Sep 11 04:38:07.011051 ip-10-0-143-244 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 04:38:07.011060 ip-10-0-143-244 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 04:38:07.011068 ip-10-0-143-244 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 04:38:07.011290 ip-10-0-143-244 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 04:38:16.783899 ip-10-0-143-244 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 11 04:38:16.783913 ip-10-0-143-244 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 2637738355b549018fe0ade1d2a5e120 --
Sep 11 04:40:09.124942 ip-10-0-143-244 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 04:40:09.510720 ip-10-0-143-244 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 04:40:09.510720 ip-10-0-143-244 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 04:40:09.510720 ip-10-0-143-244 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 04:40:09.510720 ip-10-0-143-244 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 04:40:09.510720 ip-10-0-143-244 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 04:40:09.511822 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.511729    2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 04:40:09.517646 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517618    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 04:40:09.517646 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517641    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 04:40:09.517646 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517644    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 04:40:09.517646 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517650    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 04:40:09.517646 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517653    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 04:40:09.517646 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517656    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517660    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517663    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517666    2554 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517669    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517672    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517675    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517678    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517681    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517683    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517686    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517688    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517691    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517694    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517697    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517699    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517701    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517704    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517706    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517709    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 04:40:09.517887 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517711    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 04:40:09.518368 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517714    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 04:40:09.518368 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517716    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 04:40:09.518368 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517719    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 04:40:09.518368 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517722    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 04:40:09.518368 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517724    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 04:40:09.518368 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517727    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 04:40:09.518368 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517731    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 04:40:09.518368 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517734    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 04:40:09.518368 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517737    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 04:40:09.518368 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517739    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 04:40:09.518368 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517741    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 04:40:09.518368 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517744    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 04:40:09.518368 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517748    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 04:40:09.518368 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517751    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 04:40:09.518368 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517754    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 04:40:09.518368 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517759    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 04:40:09.518368 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517762    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 04:40:09.518368 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517765    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 04:40:09.518368 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517769    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517771    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517774    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517777    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517780    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517783    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517786    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517789    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517792    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517795    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517798    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517801    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517803    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517806    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517808    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517811    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517813    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517816    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517819    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517821    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 04:40:09.518869 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517824    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 04:40:09.519349 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517826    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 04:40:09.519349 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517828    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 04:40:09.519349 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517831    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 04:40:09.519349 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517836    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 04:40:09.519349 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517839    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 04:40:09.519349 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517842    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 04:40:09.519349 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517845    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 04:40:09.519349 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517848    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 04:40:09.519349 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517851    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 04:40:09.519349 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517854    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 04:40:09.519349 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517856    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 04:40:09.519349 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517859    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 04:40:09.519349 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517861    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 04:40:09.519349 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517864    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 04:40:09.519349 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517866    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 04:40:09.519349 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517868    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 04:40:09.519349 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517871    2554 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 04:40:09.519349 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517873    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 04:40:09.519349 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517877    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 04:40:09.519826 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517881    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 04:40:09.519826 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517885    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 04:40:09.519826 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517888    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 04:40:09.519826 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517891    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 04:40:09.519826 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517894    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 04:40:09.519826 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517897    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 04:40:09.519826 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517900    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 04:40:09.519826 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517903    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 04:40:09.519826 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517906    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 04:40:09.519826 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517909    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 04:40:09.519826 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517912    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 04:40:09.519826 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517914    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 04:40:09.519826 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517917    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 04:40:09.519826 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517919    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 04:40:09.519826 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.517922    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 04:40:09.519826 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518685    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 04:40:09.519826 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518693    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 04:40:09.519826 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518697    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 04:40:09.519826 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518699    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 04:40:09.520321 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518702    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 04:40:09.520321 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518705    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 04:40:09.520321 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518708    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 04:40:09.520321 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518710    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 04:40:09.520321 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518715    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 04:40:09.520321 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518718    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 04:40:09.520321 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518721    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 04:40:09.520321 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518724    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 04:40:09.520321 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518726    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 04:40:09.520321 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518729    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 04:40:09.520321 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518732    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 04:40:09.520321 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518734    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 04:40:09.520321 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518739    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 04:40:09.520321 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518743    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 04:40:09.520321 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518747    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 04:40:09.520321 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518750    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 04:40:09.520321 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518753    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 04:40:09.520321 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518755    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 04:40:09.520321 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518758    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518760    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518764    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518766    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518769    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518772    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518774    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518777    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518779    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518782    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518784    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518787    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518789    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518792    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518795    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518797    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518800    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518803    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518805    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518808    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 04:40:09.520808 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518810    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518812    2554 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518815    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518818    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518820    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518823    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518825    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518828    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518834    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518838    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518841    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518844    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518847    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518849    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518852    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518855    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518857    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518859    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518862    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518865    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 04:40:09.528604 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518867    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518870    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518872    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518875    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518878    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518880    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518884    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518887    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518889    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518892    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518897    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518900    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518902    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518904    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518907    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518910    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518912    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518915    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518917    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518920    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 04:40:09.529110 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518922    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518925    2554 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518928    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518930    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518933    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518936    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518938    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518940    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518943    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518945    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518948    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518951    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518953    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518955    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518958    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518960    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.518963    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520203    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520211    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520214    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 04:40:09.529609 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520217    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 04:40:09.530115 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520220    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 04:40:09.530115 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520224    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 04:40:09.530115 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520227    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 04:40:09.530115 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520229    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 04:40:09.530115 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520233    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 04:40:09.530115 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520235    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 04:40:09.530115 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520237    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 04:40:09.530115 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520240    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 04:40:09.530115 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520243    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 04:40:09.530115 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520245    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 04:40:09.530115 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520248    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 04:40:09.530115 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520252    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 04:40:09.530115 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520256    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 04:40:09.530115 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520259    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 04:40:09.530115 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520262    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 04:40:09.530115 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520264    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 04:40:09.530115 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520267    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 04:40:09.530115 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520269    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 04:40:09.530115 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520272    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 04:40:09.530621 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520274    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 04:40:09.530621 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520277    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 04:40:09.530621 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520279    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 04:40:09.530621 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520281    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 04:40:09.530621 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520285    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 04:40:09.530621 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520288    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 04:40:09.530621 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520291    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 04:40:09.530621 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520293    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 04:40:09.530621 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520295    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 04:40:09.530621 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520298    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 04:40:09.530621 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520301    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 04:40:09.530621 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520303    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 04:40:09.530621 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520306    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 04:40:09.530621 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520309    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 04:40:09.530621 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520311    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 04:40:09.530621 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520314    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 04:40:09.530621 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520316    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 04:40:09.530621 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520319    2554 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 04:40:09.530621 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520321    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520324    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520327    2554 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520330    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520333    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520336    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520338    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520341    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520344    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520346    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520350    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520353    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520356    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520359    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520362    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520365    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520367    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520369    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520372    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520374    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 04:40:09.531093 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520377    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520379    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520381    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520384    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520387    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520389    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520392    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520394    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520397    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520399    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520402    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520404    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520407    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520413    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520416    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520418    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520421    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520423    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520425    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520428    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 04:40:09.531584 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520430    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520433    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520435    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520438    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520440    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520443    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520445    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520448    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520450    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520453    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520455    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520458    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520460    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520463    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520465    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520468    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520470    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.520473    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520551    2554 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520600    2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520607    2554 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 04:40:09.532065 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520612    2554 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520616    2554 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520619    2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520624    2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520628    2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520631    2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520634    2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520638    2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520640    2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520643    2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520646    2554 flags.go:64] FLAG: --cgroup-root=""
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520649    2554 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520652    2554 flags.go:64] FLAG: --client-ca-file=""
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520655    2554 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520658    2554 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520665    2554 flags.go:64] FLAG: --cluster-domain=""
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520668    2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520671    2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520674    2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520677    2554 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520681    2554 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520686    2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520689    2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 04:40:09.532614 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520693    2554 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520696    2554 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520699    2554 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520702    2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520706    2554 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520709    2554 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520713    2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520716    2554 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520719    2554 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520722    2554 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520725    2554 flags.go:64] FLAG: --enable-server="true"
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520727    2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520752    2554 flags.go:64] FLAG: --event-burst="100"
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520756    2554 flags.go:64] FLAG: --event-qps="50"
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520759    2554 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520762    2554 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520766    2554 flags.go:64] FLAG: --eviction-hard=""
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520769    2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520772    2554 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520775    2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520778    2554 flags.go:64] FLAG: --eviction-soft=""
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520781    2554 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520783    2554 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520787    2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520790    2554 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 04:40:09.533170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520792    2554 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520795    2554 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520798    2554 flags.go:64] FLAG: --feature-gates=""
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520802    2554 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520805    2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520809    2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520812    2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520815    2554 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520819    2554 flags.go:64] FLAG: --help="false"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520821    2554 flags.go:64] FLAG: --hostname-override="ip-10-0-143-244.ec2.internal"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520825    2554 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520829    2554 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520831    2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520834    2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520838    2554 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520841    2554 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520843    2554 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520847    2554 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520849    2554 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520852    2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520855    2554 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520858    2554 flags.go:64] FLAG: --kube-reserved=""
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520861    2554 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520863    2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 04:40:09.533819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520866    2554 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520869    2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520872    2554 flags.go:64] FLAG: --lock-file=""
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520874    2554 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520877    2554 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520880    2554 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520888    2554 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520892    2554 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520894    2554 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520897    2554 flags.go:64] FLAG: --logging-format="text"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520900    2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520903    2554 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520906    2554 flags.go:64] FLAG: --manifest-url=""
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520910    2554 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520914    2554 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520917    2554 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520922    2554 flags.go:64] FLAG: --max-pods="110"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520925    2554 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520928    2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520934    2554 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520937    2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520939    2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520943    2554 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520946    2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520953    2554 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 04:40:09.534398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520956    2554 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520959    2554 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520962    2554 flags.go:64] FLAG: --pod-cidr=""
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520965    2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520970    2554 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520973    2554 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520976    2554 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520979    2554 flags.go:64] FLAG: --port="10250"
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520982    2554 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520985    2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05bf6075eb5b45971"
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520988    2554 flags.go:64] FLAG: --qos-reserved=""
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520991    2554 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520994    2554 flags.go:64] FLAG: --register-node="true"
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.520996    2554 flags.go:64] FLAG: --register-with-taints=""
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521000    2554 flags.go:64] FLAG: --registry-burst="10"
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521004    2554 flags.go:64] FLAG: --registry-qps="5"
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521006    2554 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521009    2554 flags.go:64] FLAG: --reserved-memory=""
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521013    2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521016    2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521020    2554 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521023    2554 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521025    2554 flags.go:64] FLAG: --runonce="false"
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521028    2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521031    2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 04:40:09.535041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521034    2554 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521037    2554 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521042    2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521045    2554 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521048    2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521051    2554 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521054    2554 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521057    2554 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521060    2554 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521062    2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521065    2554 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521068    2554 flags.go:64] FLAG: --system-cgroups=""
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521071    2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521076    2554 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521079    2554 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521082    2554 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521093    2554 flags.go:64] FLAG: --tls-min-version=""
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521096    2554 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521099    2554 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521102    2554 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521105    2554 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521108    2554 flags.go:64] FLAG: --v="2"
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521112    2554 flags.go:64] FLAG: --version="false"
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521117    2554 flags.go:64] FLAG: --vmodule=""
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521121    2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 04:40:09.535763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.521125    2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 04:40:09.536435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521241    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 04:40:09.536435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521246    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 04:40:09.536435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521250    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 04:40:09.536435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521253    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 04:40:09.536435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521256    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 04:40:09.536435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521258    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 04:40:09.536435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521261    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 04:40:09.536435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521264    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 04:40:09.536435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521268    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 04:40:09.536435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521270    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 04:40:09.536435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521274    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 04:40:09.536435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521276    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 04:40:09.536435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521279    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 04:40:09.536435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521282    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 04:40:09.536435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521284    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 04:40:09.536435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521287    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 04:40:09.536435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521289    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 04:40:09.536435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521292    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 04:40:09.536435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521294    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521297    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521301    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521305    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521308    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521310    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521313    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521315    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521317    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521320    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521322    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521325    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521328    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521331    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521333    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521337    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521340    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521342    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521345    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521347    2554 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 04:40:09.537193 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521349    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 04:40:09.537718 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521352    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 04:40:09.537718 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521357    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 04:40:09.537718 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521361    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 04:40:09.537718 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521364    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 04:40:09.537718 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521367    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 04:40:09.537718 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521370    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 04:40:09.537718 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521372    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 04:40:09.537718 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521375    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 04:40:09.537718 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521378    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 04:40:09.537718 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521380    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 04:40:09.537718 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521383    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 04:40:09.537718 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521386    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 04:40:09.537718 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521389    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 04:40:09.537718 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521391    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 04:40:09.537718 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521394    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 04:40:09.537718 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521396    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 04:40:09.537718 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521399    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 04:40:09.537718 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521401    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 04:40:09.537718 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521404    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521406    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521408    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521411    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521414    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521416    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521419    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521422    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521426    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521428    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521431    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521433    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521436    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521438    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521441    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521444    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521447    2554 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521449    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521452    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521454    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 04:40:09.538175 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521457    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521459    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521462    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521465    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521467    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521470    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521473    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521476    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521479    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521481    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521483    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521486    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521488    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521491    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521493    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521496    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521498    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521501    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521503    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521506    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 04:40:09.538783 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521510    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 04:40:09.539398 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.521514    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 04:40:09.539398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.522105    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 04:40:09.539398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.531596    2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 04:40:09.539398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.531616    2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 04:40:09.539398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.532331    2554 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 04:40:09.539398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.532339    2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 04:40:09.539398 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532398    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 04:40:09.539398 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532404    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 04:40:09.539398 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532409    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 04:40:09.539398 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532413    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 04:40:09.539398 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532416    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 04:40:09.539398 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532419    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 04:40:09.539398 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532422    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 04:40:09.539398 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532425    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532428    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532431    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532434    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532437    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532440    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532443    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532445    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532448    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532451    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532453    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532456    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532458    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532461    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532463    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532466    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532468    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532471    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532473    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532476    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 04:40:09.540058 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532479    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532481    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532485    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532490    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532493    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532496    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532500    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532503    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532506    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532508    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532511    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532514    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532516    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532519    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532522    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532525    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532527    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532530    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532532    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532535    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 04:40:09.540613 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532538    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532540    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532543    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532545    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532547    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532551    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532554    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532557    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532560    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532563    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532566    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532568    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532583    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532586    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532589    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532593    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532596    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532599    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532602    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532604    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 04:40:09.541144 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532607    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532609    2554 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532611    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532614    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532617    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532620    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532623    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532625    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532628    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532631    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532633    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532636    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532639    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532641    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532643    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532646    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532648    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532651    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532653    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532656    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 04:40:09.541717 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532658    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 04:40:09.542202 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532661    2554 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 04:40:09.542202 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532664    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 04:40:09.542202 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532666    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 04:40:09.542202 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532668    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 04:40:09.542202 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532671    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 04:40:09.542202 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532674    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 04:40:09.542202 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532676    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 04:40:09.542202 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532680    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 04:40:09.542202 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532682    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 04:40:09.542202 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532685    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 04:40:09.542202 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532688    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 04:40:09.542202 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.532693    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 04:40:09.542202 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532829    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 04:40:09.542202 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532835    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 04:40:09.542202 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532838    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532841    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532844    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532847    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532850    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532852    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532855    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532857    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532860    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532862    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532865    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532867    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532870    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532872    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532875    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532877    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532880    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532882    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532885    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532887    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 04:40:09.542633 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532889    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532892    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532894    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532897    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532900    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532903    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532906    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532909    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532913    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532917    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532920    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532923    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532926    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532928    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532931    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532933    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532936    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532938    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532941    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532944    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 04:40:09.543124 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532946    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 04:40:09.543762 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532950    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 04:40:09.543762 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532953    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 04:40:09.543762 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532956    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 04:40:09.543762 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532959    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 04:40:09.543762 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532962    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 04:40:09.543762 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532964    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 04:40:09.543762 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532966    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 04:40:09.543762 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532969    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 04:40:09.543762 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532972    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 04:40:09.543762 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532974    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 04:40:09.543762 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532976    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 04:40:09.543762 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532979    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 04:40:09.543762 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532981    2554 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 04:40:09.543762 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532984    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 04:40:09.543762 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532987    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 04:40:09.543762 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532990    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 04:40:09.543762 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532993    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 04:40:09.543762 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532995    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 04:40:09.543762 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.532999    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533001    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533004    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533006    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533008    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533011    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533013    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533016    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533018    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533021    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533023    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533026    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533028    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533030    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533033    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533036    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533039    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533042    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533045    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533047    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 04:40:09.544278 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533049    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 04:40:09.545050 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533052    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 04:40:09.545050 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533054    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 04:40:09.545050 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533057    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 04:40:09.545050 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533059    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 04:40:09.545050 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533062    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 04:40:09.545050 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533064    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 04:40:09.545050 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533067    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 04:40:09.545050 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533069    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 04:40:09.545050 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533074    2554 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 04:40:09.545050 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533077    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 04:40:09.545050 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533079    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 04:40:09.545050 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533082    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 04:40:09.545050 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533085    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 04:40:09.545050 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533087    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 04:40:09.545050 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533090    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 04:40:09.545050 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533092    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 04:40:09.545050 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:09.533095    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 04:40:09.545475 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.533099    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 04:40:09.545475 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.533227    2554 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 04:40:09.545475 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.535309    2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 04:40:09.545475 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.536181    2554 server.go:1019] "Starting client certificate rotation"
Sep 11 04:40:09.545475 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.536297    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 04:40:09.545475 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.537001    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 04:40:09.545475 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.538464    2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 04:40:09.545475 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.543478    2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 04:40:09.556211 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.556190    2554 log.go:25] "Validated CRI v1 runtime API"
Sep 11 04:40:09.559173 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.559154    2554 log.go:25] "Validated CRI v1 image API"
Sep 11 04:40:09.560053 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.560040    2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 04:40:09.563959 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.563932    2554 fs.go:135] Filesystem UUIDs: map[5478b14e-1868-49e6-a92f-ff0a4b4f3ebf:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d87c10d6-3be5-497a-b9dc-87a170acd508:/dev/nvme0n1p3]
Sep 11 04:40:09.564033 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.563959    2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 04:40:09.569562 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.569533    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 04:40:09.570155 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.570030    2554 manager.go:216] Machine: {Timestamp:2026-09-11 04:40:09.568830051 +0000 UTC m=+0.324845403 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095629 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2017fd37670e78d4420308032c3caf SystemUUID:ec2017fd-3767-0e78-d442-0308032c3caf BootID:26377383-55b5-4901-8fe0-ade1d2a5e120 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:84:76:93:5b:a5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:84:76:93:5b:a5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:de:92:cc:af:ba Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 04:40:09.570155 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.570152    2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 04:40:09.570262 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.570251    2554 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 04:40:09.571327 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.571303    2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 04:40:09.571493 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.571330    2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-244.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 04:40:09.572233 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.572222    2554 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 04:40:09.572276 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.572235    2554 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 04:40:09.572276 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.572242    2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 04:40:09.572827 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.572816    2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 04:40:09.573613 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.573604    2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 04:40:09.578012 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.577998    2554 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 04:40:09.578130 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.578120    2554 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 04:40:09.578172 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.578152    2554 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 04:40:09.578172 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.578163    2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 04:40:09.578236 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.578174    2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 04:40:09.578236 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.578188    2554 kubelet.go:398] "Adding apiserver pod source"
Sep 11 04:40:09.578236 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.578197    2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 04:40:09.578605 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.578592    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 04:40:09.578673 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.578612    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 04:40:09.580934 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.580919    2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 04:40:09.583521 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.583505    2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 04:40:09.583599 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.583537    2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 04:40:09.585253 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.585240    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 04:40:09.585306 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.585257    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 04:40:09.585306 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.585263    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 04:40:09.585306 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.585268    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 04:40:09.585306 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.585282    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 04:40:09.585306 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.585291    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 04:40:09.585306 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.585305    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 04:40:09.585502 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.585310    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 04:40:09.585502 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.585318    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 04:40:09.585502 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.585324    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 04:40:09.585502 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.585345    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 04:40:09.585502 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.585350    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 04:40:09.586126 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.586113    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 04:40:09.586172 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.586129    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 04:40:09.588034 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:09.588000    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 04:40:09.588131 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:09.588018    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 04:40:09.589931 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.589917    2554 server.go:1268] "Started kubelet"
Sep 11 04:40:09.590081 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.590030    2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 04:40:09.590252 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.590016    2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 04:40:09.590252 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.590225    2554 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 04:40:09.590776 ip-10-0-143-244 systemd[1]: Started Kubernetes Kubelet.
Sep 11 04:40:09.592794 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.592160    2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 04:40:09.592794 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.592439    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2fnch"
Sep 11 04:40:09.594303 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.594283    2554 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 04:40:09.597412 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.597393    2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-244.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 04:40:09.597508 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:09.597466    2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 04:40:09.598254 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:09.597440    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-244.ec2.internal.18d42a6f52af4eb7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-244.ec2.internal,UID:ip-10-0-143-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-244.ec2.internal,},FirstTimestamp:2026-09-11 04:40:09.589886647 +0000 UTC m=+0.345901999,LastTimestamp:2026-09-11 04:40:09.589886647 +0000 UTC m=+0.345901999,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-244.ec2.internal,}"
Sep 11 04:40:09.599606 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.599593    2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 04:40:09.599675 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.599608    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 04:40:09.599779 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:09.599763    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Sep 11 04:40:09.599874 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.599857    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2fnch"
Sep 11 04:40:09.600279 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.600257    2554 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 04:40:09.600279 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.600281    2554 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 04:40:09.600397 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.600369    2554 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 04:40:09.600397 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.600379    2554 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 04:40:09.600494 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.600428    2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 04:40:09.601463 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.601443    2554 factory.go:55] Registering systemd factory
Sep 11 04:40:09.601463 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.601461    2554 factory.go:223] Registration of the systemd container factory successfully
Sep 11 04:40:09.601732 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.601715    2554 factory.go:153] Registering CRI-O factory
Sep 11 04:40:09.601811 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.601735    2554 factory.go:223] Registration of the crio container factory successfully
Sep 11 04:40:09.601811 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.601787    2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 04:40:09.601811 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.601805    2554 factory.go:103] Registering Raw factory
Sep 11 04:40:09.601959 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.601819    2554 manager.go:1196] Started watching for new ooms in manager
Sep 11 04:40:09.602254 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.602239    2554 manager.go:349] Starting recovery of all containers
Sep 11 04:40:09.604436 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:09.604403    2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 04:40:09.604742 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:09.604706    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 04:40:09.613089 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.613073    2554 manager.go:354] Recovery completed
Sep 11 04:40:09.617086 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.617072    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 04:40:09.618912 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.618893    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 04:40:09.618995 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.618926    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 04:40:09.618995 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.618940    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
Sep 11 04:40:09.619551 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.619539    2554 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 04:40:09.619551 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.619551    2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 04:40:09.619664 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.619565    2554 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 04:40:09.619664 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.619610    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 04:40:09.620771 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.620753    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 04:40:09.620863 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.620787    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 04:40:09.620863 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.620803    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
Sep 11 04:40:09.621674 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.621661    2554 policy_none.go:49] "None policy: Start"
Sep 11 04:40:09.621729 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.621678    2554 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 04:40:09.621729 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.621689    2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 04:40:09.623646 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.623635    2554 policy_none.go:47] "Start"
Sep 11 04:40:09.687119 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.672250    2554 manager.go:337] "Starting Device Plugin manager"
Sep 11 04:40:09.687119 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:09.672304    2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 04:40:09.687119 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.672319    2554 server.go:87] "Starting device plugin registration server"
Sep 11 04:40:09.687119 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.672722    2554 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 04:40:09.687119 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.672733    2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 04:40:09.687119 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.672836    2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 04:40:09.687119 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.672934    2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 04:40:09.687119 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.672944    2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 04:40:09.687119 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:09.673516    2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 04:40:09.687119 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:09.673567    2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-244.ec2.internal\" not found"
Sep 11 04:40:09.702341 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.702304    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 04:40:09.703859 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.703827    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 04:40:09.703963 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.703886    2554 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 04:40:09.703963 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.703921    2554 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 04:40:09.704047 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:09.703967    2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 04:40:09.706343 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.706323    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 04:40:09.773422 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.773288    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 04:40:09.774700 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.774676    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 04:40:09.774788 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.774715    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 04:40:09.774788 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.774728    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
Sep 11 04:40:09.774788 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.774754    2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-244.ec2.internal"
Sep 11 04:40:09.782745 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.782722    2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-244.ec2.internal"
Sep 11 04:40:09.782822 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:09.782750    2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-244.ec2.internal\": node \"ip-10-0-143-244.ec2.internal\" not found"
Sep 11 04:40:09.798945 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:09.798915    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Sep 11 04:40:09.804177 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.804139    2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"]
Sep 11 04:40:09.804264 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.804227    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 04:40:09.805852 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.805829    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 04:40:09.805852 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.805857    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 04:40:09.805994 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.805869    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
Sep 11 04:40:09.808181 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.808159    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 04:40:09.808326 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.808274    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
Sep 11 04:40:09.808326 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.808307    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 04:40:09.809160 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.809143    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 04:40:09.809228 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.809176    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 04:40:09.809228 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.809188    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
Sep 11 04:40:09.809304 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.809144    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 04:40:09.809304 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.809245    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 04:40:09.809304 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.809258    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
Sep 11 04:40:09.811492 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.811478    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"
Sep 11 04:40:09.811559 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.811504    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 04:40:09.812464 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.812445    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 04:40:09.812552 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.812485    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 04:40:09.812552 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:09.812503    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeHasSufficientPID"
Sep 11 04:40:09.834446 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:09.834424    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-244.ec2.internal\" not found" node="ip-10-0-143-244.ec2.internal"
Sep 11 04:40:09.837938 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:09.837922    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-244.ec2.internal\" not found" node="ip-10-0-143-244.ec2.internal"
Sep 11 04:40:09.899980 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:09.899953    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Sep 11 04:40:10.000273 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:10.000228    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Sep 11 04:40:10.001412 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:10.001398    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1ac2d8c39f840eb50ee15953820bbe61-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal\" (UID: \"1ac2d8c39f840eb50ee15953820bbe61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
Sep 11 04:40:10.001469 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:10.001421    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ac2d8c39f840eb50ee15953820bbe61-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal\" (UID: \"1ac2d8c39f840eb50ee15953820bbe61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
Sep 11 04:40:10.001469 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:10.001443    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1dc5f07142ffec6eb419ac61ce92a9d5-config\") pod \"kube-apiserver-proxy-ip-10-0-143-244.ec2.internal\" (UID: \"1dc5f07142ffec6eb419ac61ce92a9d5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"
Sep 11 04:40:10.100849 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:10.100806    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Sep 11 04:40:10.101967 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:10.101949    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1dc5f07142ffec6eb419ac61ce92a9d5-config\") pod \"kube-apiserver-proxy-ip-10-0-143-244.ec2.internal\" (UID: \"1dc5f07142ffec6eb419ac61ce92a9d5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"
Sep 11 04:40:10.102015 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:10.101977    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1ac2d8c39f840eb50ee15953820bbe61-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal\" (UID: \"1ac2d8c39f840eb50ee15953820bbe61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
Sep 11 04:40:10.102015 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:10.102007    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ac2d8c39f840eb50ee15953820bbe61-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal\" (UID: \"1ac2d8c39f840eb50ee15953820bbe61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
Sep 11 04:40:10.102082 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:10.102071    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ac2d8c39f840eb50ee15953820bbe61-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal\" (UID: \"1ac2d8c39f840eb50ee15953820bbe61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
Sep 11 04:40:10.102120 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:10.102080    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1dc5f07142ffec6eb419ac61ce92a9d5-config\") pod \"kube-apiserver-proxy-ip-10-0-143-244.ec2.internal\" (UID: \"1dc5f07142ffec6eb419ac61ce92a9d5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"
Sep 11 04:40:10.102120 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:10.102080    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1ac2d8c39f840eb50ee15953820bbe61-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal\" (UID: \"1ac2d8c39f840eb50ee15953820bbe61\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
Sep 11 04:40:10.137124 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:10.137093    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
Sep 11 04:40:10.140865 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:10.140832    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"
Sep 11 04:40:10.201689 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:10.201652    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Sep 11 04:40:10.302076 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:10.302036    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Sep 11 04:40:10.402623 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:10.402509    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Sep 11 04:40:10.502964 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:10.502932    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Sep 11 04:40:10.536190 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:10.536164    2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 04:40:10.536622 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:10.536315    2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 04:40:10.603868 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:10.603837    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Sep 11 04:40:10.605351 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:10.605316    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 04:35:10 +0000 UTC" deadline="2028-02-09 12:47:46.611638925 +0000 UTC"
Sep 11 04:40:10.605351 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:10.605349    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12392h7m36.006293876s"
Sep 11 04:40:10.704965 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:10.704893    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Sep 11 04:40:10.758960 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:10.757988    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc5f07142ffec6eb419ac61ce92a9d5.slice/crio-678c557657478e38dd1ac836a23f8f7511b966d090a356645ab2dc17e4803841 WatchSource:0}: Error finding container 678c557657478e38dd1ac836a23f8f7511b966d090a356645ab2dc17e4803841: Status 404 returned error can't find the container with id 678c557657478e38dd1ac836a23f8f7511b966d090a356645ab2dc17e4803841
Sep 11 04:40:10.759112 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:10.759027    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac2d8c39f840eb50ee15953820bbe61.slice/crio-c72ea3f77314330be98c2a59d2310e327bd6a5033bc4e34dba15b28f95cc8748 WatchSource:0}: Error finding container c72ea3f77314330be98c2a59d2310e327bd6a5033bc4e34dba15b28f95cc8748: Status 404 returned error can't find the container with id c72ea3f77314330be98c2a59d2310e327bd6a5033bc4e34dba15b28f95cc8748
Sep 11 04:40:10.762699 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:10.762684    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 04:40:10.778552 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:10.778525    2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 04:40:10.806036 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:10.806006    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Sep 11 04:40:10.807019 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:10.807003    2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 04:40:10.906681 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:10.906650    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Sep 11 04:40:11.007119 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:11.007048    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Sep 11 04:40:12.210519 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:12.210479    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-244.ec2.internal\" not found"
Sep 11 04:40:12.245596 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.245565    2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 04:40:12.303437 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.303402    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal"
Sep 11 04:40:12.313766 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.313741    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 04:40:12.314913 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.314894    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal"
Sep 11 04:40:12.322214 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.322192    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 04:40:12.681624 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.681594    2554 apiserver.go:52] "Watching apiserver"
Sep 11 04:40:12.688928 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.688570    2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 04:40:12.694299 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.692450    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-d66qg","kube-system/konnectivity-agent-ghlxt","kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal","openshift-cluster-node-tuning-operator/tuned-vjkgd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal","openshift-multus/multus-additional-cni-plugins-t88qn","openshift-multus/network-metrics-daemon-2r4m7","openshift-network-diagnostics/network-check-target-tgt9r","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5","openshift-dns/node-resolver-zmltd","openshift-image-registry/node-ca-ddk77","openshift-multus/multus-68r27","openshift-network-operator/iptables-alerter-qd5ll","openshift-ovn-kubernetes/ovnkube-node-2x5gc"]
Sep 11 04:40:12.695811 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.695669    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:12.695811 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:12.695750    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2r4m7" podUID="8aaff5eb-511c-4772-84b1-d51c257ef1c8"
Sep 11 04:40:12.698534 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.698012    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ddk77"
Sep 11 04:40:12.701266 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.700613    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.702121 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.701707    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 04:40:12.702121 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.701744    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 04:40:12.702121 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.701773    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9mqhq\""
Sep 11 04:40:12.702121 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.701706    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 04:40:12.702986 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.702652    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.705168 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.703318    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 04:40:12.705168 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.703491    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 04:40:12.705168 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.704261    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 04:40:12.705168 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.704435    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 04:40:12.705168 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.704562    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 04:40:12.705168 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.704726    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 04:40:12.705168 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.704854    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wtcd4\""
Sep 11 04:40:12.705168 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.704993    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 04:40:12.705622 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.705316    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.706345 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.706175    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 04:40:12.706345 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.706201    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 04:40:12.706345 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.706166    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m7hp2\""
Sep 11 04:40:12.707355 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.707205    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 04:40:12.707755 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.707603    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mk4mp\""
Sep 11 04:40:12.707755 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.707632    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 04:40:12.708165 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.707943    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.708764 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.708447    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 04:40:12.708764 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.708630    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 04:40:12.710254 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.710239    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 04:40:12.710254 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.710240    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 04:40:12.710890 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.710494    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.711706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.711355    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pbb6b\""
Sep 11 04:40:12.716101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.712191    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 04:40:12.716101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.712567    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gc6gm\""
Sep 11 04:40:12.716101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.712802    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 04:40:12.716101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.714058    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 04:40:12.716101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.714686    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4aad5d06-7f07-4419-9038-450a380246f9-etc-tuned\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.716101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.714735    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4aad5d06-7f07-4419-9038-450a380246f9-tmp\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.716101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.714761    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-kubelet\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.716101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.714783    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-systemd-units\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.716101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.714804    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-cni-netd\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.716101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.714827    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmbkl\" (UniqueName: \"kubernetes.io/projected/ca5086d2-4a84-4130-a5ab-cad1e43a286d-kube-api-access-mmbkl\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.716101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.714870    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-etc-modprobe-d\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.716101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.714892    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-host-run-netns\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.716101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.714916    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs\") pod \"network-metrics-daemon-2r4m7\" (UID: \"8aaff5eb-511c-4772-84b1-d51c257ef1c8\") " pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:12.716101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.715280    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-lib-modules\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.716101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.715303    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-cnibin\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.716101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.715361    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-host-run-k8s-cni-cncf-io\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.716101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.715384    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55lkd\" (UniqueName: \"kubernetes.io/projected/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-kube-api-access-55lkd\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.716101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.715406    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92kfh\" (UniqueName: \"kubernetes.io/projected/b096f3e4-4f74-419a-b6ff-c7d246dfa1d1-kube-api-access-92kfh\") pod \"node-ca-ddk77\" (UID: \"b096f3e4-4f74-419a-b6ff-c7d246dfa1d1\") " pod="openshift-image-registry/node-ca-ddk77"
Sep 11 04:40:12.716101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.715430    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-etc-openvswitch\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.717035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.715454    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-run-openvswitch\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.717035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.715494    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.717035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.715530    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-run\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.717035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.715553    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-hostroot\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.717035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.715577    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-host-run-multus-certs\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.717035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.715601    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-run-ovn\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.717035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.715666    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-node-log\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.717035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.715703    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca5086d2-4a84-4130-a5ab-cad1e43a286d-ovn-node-metrics-cert\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.717035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.715742    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qd5ll"
Sep 11 04:40:12.717035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.715756    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ghlxt"
Sep 11 04:40:12.717035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.715740    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-cni-binary-copy\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.717035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716103    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-host-var-lib-cni-multus\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.717035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716139    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b096f3e4-4f74-419a-b6ff-c7d246dfa1d1-host\") pod \"node-ca-ddk77\" (UID: \"b096f3e4-4f74-419a-b6ff-c7d246dfa1d1\") " pod="openshift-image-registry/node-ca-ddk77"
Sep 11 04:40:12.717035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716170    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ca5086d2-4a84-4130-a5ab-cad1e43a286d-ovnkube-script-lib\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.717035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716193    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-etc-systemd\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.717035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716216    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-var-lib-openvswitch\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.717035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716240    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-etc-sysctl-d\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.717035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716261    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-host\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.717952 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716284    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-multus-conf-dir\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.717952 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716306    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ca5086d2-4a84-4130-a5ab-cad1e43a286d-ovnkube-config\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.717952 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716386    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-var-lib-kubelet\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.717952 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716416    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vstm\" (UniqueName: \"kubernetes.io/projected/4aad5d06-7f07-4419-9038-450a380246f9-kube-api-access-4vstm\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.717952 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716439    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-host-var-lib-kubelet\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.717952 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716495    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-etc-kubernetes\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.717952 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716519    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-slash\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.717952 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716540    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ca5086d2-4a84-4130-a5ab-cad1e43a286d-env-overrides\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.717952 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716563    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-etc-sysctl-conf\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.717952 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716588    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-system-cni-dir\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.717952 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716612    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6fgb\" (UniqueName: \"kubernetes.io/projected/8aaff5eb-511c-4772-84b1-d51c257ef1c8-kube-api-access-g6fgb\") pod \"network-metrics-daemon-2r4m7\" (UID: \"8aaff5eb-511c-4772-84b1-d51c257ef1c8\") " pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:12.717952 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716633    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b096f3e4-4f74-419a-b6ff-c7d246dfa1d1-serviceca\") pod \"node-ca-ddk77\" (UID: \"b096f3e4-4f74-419a-b6ff-c7d246dfa1d1\") " pod="openshift-image-registry/node-ca-ddk77"
Sep 11 04:40:12.717952 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716656    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-run-systemd\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.717952 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716693    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-log-socket\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.717952 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716762    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-etc-sysconfig\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.717952 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716791    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-multus-cni-dir\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.717952 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716825    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-etc-kubernetes\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.718858 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716859    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-run-netns\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.718858 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716888    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-cni-bin\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.718858 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716915    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-multus-socket-dir-parent\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.718858 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716943    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-host-var-lib-cni-bin\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.718858 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716965    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-multus-daemon-config\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.718858 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.716996    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-run-ovn-kubernetes\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.718858 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.717029    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-sys\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.718858 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.718105    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 04:40:12.718858 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.718301    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 04:40:12.718858 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.718525    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zmltd"
Sep 11 04:40:12.719502 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.718874    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 04:40:12.719502 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.719055    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 04:40:12.721012 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.720095    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mcmpx\""
Sep 11 04:40:12.721012 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.720317    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 04:40:12.721012 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.720497    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 04:40:12.721012 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.720631    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l95dm\""
Sep 11 04:40:12.721012 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.720687    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 04:40:12.721012 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.720720    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 04:40:12.721012 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.720819    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qlqh8\""
Sep 11 04:40:12.728471 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.725957    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:12.728471 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:12.726212    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d66qg" podUID="216c51f9-f976-4b58-a9ab-96bef1bf776c"
Sep 11 04:40:12.733018 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.732995    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:12.733128 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:12.733056    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgt9r" podUID="e0bd904c-02f2-47ab-8605-4791b0ea678e"
Sep 11 04:40:12.735748 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.735724    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dt4fh"
Sep 11 04:40:12.742953 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.742929    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dt4fh"
Sep 11 04:40:12.804847 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.804817    2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 04:40:12.812737 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.812675    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal" event={"ID":"1dc5f07142ffec6eb419ac61ce92a9d5","Type":"ContainerStarted","Data":"678c557657478e38dd1ac836a23f8f7511b966d090a356645ab2dc17e4803841"}
Sep 11 04:40:12.814989 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.814958    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal" event={"ID":"1ac2d8c39f840eb50ee15953820bbe61","Type":"ContainerStarted","Data":"c72ea3f77314330be98c2a59d2310e327bd6a5033bc4e34dba15b28f95cc8748"}
Sep 11 04:40:12.818251 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818226    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ca5086d2-4a84-4130-a5ab-cad1e43a286d-env-overrides\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.818491 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818262    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-etc-sysctl-conf\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.818491 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818283    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-system-cni-dir\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.818491 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818371    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e1c2694b-8c0f-4f81-8a76-956c1615be81-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.818491 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818406    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f32aea16-a091-4521-8695-5ccb48885bbe-registration-dir\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.818491 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818435    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb54x\" (UniqueName: \"kubernetes.io/projected/c24c3cd6-c444-489a-a59d-d9ce9f02217e-kube-api-access-qb54x\") pod \"iptables-alerter-qd5ll\" (UID: \"c24c3cd6-c444-489a-a59d-d9ce9f02217e\") " pod="openshift-network-operator/iptables-alerter-qd5ll"
Sep 11 04:40:12.818491 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818437    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-system-cni-dir\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.818491 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818450    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-etc-sysctl-conf\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.818491 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818460    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6fgb\" (UniqueName: \"kubernetes.io/projected/8aaff5eb-511c-4772-84b1-d51c257ef1c8-kube-api-access-g6fgb\") pod \"network-metrics-daemon-2r4m7\" (UID: \"8aaff5eb-511c-4772-84b1-d51c257ef1c8\") " pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:12.818491 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818485    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b096f3e4-4f74-419a-b6ff-c7d246dfa1d1-serviceca\") pod \"node-ca-ddk77\" (UID: \"b096f3e4-4f74-419a-b6ff-c7d246dfa1d1\") " pod="openshift-image-registry/node-ca-ddk77"
Sep 11 04:40:12.818920 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818508    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmwnj\" (UniqueName: \"kubernetes.io/projected/f32aea16-a091-4521-8695-5ccb48885bbe-kube-api-access-kmwnj\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.818920 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818531    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-run-systemd\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.818920 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818554    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-log-socket\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.818920 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818578    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-etc-sysconfig\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.818920 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818637    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-etc-sysconfig\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.818920 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818695    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-run-systemd\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.818920 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818731    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-log-socket\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.818920 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818747    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-multus-cni-dir\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.818920 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818770    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-etc-kubernetes\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.818920 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818786    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-run-netns\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.818920 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818802    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-cni-bin\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.818920 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818816    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-multus-socket-dir-parent\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.818920 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818837    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ca5086d2-4a84-4130-a5ab-cad1e43a286d-env-overrides\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.818920 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818848    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-host-var-lib-cni-bin\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.818920 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818875    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-run-netns\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.818920 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818885    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-multus-daemon-config\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.818920 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818895    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-multus-cni-dir\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.818920 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818902    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-cni-bin\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.819706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818921    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-multus-socket-dir-parent\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.819706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818922    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-run-ovn-kubernetes\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.819706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818930    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-host-var-lib-cni-bin\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.819706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818952    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-run-ovn-kubernetes\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.819706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818957    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-sys\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.819706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818966    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-etc-kubernetes\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.819706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818990    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1c2694b-8c0f-4f81-8a76-956c1615be81-cnibin\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.819706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.818994    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b096f3e4-4f74-419a-b6ff-c7d246dfa1d1-serviceca\") pod \"node-ca-ddk77\" (UID: \"b096f3e4-4f74-419a-b6ff-c7d246dfa1d1\") " pod="openshift-image-registry/node-ca-ddk77"
Sep 11 04:40:12.819706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819003    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-sys\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.819706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819015    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f32aea16-a091-4521-8695-5ccb48885bbe-socket-dir\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.819706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819037    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c9e693e-282c-44df-9ecd-485c40bc15a0-hosts-file\") pod \"node-resolver-zmltd\" (UID: \"4c9e693e-282c-44df-9ecd-485c40bc15a0\") " pod="openshift-dns/node-resolver-zmltd"
Sep 11 04:40:12.819706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819057    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/216c51f9-f976-4b58-a9ab-96bef1bf776c-dbus\") pod \"global-pull-secret-syncer-d66qg\" (UID: \"216c51f9-f976-4b58-a9ab-96bef1bf776c\") " pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:12.819706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819080    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4aad5d06-7f07-4419-9038-450a380246f9-etc-tuned\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.819706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819109    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4aad5d06-7f07-4419-9038-450a380246f9-tmp\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.819706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819134    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e1c2694b-8c0f-4f81-8a76-956c1615be81-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.819706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819160    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c9e693e-282c-44df-9ecd-485c40bc15a0-tmp-dir\") pod \"node-resolver-zmltd\" (UID: \"4c9e693e-282c-44df-9ecd-485c40bc15a0\") " pod="openshift-dns/node-resolver-zmltd"
Sep 11 04:40:12.819706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819182    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-kubelet\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.820390 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819204    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-systemd-units\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.820390 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819226    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-cni-netd\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.820390 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819249    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmbkl\" (UniqueName: \"kubernetes.io/projected/ca5086d2-4a84-4130-a5ab-cad1e43a286d-kube-api-access-mmbkl\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.820390 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819262    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-kubelet\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.820390 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819284    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-systemd-units\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.820390 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819269    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-etc-modprobe-d\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.820390 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819313    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-host-run-netns\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.820390 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819322    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-cni-netd\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.820390 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819350    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs\") pod \"network-metrics-daemon-2r4m7\" (UID: \"8aaff5eb-511c-4772-84b1-d51c257ef1c8\") " pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:12.820390 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819362    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-etc-modprobe-d\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.820390 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819388    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h4c8\" (UniqueName: \"kubernetes.io/projected/e1c2694b-8c0f-4f81-8a76-956c1615be81-kube-api-access-4h4c8\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.820390 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819398    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-host-run-netns\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.820390 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819415    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-multus-daemon-config\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.820390 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819420    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-lib-modules\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.820390 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819457    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-cnibin\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.820390 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819477    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-host-run-k8s-cni-cncf-io\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.820390 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819505    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-cnibin\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.820390 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819506    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55lkd\" (UniqueName: \"kubernetes.io/projected/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-kube-api-access-55lkd\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.821079 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819535    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92kfh\" (UniqueName: \"kubernetes.io/projected/b096f3e4-4f74-419a-b6ff-c7d246dfa1d1-kube-api-access-92kfh\") pod \"node-ca-ddk77\" (UID: \"b096f3e4-4f74-419a-b6ff-c7d246dfa1d1\") " pod="openshift-image-registry/node-ca-ddk77"
Sep 11 04:40:12.821079 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819560    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f32aea16-a091-4521-8695-5ccb48885bbe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.821079 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819569    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-lib-modules\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.821079 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819536    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-host-run-k8s-cni-cncf-io\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.821079 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819587    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c24c3cd6-c444-489a-a59d-d9ce9f02217e-iptables-alerter-script\") pod \"iptables-alerter-qd5ll\" (UID: \"c24c3cd6-c444-489a-a59d-d9ce9f02217e\") " pod="openshift-network-operator/iptables-alerter-qd5ll"
Sep 11 04:40:12.821079 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819667    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w77hh\" (UniqueName: \"kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh\") pod \"network-check-target-tgt9r\" (UID: \"e0bd904c-02f2-47ab-8605-4791b0ea678e\") " pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:12.821079 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819694    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1c2694b-8c0f-4f81-8a76-956c1615be81-cni-binary-copy\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.821079 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819720    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f32aea16-a091-4521-8695-5ccb48885bbe-device-dir\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.821079 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819720    2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 04:40:12.821079 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819747    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f87de3b3-7604-4f7a-8c87-c5fabe66555b-konnectivity-ca\") pod \"konnectivity-agent-ghlxt\" (UID: \"f87de3b3-7604-4f7a-8c87-c5fabe66555b\") " pod="kube-system/konnectivity-agent-ghlxt"
Sep 11 04:40:12.821079 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819774    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-etc-openvswitch\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.821079 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819797    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-run-openvswitch\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.821079 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819824    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.821079 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:12.819829    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 04:40:12.821079 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819848    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-run\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.821079 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819860    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-etc-openvswitch\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.821079 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819870    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-hostroot\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.821999 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:12.819900    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs podName:8aaff5eb-511c-4772-84b1-d51c257ef1c8 nodeName:}" failed. No retries permitted until 2026-09-11 04:40:13.31988036 +0000 UTC m=+2.973140021 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs") pod "network-metrics-daemon-2r4m7" (UID: "8aaff5eb-511c-4772-84b1-d51c257ef1c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 04:40:12.821999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819920    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-host-run-multus-certs\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.821999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819940    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-run-openvswitch\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.821999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819945    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.821999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819943    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-hostroot\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.821999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819959    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1c2694b-8c0f-4f81-8a76-956c1615be81-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.821999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819979    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-run\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.821999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819988    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-host-run-multus-certs\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.821999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.819989    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jntb7\" (UniqueName: \"kubernetes.io/projected/4c9e693e-282c-44df-9ecd-485c40bc15a0-kube-api-access-jntb7\") pod \"node-resolver-zmltd\" (UID: \"4c9e693e-282c-44df-9ecd-485c40bc15a0\") " pod="openshift-dns/node-resolver-zmltd"
Sep 11 04:40:12.821999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820020    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-run-ovn\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.821999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820037    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-run-ovn\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.821999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820045    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-node-log\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.821999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820070    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca5086d2-4a84-4130-a5ab-cad1e43a286d-ovn-node-metrics-cert\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.821999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820116    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-node-log\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.821999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820146    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-cni-binary-copy\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.821999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820163    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-host-var-lib-cni-multus\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.821999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820183    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b096f3e4-4f74-419a-b6ff-c7d246dfa1d1-host\") pod \"node-ca-ddk77\" (UID: \"b096f3e4-4f74-419a-b6ff-c7d246dfa1d1\") " pod="openshift-image-registry/node-ca-ddk77"
Sep 11 04:40:12.822840 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820200    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/216c51f9-f976-4b58-a9ab-96bef1bf776c-kubelet-config\") pod \"global-pull-secret-syncer-d66qg\" (UID: \"216c51f9-f976-4b58-a9ab-96bef1bf776c\") " pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:12.822840 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820227    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ca5086d2-4a84-4130-a5ab-cad1e43a286d-ovnkube-script-lib\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.822840 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820248    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-host-var-lib-cni-multus\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.822840 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820251    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-etc-systemd\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.822840 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820268    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b096f3e4-4f74-419a-b6ff-c7d246dfa1d1-host\") pod \"node-ca-ddk77\" (UID: \"b096f3e4-4f74-419a-b6ff-c7d246dfa1d1\") " pod="openshift-image-registry/node-ca-ddk77"
Sep 11 04:40:12.822840 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820290    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-var-lib-openvswitch\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.822840 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820316    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-etc-sysctl-d\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.822840 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820355    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-host\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.822840 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820323    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-etc-systemd\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.822840 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820399    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-var-lib-openvswitch\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.822840 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820402    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-host\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.822840 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820419    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-multus-conf-dir\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.822840 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820442    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f87de3b3-7604-4f7a-8c87-c5fabe66555b-agent-certs\") pod \"konnectivity-agent-ghlxt\" (UID: \"f87de3b3-7604-4f7a-8c87-c5fabe66555b\") " pod="kube-system/konnectivity-agent-ghlxt"
Sep 11 04:40:12.822840 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820463    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ca5086d2-4a84-4130-a5ab-cad1e43a286d-ovnkube-config\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.822840 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820485    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-var-lib-kubelet\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.822840 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820491    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-etc-sysctl-d\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.822840 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820505    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c24c3cd6-c444-489a-a59d-d9ce9f02217e-host-slash\") pod \"iptables-alerter-qd5ll\" (UID: \"c24c3cd6-c444-489a-a59d-d9ce9f02217e\") " pod="openshift-network-operator/iptables-alerter-qd5ll"
Sep 11 04:40:12.822840 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820560    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-cni-binary-copy\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.823693 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820561    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-multus-conf-dir\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.823693 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820530    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vstm\" (UniqueName: \"kubernetes.io/projected/4aad5d06-7f07-4419-9038-450a380246f9-kube-api-access-4vstm\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.823693 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820595    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4aad5d06-7f07-4419-9038-450a380246f9-var-lib-kubelet\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.823693 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820599    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-host-var-lib-kubelet\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.823693 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820647    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-host-var-lib-kubelet\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.823693 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820710    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-etc-kubernetes\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.823693 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820749    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1c2694b-8c0f-4f81-8a76-956c1615be81-system-cni-dir\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.823693 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820763    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-etc-kubernetes\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.823693 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820776    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f32aea16-a091-4521-8695-5ccb48885bbe-etc-selinux\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.823693 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820806    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f32aea16-a091-4521-8695-5ccb48885bbe-sys-fs\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.823693 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820829    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret\") pod \"global-pull-secret-syncer-d66qg\" (UID: \"216c51f9-f976-4b58-a9ab-96bef1bf776c\") " pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:12.823693 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820851    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-slash\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.823693 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820861    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ca5086d2-4a84-4130-a5ab-cad1e43a286d-ovnkube-script-lib\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.823693 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820894    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ca5086d2-4a84-4130-a5ab-cad1e43a286d-ovnkube-config\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.823693 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.820919    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ca5086d2-4a84-4130-a5ab-cad1e43a286d-host-slash\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.824597 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.824577    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4aad5d06-7f07-4419-9038-450a380246f9-tmp\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.824662 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.824635    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4aad5d06-7f07-4419-9038-450a380246f9-etc-tuned\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.826163 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.826115    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ca5086d2-4a84-4130-a5ab-cad1e43a286d-ovn-node-metrics-cert\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.832235 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.832203    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6fgb\" (UniqueName: \"kubernetes.io/projected/8aaff5eb-511c-4772-84b1-d51c257ef1c8-kube-api-access-g6fgb\") pod \"network-metrics-daemon-2r4m7\" (UID: \"8aaff5eb-511c-4772-84b1-d51c257ef1c8\") " pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:12.833009 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.832960    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92kfh\" (UniqueName: \"kubernetes.io/projected/b096f3e4-4f74-419a-b6ff-c7d246dfa1d1-kube-api-access-92kfh\") pod \"node-ca-ddk77\" (UID: \"b096f3e4-4f74-419a-b6ff-c7d246dfa1d1\") " pod="openshift-image-registry/node-ca-ddk77"
Sep 11 04:40:12.833899 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.833853    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmbkl\" (UniqueName: \"kubernetes.io/projected/ca5086d2-4a84-4130-a5ab-cad1e43a286d-kube-api-access-mmbkl\") pod \"ovnkube-node-2x5gc\" (UID: \"ca5086d2-4a84-4130-a5ab-cad1e43a286d\") " pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:12.834400 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.834360    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vstm\" (UniqueName: \"kubernetes.io/projected/4aad5d06-7f07-4419-9038-450a380246f9-kube-api-access-4vstm\") pod \"tuned-vjkgd\" (UID: \"4aad5d06-7f07-4419-9038-450a380246f9\") " pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:12.834636 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.834619    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55lkd\" (UniqueName: \"kubernetes.io/projected/355c0baf-57fe-40e8-ad75-3ef2bebb40c2-kube-api-access-55lkd\") pod \"multus-68r27\" (UID: \"355c0baf-57fe-40e8-ad75-3ef2bebb40c2\") " pod="openshift-multus/multus-68r27"
Sep 11 04:40:12.855289 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.853541    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 04:40:12.922139 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922099    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1c2694b-8c0f-4f81-8a76-956c1615be81-cnibin\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.922322 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922146    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f32aea16-a091-4521-8695-5ccb48885bbe-socket-dir\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.922322 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922175    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c9e693e-282c-44df-9ecd-485c40bc15a0-hosts-file\") pod \"node-resolver-zmltd\" (UID: \"4c9e693e-282c-44df-9ecd-485c40bc15a0\") " pod="openshift-dns/node-resolver-zmltd"
Sep 11 04:40:12.922322 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922189    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1c2694b-8c0f-4f81-8a76-956c1615be81-cnibin\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.922322 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922196    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/216c51f9-f976-4b58-a9ab-96bef1bf776c-dbus\") pod \"global-pull-secret-syncer-d66qg\" (UID: \"216c51f9-f976-4b58-a9ab-96bef1bf776c\") " pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:12.922322 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922251    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e1c2694b-8c0f-4f81-8a76-956c1615be81-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.922322 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922279    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c9e693e-282c-44df-9ecd-485c40bc15a0-tmp-dir\") pod \"node-resolver-zmltd\" (UID: \"4c9e693e-282c-44df-9ecd-485c40bc15a0\") " pod="openshift-dns/node-resolver-zmltd"
Sep 11 04:40:12.922322 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922318    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h4c8\" (UniqueName: \"kubernetes.io/projected/e1c2694b-8c0f-4f81-8a76-956c1615be81-kube-api-access-4h4c8\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.922714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922355    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f32aea16-a091-4521-8695-5ccb48885bbe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.922714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922365    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f32aea16-a091-4521-8695-5ccb48885bbe-socket-dir\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.922714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922358    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/216c51f9-f976-4b58-a9ab-96bef1bf776c-dbus\") pod \"global-pull-secret-syncer-d66qg\" (UID: \"216c51f9-f976-4b58-a9ab-96bef1bf776c\") " pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:12.922714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922405    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4c9e693e-282c-44df-9ecd-485c40bc15a0-hosts-file\") pod \"node-resolver-zmltd\" (UID: \"4c9e693e-282c-44df-9ecd-485c40bc15a0\") " pod="openshift-dns/node-resolver-zmltd"
Sep 11 04:40:12.922714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922441    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c24c3cd6-c444-489a-a59d-d9ce9f02217e-iptables-alerter-script\") pod \"iptables-alerter-qd5ll\" (UID: \"c24c3cd6-c444-489a-a59d-d9ce9f02217e\") " pod="openshift-network-operator/iptables-alerter-qd5ll"
Sep 11 04:40:12.922714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922470    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w77hh\" (UniqueName: \"kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh\") pod \"network-check-target-tgt9r\" (UID: \"e0bd904c-02f2-47ab-8605-4791b0ea678e\") " pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:12.922714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922495    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1c2694b-8c0f-4f81-8a76-956c1615be81-cni-binary-copy\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.922714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922519    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f32aea16-a091-4521-8695-5ccb48885bbe-device-dir\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.922714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922544    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f87de3b3-7604-4f7a-8c87-c5fabe66555b-konnectivity-ca\") pod \"konnectivity-agent-ghlxt\" (UID: \"f87de3b3-7604-4f7a-8c87-c5fabe66555b\") " pod="kube-system/konnectivity-agent-ghlxt"
Sep 11 04:40:12.922714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922573    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1c2694b-8c0f-4f81-8a76-956c1615be81-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.922714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922598    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jntb7\" (UniqueName: \"kubernetes.io/projected/4c9e693e-282c-44df-9ecd-485c40bc15a0-kube-api-access-jntb7\") pod \"node-resolver-zmltd\" (UID: \"4c9e693e-282c-44df-9ecd-485c40bc15a0\") " pod="openshift-dns/node-resolver-zmltd"
Sep 11 04:40:12.922714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922626    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/216c51f9-f976-4b58-a9ab-96bef1bf776c-kubelet-config\") pod \"global-pull-secret-syncer-d66qg\" (UID: \"216c51f9-f976-4b58-a9ab-96bef1bf776c\") " pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:12.922714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922661    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f87de3b3-7604-4f7a-8c87-c5fabe66555b-agent-certs\") pod \"konnectivity-agent-ghlxt\" (UID: \"f87de3b3-7604-4f7a-8c87-c5fabe66555b\") " pod="kube-system/konnectivity-agent-ghlxt"
Sep 11 04:40:12.922714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922689    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c24c3cd6-c444-489a-a59d-d9ce9f02217e-host-slash\") pod \"iptables-alerter-qd5ll\" (UID: \"c24c3cd6-c444-489a-a59d-d9ce9f02217e\") " pod="openshift-network-operator/iptables-alerter-qd5ll"
Sep 11 04:40:12.922714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922716    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1c2694b-8c0f-4f81-8a76-956c1615be81-system-cni-dir\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.923460 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922740    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f32aea16-a091-4521-8695-5ccb48885bbe-etc-selinux\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.923460 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922778    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f32aea16-a091-4521-8695-5ccb48885bbe-sys-fs\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.923460 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922802    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret\") pod \"global-pull-secret-syncer-d66qg\" (UID: \"216c51f9-f976-4b58-a9ab-96bef1bf776c\") " pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:12.923460 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922826    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e1c2694b-8c0f-4f81-8a76-956c1615be81-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.923460 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922831    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e1c2694b-8c0f-4f81-8a76-956c1615be81-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.923460 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922831    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c9e693e-282c-44df-9ecd-485c40bc15a0-tmp-dir\") pod \"node-resolver-zmltd\" (UID: \"4c9e693e-282c-44df-9ecd-485c40bc15a0\") " pod="openshift-dns/node-resolver-zmltd"
Sep 11 04:40:12.923460 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922857    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f32aea16-a091-4521-8695-5ccb48885bbe-registration-dir\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.923460 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922873    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f32aea16-a091-4521-8695-5ccb48885bbe-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.923460 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922882    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb54x\" (UniqueName: \"kubernetes.io/projected/c24c3cd6-c444-489a-a59d-d9ce9f02217e-kube-api-access-qb54x\") pod \"iptables-alerter-qd5ll\" (UID: \"c24c3cd6-c444-489a-a59d-d9ce9f02217e\") " pod="openshift-network-operator/iptables-alerter-qd5ll"
Sep 11 04:40:12.923460 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922888    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/216c51f9-f976-4b58-a9ab-96bef1bf776c-kubelet-config\") pod \"global-pull-secret-syncer-d66qg\" (UID: \"216c51f9-f976-4b58-a9ab-96bef1bf776c\") " pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:12.923460 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922911    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmwnj\" (UniqueName: \"kubernetes.io/projected/f32aea16-a091-4521-8695-5ccb48885bbe-kube-api-access-kmwnj\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.923460 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.922970    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f32aea16-a091-4521-8695-5ccb48885bbe-etc-selinux\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.923460 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.923000    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c24c3cd6-c444-489a-a59d-d9ce9f02217e-host-slash\") pod \"iptables-alerter-qd5ll\" (UID: \"c24c3cd6-c444-489a-a59d-d9ce9f02217e\") " pod="openshift-network-operator/iptables-alerter-qd5ll"
Sep 11 04:40:12.923460 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.923031    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f32aea16-a091-4521-8695-5ccb48885bbe-sys-fs\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.923460 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:12.923111    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 04:40:12.923460 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:12.923164    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret podName:216c51f9-f976-4b58-a9ab-96bef1bf776c nodeName:}" failed. No retries permitted until 2026-09-11 04:40:13.423147054 +0000 UTC m=+3.076406729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret") pod "global-pull-secret-syncer-d66qg" (UID: "216c51f9-f976-4b58-a9ab-96bef1bf776c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 04:40:12.924134 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.923163    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1c2694b-8c0f-4f81-8a76-956c1615be81-system-cni-dir\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.924134 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.923263    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1c2694b-8c0f-4f81-8a76-956c1615be81-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.924134 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.923323    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f32aea16-a091-4521-8695-5ccb48885bbe-device-dir\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.924134 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.923407    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1c2694b-8c0f-4f81-8a76-956c1615be81-cni-binary-copy\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.924134 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.923675    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e1c2694b-8c0f-4f81-8a76-956c1615be81-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.924134 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.923749    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f32aea16-a091-4521-8695-5ccb48885bbe-registration-dir\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.924134 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.923753    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f87de3b3-7604-4f7a-8c87-c5fabe66555b-konnectivity-ca\") pod \"konnectivity-agent-ghlxt\" (UID: \"f87de3b3-7604-4f7a-8c87-c5fabe66555b\") " pod="kube-system/konnectivity-agent-ghlxt"
Sep 11 04:40:12.924134 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.924110    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c24c3cd6-c444-489a-a59d-d9ce9f02217e-iptables-alerter-script\") pod \"iptables-alerter-qd5ll\" (UID: \"c24c3cd6-c444-489a-a59d-d9ce9f02217e\") " pod="openshift-network-operator/iptables-alerter-qd5ll"
Sep 11 04:40:12.926141 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.926119    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f87de3b3-7604-4f7a-8c87-c5fabe66555b-agent-certs\") pod \"konnectivity-agent-ghlxt\" (UID: \"f87de3b3-7604-4f7a-8c87-c5fabe66555b\") " pod="kube-system/konnectivity-agent-ghlxt"
Sep 11 04:40:12.930170 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:12.930139    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 04:40:12.930170 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:12.930163    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 04:40:12.930319 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:12.930176    2554 projected.go:196] Error preparing data for projected volume kube-api-access-w77hh for pod openshift-network-diagnostics/network-check-target-tgt9r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 04:40:12.930319 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:12.930224    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh podName:e0bd904c-02f2-47ab-8605-4791b0ea678e nodeName:}" failed. No retries permitted until 2026-09-11 04:40:13.430209989 +0000 UTC m=+3.083469647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-w77hh" (UniqueName: "kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh") pod "network-check-target-tgt9r" (UID: "e0bd904c-02f2-47ab-8605-4791b0ea678e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 04:40:12.932414 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.932349    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmwnj\" (UniqueName: \"kubernetes.io/projected/f32aea16-a091-4521-8695-5ccb48885bbe-kube-api-access-kmwnj\") pod \"aws-ebs-csi-driver-node-ljdz5\" (UID: \"f32aea16-a091-4521-8695-5ccb48885bbe\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:12.932610 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.932590    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h4c8\" (UniqueName: \"kubernetes.io/projected/e1c2694b-8c0f-4f81-8a76-956c1615be81-kube-api-access-4h4c8\") pod \"multus-additional-cni-plugins-t88qn\" (UID: \"e1c2694b-8c0f-4f81-8a76-956c1615be81\") " pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:12.932793 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.932778    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb54x\" (UniqueName: \"kubernetes.io/projected/c24c3cd6-c444-489a-a59d-d9ce9f02217e-kube-api-access-qb54x\") pod \"iptables-alerter-qd5ll\" (UID: \"c24c3cd6-c444-489a-a59d-d9ce9f02217e\") " pod="openshift-network-operator/iptables-alerter-qd5ll"
Sep 11 04:40:12.932836 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:12.932804    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jntb7\" (UniqueName: \"kubernetes.io/projected/4c9e693e-282c-44df-9ecd-485c40bc15a0-kube-api-access-jntb7\") pod \"node-resolver-zmltd\" (UID: \"4c9e693e-282c-44df-9ecd-485c40bc15a0\") " pod="openshift-dns/node-resolver-zmltd"
Sep 11 04:40:13.012092 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.012053    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ddk77"
Sep 11 04:40:13.026863 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.026831    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:13.041722 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.041688    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vjkgd"
Sep 11 04:40:13.048799 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.048780    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-68r27"
Sep 11 04:40:13.056636 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.056589    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t88qn"
Sep 11 04:40:13.063865 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.063838    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5"
Sep 11 04:40:13.072397 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.072357    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qd5ll"
Sep 11 04:40:13.080130 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.080108    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ghlxt"
Sep 11 04:40:13.086759 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.086736    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zmltd"
Sep 11 04:40:13.326361 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.326255    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs\") pod \"network-metrics-daemon-2r4m7\" (UID: \"8aaff5eb-511c-4772-84b1-d51c257ef1c8\") " pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:13.326510 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:13.326410    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 04:40:13.326510 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:13.326469    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs podName:8aaff5eb-511c-4772-84b1-d51c257ef1c8 nodeName:}" failed. No retries permitted until 2026-09-11 04:40:14.326455286 +0000 UTC m=+3.979714944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs") pod "network-metrics-daemon-2r4m7" (UID: "8aaff5eb-511c-4772-84b1-d51c257ef1c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 04:40:13.427551 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.427519    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret\") pod \"global-pull-secret-syncer-d66qg\" (UID: \"216c51f9-f976-4b58-a9ab-96bef1bf776c\") " pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:13.427704 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:13.427668    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 04:40:13.427778 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:13.427740    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret podName:216c51f9-f976-4b58-a9ab-96bef1bf776c nodeName:}" failed. No retries permitted until 2026-09-11 04:40:14.42772515 +0000 UTC m=+4.080984826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret") pod "global-pull-secret-syncer-d66qg" (UID: "216c51f9-f976-4b58-a9ab-96bef1bf776c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 04:40:13.528216 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.528172    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w77hh\" (UniqueName: \"kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh\") pod \"network-check-target-tgt9r\" (UID: \"e0bd904c-02f2-47ab-8605-4791b0ea678e\") " pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:13.528426 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:13.528378    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 04:40:13.528426 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:13.528405    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 04:40:13.528426 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:13.528418    2554 projected.go:196] Error preparing data for projected volume kube-api-access-w77hh for pod openshift-network-diagnostics/network-check-target-tgt9r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 04:40:13.528574 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:13.528488    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh podName:e0bd904c-02f2-47ab-8605-4791b0ea678e nodeName:}" failed. No retries permitted until 2026-09-11 04:40:14.528467014 +0000 UTC m=+4.181726689 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-w77hh" (UniqueName: "kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh") pod "network-check-target-tgt9r" (UID: "e0bd904c-02f2-47ab-8605-4791b0ea678e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 04:40:13.746562 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.746530    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 04:35:12 +0000 UTC" deadline="2028-06-04 20:40:20.070975828 +0000 UTC"
Sep 11 04:40:13.746562 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.746560    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15184h0m6.324418875s"
Sep 11 04:40:13.760478 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:13.760452    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aad5d06_7f07_4419_9038_450a380246f9.slice/crio-91df0a4bc8edf3fb77642af900c9a46dddfd598c7b6681fca9d5d60aad9b5fa9 WatchSource:0}: Error finding container 91df0a4bc8edf3fb77642af900c9a46dddfd598c7b6681fca9d5d60aad9b5fa9: Status 404 returned error can't find the container with id 91df0a4bc8edf3fb77642af900c9a46dddfd598c7b6681fca9d5d60aad9b5fa9
Sep 11 04:40:13.782313 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:13.782283    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod355c0baf_57fe_40e8_ad75_3ef2bebb40c2.slice/crio-289fd61b57cb61e89c6f743c6d9e4031bd4e76cba9969aacc1342af68bdcf696 WatchSource:0}: Error finding container 289fd61b57cb61e89c6f743c6d9e4031bd4e76cba9969aacc1342af68bdcf696: Status 404 returned error can't find the container with id 289fd61b57cb61e89c6f743c6d9e4031bd4e76cba9969aacc1342af68bdcf696
Sep 11 04:40:13.787744 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:13.787716    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c9e693e_282c_44df_9ecd_485c40bc15a0.slice/crio-6edd3fd0e3d72213af36d187ef4dd44fa1a107f7b1ca5d009b53a74769ffdd12 WatchSource:0}: Error finding container 6edd3fd0e3d72213af36d187ef4dd44fa1a107f7b1ca5d009b53a74769ffdd12: Status 404 returned error can't find the container with id 6edd3fd0e3d72213af36d187ef4dd44fa1a107f7b1ca5d009b53a74769ffdd12
Sep 11 04:40:13.790410 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:13.790279    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1c2694b_8c0f_4f81_8a76_956c1615be81.slice/crio-c255cc3652ebaabe89badd696ecc59db22b666325842fc80b6a7e2e0ad32b95e WatchSource:0}: Error finding container c255cc3652ebaabe89badd696ecc59db22b666325842fc80b6a7e2e0ad32b95e: Status 404 returned error can't find the container with id c255cc3652ebaabe89badd696ecc59db22b666325842fc80b6a7e2e0ad32b95e
Sep 11 04:40:13.791405 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:13.791379    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf32aea16_a091_4521_8695_5ccb48885bbe.slice/crio-bce683fb79e5ac40c55083221bd3430f30fb70b4da9bfc398932d794de2c694d WatchSource:0}: Error finding container bce683fb79e5ac40c55083221bd3430f30fb70b4da9bfc398932d794de2c694d: Status 404 returned error can't find the container with id bce683fb79e5ac40c55083221bd3430f30fb70b4da9bfc398932d794de2c694d
Sep 11 04:40:13.792367 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:13.792325    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc24c3cd6_c444_489a_a59d_d9ce9f02217e.slice/crio-c6bb814dc017f10902ffa5a8a1d0cb6eaf7d5edcbdfb2ded4b37f85b7d00dc7d WatchSource:0}: Error finding container c6bb814dc017f10902ffa5a8a1d0cb6eaf7d5edcbdfb2ded4b37f85b7d00dc7d: Status 404 returned error can't find the container with id c6bb814dc017f10902ffa5a8a1d0cb6eaf7d5edcbdfb2ded4b37f85b7d00dc7d
Sep 11 04:40:13.793249 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:13.793196    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb096f3e4_4f74_419a_b6ff_c7d246dfa1d1.slice/crio-4230e5d08b24c404daa5dcdd1ae6e1926d2c03a1746b1e4da5132220e61a6df9 WatchSource:0}: Error finding container 4230e5d08b24c404daa5dcdd1ae6e1926d2c03a1746b1e4da5132220e61a6df9: Status 404 returned error can't find the container with id 4230e5d08b24c404daa5dcdd1ae6e1926d2c03a1746b1e4da5132220e61a6df9
Sep 11 04:40:13.796599 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:13.794981    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca5086d2_4a84_4130_a5ab_cad1e43a286d.slice/crio-1533f3a1d49dfd0418638ce6793e796b00a8ff263818dc2613fc3251cc54e873 WatchSource:0}: Error finding container 1533f3a1d49dfd0418638ce6793e796b00a8ff263818dc2613fc3251cc54e873: Status 404 returned error can't find the container with id 1533f3a1d49dfd0418638ce6793e796b00a8ff263818dc2613fc3251cc54e873
Sep 11 04:40:13.796599 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:13.795692    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf87de3b3_7604_4f7a_8c87_c5fabe66555b.slice/crio-513cb8bd71c6d3613ffa33a698278696a8c60438bedc3664ba1822b5bbe72892 WatchSource:0}: Error finding container 513cb8bd71c6d3613ffa33a698278696a8c60438bedc3664ba1822b5bbe72892: Status 404 returned error can't find the container with id 513cb8bd71c6d3613ffa33a698278696a8c60438bedc3664ba1822b5bbe72892
Sep 11 04:40:13.817968 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.817931    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ghlxt" event={"ID":"f87de3b3-7604-4f7a-8c87-c5fabe66555b","Type":"ContainerStarted","Data":"513cb8bd71c6d3613ffa33a698278696a8c60438bedc3664ba1822b5bbe72892"}
Sep 11 04:40:13.819201 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.819167    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5" event={"ID":"f32aea16-a091-4521-8695-5ccb48885bbe","Type":"ContainerStarted","Data":"bce683fb79e5ac40c55083221bd3430f30fb70b4da9bfc398932d794de2c694d"}
Sep 11 04:40:13.820281 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.820261    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88qn" event={"ID":"e1c2694b-8c0f-4f81-8a76-956c1615be81","Type":"ContainerStarted","Data":"c255cc3652ebaabe89badd696ecc59db22b666325842fc80b6a7e2e0ad32b95e"}
Sep 11 04:40:13.822638 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.822562    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zmltd" event={"ID":"4c9e693e-282c-44df-9ecd-485c40bc15a0","Type":"ContainerStarted","Data":"6edd3fd0e3d72213af36d187ef4dd44fa1a107f7b1ca5d009b53a74769ffdd12"}
Sep 11 04:40:13.823821 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.823795    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-68r27" event={"ID":"355c0baf-57fe-40e8-ad75-3ef2bebb40c2","Type":"ContainerStarted","Data":"289fd61b57cb61e89c6f743c6d9e4031bd4e76cba9969aacc1342af68bdcf696"}
Sep 11 04:40:13.825224 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.825203    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vjkgd" event={"ID":"4aad5d06-7f07-4419-9038-450a380246f9","Type":"ContainerStarted","Data":"91df0a4bc8edf3fb77642af900c9a46dddfd598c7b6681fca9d5d60aad9b5fa9"}
Sep 11 04:40:13.826709 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.826685    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc" event={"ID":"ca5086d2-4a84-4130-a5ab-cad1e43a286d","Type":"ContainerStarted","Data":"1533f3a1d49dfd0418638ce6793e796b00a8ff263818dc2613fc3251cc54e873"}
Sep 11 04:40:13.827936 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.827913    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ddk77" event={"ID":"b096f3e4-4f74-419a-b6ff-c7d246dfa1d1","Type":"ContainerStarted","Data":"4230e5d08b24c404daa5dcdd1ae6e1926d2c03a1746b1e4da5132220e61a6df9"}
Sep 11 04:40:13.829261 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:13.829233    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qd5ll" event={"ID":"c24c3cd6-c444-489a-a59d-d9ce9f02217e","Type":"ContainerStarted","Data":"c6bb814dc017f10902ffa5a8a1d0cb6eaf7d5edcbdfb2ded4b37f85b7d00dc7d"}
Sep 11 04:40:14.334994 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:14.334901    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs\") pod \"network-metrics-daemon-2r4m7\" (UID: \"8aaff5eb-511c-4772-84b1-d51c257ef1c8\") " pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:14.335152 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:14.335082    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 04:40:14.335220 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:14.335187    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs podName:8aaff5eb-511c-4772-84b1-d51c257ef1c8 nodeName:}" failed. No retries permitted until 2026-09-11 04:40:16.335168643 +0000 UTC m=+5.988428317 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs") pod "network-metrics-daemon-2r4m7" (UID: "8aaff5eb-511c-4772-84b1-d51c257ef1c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 04:40:14.435856 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:14.435746    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret\") pod \"global-pull-secret-syncer-d66qg\" (UID: \"216c51f9-f976-4b58-a9ab-96bef1bf776c\") " pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:14.436026 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:14.435902    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 04:40:14.436026 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:14.435966    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret podName:216c51f9-f976-4b58-a9ab-96bef1bf776c nodeName:}" failed. No retries permitted until 2026-09-11 04:40:16.435947796 +0000 UTC m=+6.089207456 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret") pod "global-pull-secret-syncer-d66qg" (UID: "216c51f9-f976-4b58-a9ab-96bef1bf776c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 04:40:14.536829 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:14.536789    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w77hh\" (UniqueName: \"kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh\") pod \"network-check-target-tgt9r\" (UID: \"e0bd904c-02f2-47ab-8605-4791b0ea678e\") " pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:14.537099 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:14.536965    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 04:40:14.537099 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:14.536995    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 04:40:14.537099 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:14.537009    2554 projected.go:196] Error preparing data for projected volume kube-api-access-w77hh for pod openshift-network-diagnostics/network-check-target-tgt9r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 04:40:14.537099 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:14.537068    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh podName:e0bd904c-02f2-47ab-8605-4791b0ea678e nodeName:}" failed. No retries permitted until 2026-09-11 04:40:16.537048934 +0000 UTC m=+6.190308598 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-w77hh" (UniqueName: "kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh") pod "network-check-target-tgt9r" (UID: "e0bd904c-02f2-47ab-8605-4791b0ea678e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 04:40:14.746991 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:14.746926    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 04:35:12 +0000 UTC" deadline="2028-05-21 14:44:56.302329368 +0000 UTC"
Sep 11 04:40:14.746991 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:14.746988    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14842h4m41.555345581s"
Sep 11 04:40:14.807074 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:14.807041    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:14.807313 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:14.807186    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2r4m7" podUID="8aaff5eb-511c-4772-84b1-d51c257ef1c8"
Sep 11 04:40:14.807622 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:14.807598    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:14.807726 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:14.807702    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d66qg" podUID="216c51f9-f976-4b58-a9ab-96bef1bf776c"
Sep 11 04:40:14.807822 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:14.807809    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:14.807902 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:14.807884    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgt9r" podUID="e0bd904c-02f2-47ab-8605-4791b0ea678e"
Sep 11 04:40:14.849495 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:14.849457    2554 generic.go:356] "Generic (PLEG): container finished" podID="1ac2d8c39f840eb50ee15953820bbe61" containerID="1561cf4e1b381772933113ff8a2befa0cebe98d16d1765a6886b68e4a26762f5" exitCode=0
Sep 11 04:40:14.849659 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:14.849567    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal" event={"ID":"1ac2d8c39f840eb50ee15953820bbe61","Type":"ContainerDied","Data":"1561cf4e1b381772933113ff8a2befa0cebe98d16d1765a6886b68e4a26762f5"}
Sep 11 04:40:14.871287 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:14.871249    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal" event={"ID":"1dc5f07142ffec6eb419ac61ce92a9d5","Type":"ContainerStarted","Data":"b8a943374b6d7a4830e2d24e07582abc86c7801a9ad4be8941a99d417dc9fe9f"}
Sep 11 04:40:15.879646 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:15.879390    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal" event={"ID":"1ac2d8c39f840eb50ee15953820bbe61","Type":"ContainerStarted","Data":"3080ce5910da859a3a2f264783eb481d3d0eacf329fb6a49f0232ba9e3909bf8"}
Sep 11 04:40:15.893383 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:15.893297    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-244.ec2.internal" podStartSLOduration=3.893272354 podStartE2EDuration="3.893272354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 04:40:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:40:14.88579992 +0000 UTC m=+4.539059602" watchObservedRunningTime="2026-09-11 04:40:15.893272354 +0000 UTC m=+5.546532035"
Sep 11 04:40:15.893554 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:15.893514    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-244.ec2.internal" podStartSLOduration=3.89350434 podStartE2EDuration="3.89350434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 04:40:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:40:15.892281081 +0000 UTC m=+5.545540778" watchObservedRunningTime="2026-09-11 04:40:15.89350434 +0000 UTC m=+5.546764022"
Sep 11 04:40:16.352878 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:16.352829    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs\") pod \"network-metrics-daemon-2r4m7\" (UID: \"8aaff5eb-511c-4772-84b1-d51c257ef1c8\") " pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:16.353076 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:16.353045    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 04:40:16.353143 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:16.353111    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs podName:8aaff5eb-511c-4772-84b1-d51c257ef1c8 nodeName:}" failed. No retries permitted until 2026-09-11 04:40:20.353092246 +0000 UTC m=+10.006351906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs") pod "network-metrics-daemon-2r4m7" (UID: "8aaff5eb-511c-4772-84b1-d51c257ef1c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 04:40:16.453307 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:16.453267    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret\") pod \"global-pull-secret-syncer-d66qg\" (UID: \"216c51f9-f976-4b58-a9ab-96bef1bf776c\") " pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:16.453517 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:16.453500    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 04:40:16.453583 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:16.453568    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret podName:216c51f9-f976-4b58-a9ab-96bef1bf776c nodeName:}" failed. No retries permitted until 2026-09-11 04:40:20.453547971 +0000 UTC m=+10.106807632 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret") pod "global-pull-secret-syncer-d66qg" (UID: "216c51f9-f976-4b58-a9ab-96bef1bf776c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 04:40:16.554475 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:16.554436    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w77hh\" (UniqueName: \"kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh\") pod \"network-check-target-tgt9r\" (UID: \"e0bd904c-02f2-47ab-8605-4791b0ea678e\") " pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:16.554652 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:16.554618    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 04:40:16.554652 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:16.554643    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 04:40:16.554770 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:16.554656    2554 projected.go:196] Error preparing data for projected volume kube-api-access-w77hh for pod openshift-network-diagnostics/network-check-target-tgt9r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 04:40:16.554770 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:16.554718    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh podName:e0bd904c-02f2-47ab-8605-4791b0ea678e nodeName:}" failed. No retries permitted until 2026-09-11 04:40:20.554699878 +0000 UTC m=+10.207959539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-w77hh" (UniqueName: "kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh") pod "network-check-target-tgt9r" (UID: "e0bd904c-02f2-47ab-8605-4791b0ea678e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 04:40:16.808906 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:16.808428    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:16.808906 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:16.808432    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:16.808906 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:16.808551    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d66qg" podUID="216c51f9-f976-4b58-a9ab-96bef1bf776c"
Sep 11 04:40:16.808906 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:16.808610    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgt9r" podUID="e0bd904c-02f2-47ab-8605-4791b0ea678e"
Sep 11 04:40:16.808906 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:16.808683    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:16.808906 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:16.808777    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2r4m7" podUID="8aaff5eb-511c-4772-84b1-d51c257ef1c8"
Sep 11 04:40:18.810014 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:18.809982    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:18.810447 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:18.810097    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d66qg" podUID="216c51f9-f976-4b58-a9ab-96bef1bf776c"
Sep 11 04:40:18.810508 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:18.810475    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:18.810562 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:18.810546    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgt9r" podUID="e0bd904c-02f2-47ab-8605-4791b0ea678e"
Sep 11 04:40:18.810612 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:18.810599    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:18.810688 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:18.810673    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2r4m7" podUID="8aaff5eb-511c-4772-84b1-d51c257ef1c8"
Sep 11 04:40:20.388594 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:20.388557    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs\") pod \"network-metrics-daemon-2r4m7\" (UID: \"8aaff5eb-511c-4772-84b1-d51c257ef1c8\") " pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:20.389071 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:20.388741    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 04:40:20.389071 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:20.388803    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs podName:8aaff5eb-511c-4772-84b1-d51c257ef1c8 nodeName:}" failed. No retries permitted until 2026-09-11 04:40:28.388784554 +0000 UTC m=+18.042044216 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs") pod "network-metrics-daemon-2r4m7" (UID: "8aaff5eb-511c-4772-84b1-d51c257ef1c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 04:40:20.489876 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:20.489840    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret\") pod \"global-pull-secret-syncer-d66qg\" (UID: \"216c51f9-f976-4b58-a9ab-96bef1bf776c\") " pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:20.490058 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:20.490013    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 04:40:20.490121 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:20.490091    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret podName:216c51f9-f976-4b58-a9ab-96bef1bf776c nodeName:}" failed. No retries permitted until 2026-09-11 04:40:28.490069107 +0000 UTC m=+18.143328781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret") pod "global-pull-secret-syncer-d66qg" (UID: "216c51f9-f976-4b58-a9ab-96bef1bf776c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 04:40:20.590589 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:20.590544    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w77hh\" (UniqueName: \"kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh\") pod \"network-check-target-tgt9r\" (UID: \"e0bd904c-02f2-47ab-8605-4791b0ea678e\") " pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:20.590764 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:20.590723    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 04:40:20.590764 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:20.590745    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 04:40:20.590764 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:20.590757    2554 projected.go:196] Error preparing data for projected volume kube-api-access-w77hh for pod openshift-network-diagnostics/network-check-target-tgt9r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 04:40:20.590942 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:20.590811    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh podName:e0bd904c-02f2-47ab-8605-4791b0ea678e nodeName:}" failed. No retries permitted until 2026-09-11 04:40:28.590792732 +0000 UTC m=+18.244052405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-w77hh" (UniqueName: "kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh") pod "network-check-target-tgt9r" (UID: "e0bd904c-02f2-47ab-8605-4791b0ea678e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 04:40:20.807947 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:20.807912    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:20.808115 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:20.808036    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:20.808171 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:20.808123    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgt9r" podUID="e0bd904c-02f2-47ab-8605-4791b0ea678e"
Sep 11 04:40:20.808171 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:20.808151    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:20.808248 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:20.808206    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2r4m7" podUID="8aaff5eb-511c-4772-84b1-d51c257ef1c8"
Sep 11 04:40:20.808248 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:20.808033    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d66qg" podUID="216c51f9-f976-4b58-a9ab-96bef1bf776c"
Sep 11 04:40:22.807743 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:22.807257    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:22.807743 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:22.807302    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:22.807743 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:22.807257    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:22.807743 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:22.807406    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgt9r" podUID="e0bd904c-02f2-47ab-8605-4791b0ea678e"
Sep 11 04:40:22.807743 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:22.807471    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d66qg" podUID="216c51f9-f976-4b58-a9ab-96bef1bf776c"
Sep 11 04:40:22.807743 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:22.807576    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2r4m7" podUID="8aaff5eb-511c-4772-84b1-d51c257ef1c8"
Sep 11 04:40:24.807566 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:24.807528    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:24.807566 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:24.807553    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:24.808077 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:24.807626    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:24.808077 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:24.807719    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d66qg" podUID="216c51f9-f976-4b58-a9ab-96bef1bf776c"
Sep 11 04:40:24.808077 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:24.807778    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgt9r" podUID="e0bd904c-02f2-47ab-8605-4791b0ea678e"
Sep 11 04:40:24.808077 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:24.807860    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2r4m7" podUID="8aaff5eb-511c-4772-84b1-d51c257ef1c8"
Sep 11 04:40:26.808274 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:26.807766    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:26.808274 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:26.807796    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:26.808274 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:26.807766    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:26.808274 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:26.807913    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2r4m7" podUID="8aaff5eb-511c-4772-84b1-d51c257ef1c8"
Sep 11 04:40:26.808274 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:26.808021    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d66qg" podUID="216c51f9-f976-4b58-a9ab-96bef1bf776c"
Sep 11 04:40:26.808274 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:26.808096    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgt9r" podUID="e0bd904c-02f2-47ab-8605-4791b0ea678e"
Sep 11 04:40:28.446815 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:28.446775    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs\") pod \"network-metrics-daemon-2r4m7\" (UID: \"8aaff5eb-511c-4772-84b1-d51c257ef1c8\") " pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:28.447230 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:28.446925    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 04:40:28.447230 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:28.446989    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs podName:8aaff5eb-511c-4772-84b1-d51c257ef1c8 nodeName:}" failed. No retries permitted until 2026-09-11 04:40:44.446973587 +0000 UTC m=+34.100233245 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs") pod "network-metrics-daemon-2r4m7" (UID: "8aaff5eb-511c-4772-84b1-d51c257ef1c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 04:40:28.547656 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:28.547574    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret\") pod \"global-pull-secret-syncer-d66qg\" (UID: \"216c51f9-f976-4b58-a9ab-96bef1bf776c\") " pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:28.547793 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:28.547697    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 04:40:28.547793 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:28.547750    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret podName:216c51f9-f976-4b58-a9ab-96bef1bf776c nodeName:}" failed. No retries permitted until 2026-09-11 04:40:44.547736907 +0000 UTC m=+34.200996565 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret") pod "global-pull-secret-syncer-d66qg" (UID: "216c51f9-f976-4b58-a9ab-96bef1bf776c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 04:40:28.648929 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:28.648896    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w77hh\" (UniqueName: \"kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh\") pod \"network-check-target-tgt9r\" (UID: \"e0bd904c-02f2-47ab-8605-4791b0ea678e\") " pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:28.649113 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:28.649052    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 04:40:28.649113 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:28.649070    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 04:40:28.649113 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:28.649079    2554 projected.go:196] Error preparing data for projected volume kube-api-access-w77hh for pod openshift-network-diagnostics/network-check-target-tgt9r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 04:40:28.649256 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:28.649133    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh podName:e0bd904c-02f2-47ab-8605-4791b0ea678e nodeName:}" failed. No retries permitted until 2026-09-11 04:40:44.649119091 +0000 UTC m=+34.302378749 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-w77hh" (UniqueName: "kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh") pod "network-check-target-tgt9r" (UID: "e0bd904c-02f2-47ab-8605-4791b0ea678e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 04:40:28.807440 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:28.807347    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:28.807440 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:28.807396    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:28.807664 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:28.807476    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgt9r" podUID="e0bd904c-02f2-47ab-8605-4791b0ea678e"
Sep 11 04:40:28.807664 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:28.807550    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d66qg" podUID="216c51f9-f976-4b58-a9ab-96bef1bf776c"
Sep 11 04:40:28.807664 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:28.807604    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:28.807798 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:28.807709    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2r4m7" podUID="8aaff5eb-511c-4772-84b1-d51c257ef1c8"
Sep 11 04:40:30.808663 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:30.808628    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:30.809137 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:30.808724    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:30.809137 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:30.808743    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgt9r" podUID="e0bd904c-02f2-47ab-8605-4791b0ea678e"
Sep 11 04:40:30.809137 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:30.808841    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:30.809137 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:30.808859    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2r4m7" podUID="8aaff5eb-511c-4772-84b1-d51c257ef1c8"
Sep 11 04:40:30.809137 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:30.808914    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d66qg" podUID="216c51f9-f976-4b58-a9ab-96bef1bf776c"
Sep 11 04:40:32.809904 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.808982    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:32.809904 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:32.809371    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d66qg" podUID="216c51f9-f976-4b58-a9ab-96bef1bf776c"
Sep 11 04:40:32.809904 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.809066    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:32.809904 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:32.809484    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2r4m7" podUID="8aaff5eb-511c-4772-84b1-d51c257ef1c8"
Sep 11 04:40:32.809904 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.808994    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:32.809904 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:32.809561    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgt9r" podUID="e0bd904c-02f2-47ab-8605-4791b0ea678e"
Sep 11 04:40:32.915004 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.914965    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5" event={"ID":"f32aea16-a091-4521-8695-5ccb48885bbe","Type":"ContainerStarted","Data":"3530b09ac0342b41b1cecbc41b53af1625041b18bb200662f7e426ba181bdb33"}
Sep 11 04:40:32.917088 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.917058    2554 generic.go:356] "Generic (PLEG): container finished" podID="e1c2694b-8c0f-4f81-8a76-956c1615be81" containerID="ad94a42734e2f72ac607a1a10e4abda1752464ca3826e62d6ca169b3bbb3b635" exitCode=0
Sep 11 04:40:32.917228 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.917146    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88qn" event={"ID":"e1c2694b-8c0f-4f81-8a76-956c1615be81","Type":"ContainerDied","Data":"ad94a42734e2f72ac607a1a10e4abda1752464ca3826e62d6ca169b3bbb3b635"}
Sep 11 04:40:32.918936 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.918851    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zmltd" event={"ID":"4c9e693e-282c-44df-9ecd-485c40bc15a0","Type":"ContainerStarted","Data":"7c2b4c5958d04c38ae6f068e2b8331b55eda7626f548d6d65bc5ea07a6bec081"}
Sep 11 04:40:32.920753 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.920724    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-68r27" event={"ID":"355c0baf-57fe-40e8-ad75-3ef2bebb40c2","Type":"ContainerStarted","Data":"13760cd27eb7a83efed28b06041e72cdf350b1174765d8741f4e45fde2cda1da"}
Sep 11 04:40:32.926869 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.926841    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vjkgd" event={"ID":"4aad5d06-7f07-4419-9038-450a380246f9","Type":"ContainerStarted","Data":"6b04e0adb9c2316754e93086f4a74ae22d700fb488b3a5412bd3c61eb16f345c"}
Sep 11 04:40:32.930451 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.930421    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc" event={"ID":"ca5086d2-4a84-4130-a5ab-cad1e43a286d","Type":"ContainerStarted","Data":"bb52d7815b7a89005355588dc106d5539f3a0554091e2373e153fa7678e38e84"}
Sep 11 04:40:32.930557 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.930506    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc" event={"ID":"ca5086d2-4a84-4130-a5ab-cad1e43a286d","Type":"ContainerStarted","Data":"dc3cecd8de9687325ffa46298d9a431365294237b3259cd37816b69b9d6c62e5"}
Sep 11 04:40:32.930608 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.930557    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc" event={"ID":"ca5086d2-4a84-4130-a5ab-cad1e43a286d","Type":"ContainerStarted","Data":"f785c0cd613be11c5d8f9911b4936894d6b16afc965a46eb0fe6b10d80f4897b"}
Sep 11 04:40:32.930608 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.930605    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc" event={"ID":"ca5086d2-4a84-4130-a5ab-cad1e43a286d","Type":"ContainerStarted","Data":"28374a5049012d4609e14c27cb3fdb3c813861fc878568db83a6f8fccf90dc7e"}
Sep 11 04:40:32.930683 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.930650    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc" event={"ID":"ca5086d2-4a84-4130-a5ab-cad1e43a286d","Type":"ContainerStarted","Data":"95cd57a4e05cf51563bbfece26db11add049d2493b11380014ae73cd499c433b"}
Sep 11 04:40:32.930724 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.930697    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc" event={"ID":"ca5086d2-4a84-4130-a5ab-cad1e43a286d","Type":"ContainerStarted","Data":"4d787636758578a10b5a3cb9fa99e612436b62b1d68b87ec16b48b782dc9d1a6"}
Sep 11 04:40:32.938369 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.938314    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ddk77" event={"ID":"b096f3e4-4f74-419a-b6ff-c7d246dfa1d1","Type":"ContainerStarted","Data":"1605aea19fde5d23bef40cff855a14e62aa9aba065175211916f67a792023ad8"}
Sep 11 04:40:32.940062 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.940035    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ghlxt" event={"ID":"f87de3b3-7604-4f7a-8c87-c5fabe66555b","Type":"ContainerStarted","Data":"4b3987682f8176c7f19616db2284eaaa069733d47a3bb169e3a2e64f70c53e4a"}
Sep 11 04:40:32.953442 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.953344    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-68r27" podStartSLOduration=4.687318855 podStartE2EDuration="22.953300253s" totalImagesPullingTime="18.265981398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 04:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:40:32.953089127 +0000 UTC m=+22.606348809" watchObservedRunningTime="2026-09-11 04:40:32.953300253 +0000 UTC m=+22.606559936"
Sep 11 04:40:32.966545 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.966499    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zmltd" podStartSLOduration=4.720157814 podStartE2EDuration="22.966482108s" totalImagesPullingTime="18.246324294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 04:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:40:32.96601435 +0000 UTC m=+22.619274032" watchObservedRunningTime="2026-09-11 04:40:32.966482108 +0000 UTC m=+22.619741788"
Sep 11 04:40:32.993898 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.993849    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vjkgd" podStartSLOduration=4.754921941 podStartE2EDuration="22.993832301s" totalImagesPullingTime="18.23891036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 04:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:40:32.980849247 +0000 UTC m=+22.634108927" watchObservedRunningTime="2026-09-11 04:40:32.993832301 +0000 UTC m=+22.647092019"
Sep 11 04:40:32.994209 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:32.994190    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ddk77" podStartSLOduration=4.772878709 podStartE2EDuration="22.994181856s" totalImagesPullingTime="18.221303147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 04:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:40:32.993513195 +0000 UTC m=+22.646772887" watchObservedRunningTime="2026-09-11 04:40:32.994181856 +0000 UTC m=+22.647441535"
Sep 11 04:40:33.036528 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:33.036479    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ghlxt" podStartSLOduration=4.900923637 podStartE2EDuration="23.036460063s" totalImagesPullingTime="18.135536426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:40:33.031097563 +0000 UTC m=+22.684357242" watchObservedRunningTime="2026-09-11 04:40:33.036460063 +0000 UTC m=+22.689719743"
Sep 11 04:40:33.711704 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:33.711449    2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 04:40:33.788292 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:33.788119    2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T04:40:33.7116949Z","UUID":"f1436868-e240-4005-83bf-6a488dca56bf","Handler":null,"Name":"","Endpoint":""}
Sep 11 04:40:33.790038 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:33.790010    2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 04:40:33.790167 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:33.790053    2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 04:40:33.944149 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:33.944087    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qd5ll" event={"ID":"c24c3cd6-c444-489a-a59d-d9ce9f02217e","Type":"ContainerStarted","Data":"1d25a00e59e15d27fd67dfa43681ed0a71542c0cda628fe4a34062a9eed6505c"}
Sep 11 04:40:33.946426 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:33.946387    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5" event={"ID":"f32aea16-a091-4521-8695-5ccb48885bbe","Type":"ContainerStarted","Data":"a91bd6b813307d517c76c9d0b2f9c77e5e74b159d49f7a436a51e7fe7ca74fd7"}
Sep 11 04:40:33.958002 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:33.957953    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qd5ll" podStartSLOduration=5.735031239 podStartE2EDuration="23.957936506s" totalImagesPullingTime="18.222905267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 04:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:40:33.957628877 +0000 UTC m=+23.610888557" watchObservedRunningTime="2026-09-11 04:40:33.957936506 +0000 UTC m=+23.611196186"
Sep 11 04:40:34.807129 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:34.807093    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:34.807321 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:34.807093    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:34.807321 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:34.807239    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:34.807321 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:34.807233    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d66qg" podUID="216c51f9-f976-4b58-a9ab-96bef1bf776c"
Sep 11 04:40:34.807510 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:34.807372    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgt9r" podUID="e0bd904c-02f2-47ab-8605-4791b0ea678e"
Sep 11 04:40:34.807510 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:34.807450    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2r4m7" podUID="8aaff5eb-511c-4772-84b1-d51c257ef1c8"
Sep 11 04:40:35.954050 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:35.954013    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5" event={"ID":"f32aea16-a091-4521-8695-5ccb48885bbe","Type":"ContainerStarted","Data":"1fddd79c14886f1965a620a5daa98f47ebda6a7e38ee32ed0443dec5e4207461"}
Sep 11 04:40:35.958013 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:35.957981    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc" event={"ID":"ca5086d2-4a84-4130-a5ab-cad1e43a286d","Type":"ContainerStarted","Data":"511fab7a1b799960241643e3d26283603f68e4420b50ad02c0a04244c05982a8"}
Sep 11 04:40:35.972108 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:35.972035    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ljdz5" podStartSLOduration=5.237285447 podStartE2EDuration="25.972017626s" totalImagesPullingTime="20.734732179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 04:40:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:40:35.971086278 +0000 UTC m=+25.624345959" watchObservedRunningTime="2026-09-11 04:40:35.972017626 +0000 UTC m=+25.625277306"
Sep 11 04:40:36.334564 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:36.334462    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ghlxt"
Sep 11 04:40:36.335119 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:36.335099    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ghlxt"
Sep 11 04:40:36.807520 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:36.807482    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:36.807520 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:36.807502    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:36.807749 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:36.807484    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:36.807749 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:36.807617    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d66qg" podUID="216c51f9-f976-4b58-a9ab-96bef1bf776c"
Sep 11 04:40:36.807749 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:36.807676    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgt9r" podUID="e0bd904c-02f2-47ab-8605-4791b0ea678e"
Sep 11 04:40:36.807749 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:36.807738    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2r4m7" podUID="8aaff5eb-511c-4772-84b1-d51c257ef1c8"
Sep 11 04:40:37.965365 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:37.965149    2554 generic.go:356] "Generic (PLEG): container finished" podID="e1c2694b-8c0f-4f81-8a76-956c1615be81" containerID="d4da934a16a98e0518971253df3fac007c203979c272b9de245e896862ff40f4" exitCode=0
Sep 11 04:40:37.966020 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:37.965238    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88qn" event={"ID":"e1c2694b-8c0f-4f81-8a76-956c1615be81","Type":"ContainerDied","Data":"d4da934a16a98e0518971253df3fac007c203979c272b9de245e896862ff40f4"}
Sep 11 04:40:37.969638 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:37.969603    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc" event={"ID":"ca5086d2-4a84-4130-a5ab-cad1e43a286d","Type":"ContainerStarted","Data":"e01c80074263f7a012f022781694f585f6dc6646819e36ac22d3a9a3ee52a0d0"}
Sep 11 04:40:37.969857 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:37.969839    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:37.969937 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:37.969913    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:37.969993 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:37.969962    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:37.985871 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:37.985797    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:37.985993 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:37.985913    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:40:38.008562 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:38.008513    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc" podStartSLOduration=9.711775385 podStartE2EDuration="28.008497936s" totalImagesPullingTime="18.296722551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 04:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:40:38.00735709 +0000 UTC m=+27.660616769" watchObservedRunningTime="2026-09-11 04:40:38.008497936 +0000 UTC m=+27.661757616"
Sep 11 04:40:38.807114 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:38.807081    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:38.807308 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:38.807131    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:38.807308 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:38.807084    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:38.807308 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:38.807214    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgt9r" podUID="e0bd904c-02f2-47ab-8605-4791b0ea678e"
Sep 11 04:40:38.807617 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:38.807315    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d66qg" podUID="216c51f9-f976-4b58-a9ab-96bef1bf776c"
Sep 11 04:40:38.807617 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:38.807450    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2r4m7" podUID="8aaff5eb-511c-4772-84b1-d51c257ef1c8"
Sep 11 04:40:39.216196 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:39.216026    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ghlxt"
Sep 11 04:40:39.216776 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:39.216341    2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 04:40:39.216848 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:39.216798    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ghlxt"
Sep 11 04:40:39.412726 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:39.412691    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2r4m7"]
Sep 11 04:40:39.412906 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:39.412820    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:39.412973 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:39.412920    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2r4m7" podUID="8aaff5eb-511c-4772-84b1-d51c257ef1c8"
Sep 11 04:40:39.415854 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:39.415827    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d66qg"]
Sep 11 04:40:39.416013 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:39.415928    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:39.416076 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:39.416034    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d66qg" podUID="216c51f9-f976-4b58-a9ab-96bef1bf776c"
Sep 11 04:40:39.416484 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:39.416459    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tgt9r"]
Sep 11 04:40:39.416613 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:39.416551    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:39.416680 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:39.416644    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgt9r" podUID="e0bd904c-02f2-47ab-8605-4791b0ea678e"
Sep 11 04:40:39.976764 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:39.976732    2554 generic.go:356] "Generic (PLEG): container finished" podID="e1c2694b-8c0f-4f81-8a76-956c1615be81" containerID="ebe07b8afd736eee2b9a4fb0d9f6f65ffc7d297fc85631eb4d8e9c6a65f0690d" exitCode=0
Sep 11 04:40:39.976949 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:39.976814    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88qn" event={"ID":"e1c2694b-8c0f-4f81-8a76-956c1615be81","Type":"ContainerDied","Data":"ebe07b8afd736eee2b9a4fb0d9f6f65ffc7d297fc85631eb4d8e9c6a65f0690d"}
Sep 11 04:40:40.808506 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:40.808476    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:40.808949 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:40.808594    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2r4m7" podUID="8aaff5eb-511c-4772-84b1-d51c257ef1c8"
Sep 11 04:40:41.807583 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:41.807499    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:41.807583 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:41.807533    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:41.807758 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:41.807633    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgt9r" podUID="e0bd904c-02f2-47ab-8605-4791b0ea678e"
Sep 11 04:40:41.807758 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:41.807738    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d66qg" podUID="216c51f9-f976-4b58-a9ab-96bef1bf776c"
Sep 11 04:40:41.984024 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:41.983993    2554 generic.go:356] "Generic (PLEG): container finished" podID="e1c2694b-8c0f-4f81-8a76-956c1615be81" containerID="c4b59884edc5082261d65ad8380fdd39f63f1cbe248db4a1049dd55efd0773a2" exitCode=0
Sep 11 04:40:41.984427 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:41.984036    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88qn" event={"ID":"e1c2694b-8c0f-4f81-8a76-956c1615be81","Type":"ContainerDied","Data":"c4b59884edc5082261d65ad8380fdd39f63f1cbe248db4a1049dd55efd0773a2"}
Sep 11 04:40:42.807612 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:42.807567    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:42.807817 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:42.807715    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2r4m7" podUID="8aaff5eb-511c-4772-84b1-d51c257ef1c8"
Sep 11 04:40:43.807592 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:43.807556    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:43.808067 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:43.807556    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:43.808067 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:43.807684    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d66qg" podUID="216c51f9-f976-4b58-a9ab-96bef1bf776c"
Sep 11 04:40:43.808067 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:43.807760    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tgt9r" podUID="e0bd904c-02f2-47ab-8605-4791b0ea678e"
Sep 11 04:40:44.473630 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:44.473589    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs\") pod \"network-metrics-daemon-2r4m7\" (UID: \"8aaff5eb-511c-4772-84b1-d51c257ef1c8\") " pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:44.473796 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:44.473720    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 04:40:44.473796 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:44.473786    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs podName:8aaff5eb-511c-4772-84b1-d51c257ef1c8 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:16.473769334 +0000 UTC m=+66.127028995 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs") pod "network-metrics-daemon-2r4m7" (UID: "8aaff5eb-511c-4772-84b1-d51c257ef1c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 04:40:44.574558 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:44.574518    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret\") pod \"global-pull-secret-syncer-d66qg\" (UID: \"216c51f9-f976-4b58-a9ab-96bef1bf776c\") " pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:44.574730 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:44.574688    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 04:40:44.574783 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:44.574753    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret podName:216c51f9-f976-4b58-a9ab-96bef1bf776c nodeName:}" failed. No retries permitted until 2026-09-11 04:41:16.574736142 +0000 UTC m=+66.227995801 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret") pod "global-pull-secret-syncer-d66qg" (UID: "216c51f9-f976-4b58-a9ab-96bef1bf776c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 04:40:44.675227 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:44.675192    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w77hh\" (UniqueName: \"kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh\") pod \"network-check-target-tgt9r\" (UID: \"e0bd904c-02f2-47ab-8605-4791b0ea678e\") " pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:44.675443 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:44.675410    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 04:40:44.675443 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:44.675436    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 04:40:44.675556 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:44.675449    2554 projected.go:196] Error preparing data for projected volume kube-api-access-w77hh for pod openshift-network-diagnostics/network-check-target-tgt9r: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 04:40:44.675556 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:44.675515    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh podName:e0bd904c-02f2-47ab-8605-4791b0ea678e nodeName:}" failed. No retries permitted until 2026-09-11 04:41:16.675495091 +0000 UTC m=+66.328754752 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-w77hh" (UniqueName: "kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh") pod "network-check-target-tgt9r" (UID: "e0bd904c-02f2-47ab-8605-4791b0ea678e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 04:40:44.807901 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:44.807822    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:44.808429 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:44.807990    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2r4m7" podUID="8aaff5eb-511c-4772-84b1-d51c257ef1c8"
Sep 11 04:40:45.628753 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.628508    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-244.ec2.internal" event="NodeReady"
Sep 11 04:40:45.628928 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.628885    2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 04:40:45.673899 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.673863    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tgr28"]
Sep 11 04:40:45.676340 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.676310    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tgr28"
Sep 11 04:40:45.676966 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.676934    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rn87x"]
Sep 11 04:40:45.678714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.678691    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rn87x"
Sep 11 04:40:45.679282 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.679241    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 04:40:45.679282 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.679254    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 04:40:45.679556 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.679534    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v459k\""
Sep 11 04:40:45.681071 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.681050    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6kvx7\""
Sep 11 04:40:45.681191 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.681103    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 04:40:45.681260 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.681236    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 04:40:45.681513 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.681496    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 04:40:45.691672 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.691470    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rn87x"]
Sep 11 04:40:45.693060 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.692705    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tgr28"]
Sep 11 04:40:45.783710 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.783674    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-config-volume\") pod \"dns-default-tgr28\" (UID: \"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca\") " pod="openshift-dns/dns-default-tgr28"
Sep 11 04:40:45.783891 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.783740    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnffd\" (UniqueName: \"kubernetes.io/projected/292a0e4d-f68d-4043-9b6c-9467330e9aa6-kube-api-access-jnffd\") pod \"ingress-canary-rn87x\" (UID: \"292a0e4d-f68d-4043-9b6c-9467330e9aa6\") " pod="openshift-ingress-canary/ingress-canary-rn87x"
Sep 11 04:40:45.783891 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.783864    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls\") pod \"dns-default-tgr28\" (UID: \"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca\") " pod="openshift-dns/dns-default-tgr28"
Sep 11 04:40:45.784008 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.783903    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4v7m\" (UniqueName: \"kubernetes.io/projected/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-kube-api-access-t4v7m\") pod \"dns-default-tgr28\" (UID: \"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca\") " pod="openshift-dns/dns-default-tgr28"
Sep 11 04:40:45.784008 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.783928    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-tmp-dir\") pod \"dns-default-tgr28\" (UID: \"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca\") " pod="openshift-dns/dns-default-tgr28"
Sep 11 04:40:45.784008 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.783953    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/292a0e4d-f68d-4043-9b6c-9467330e9aa6-cert\") pod \"ingress-canary-rn87x\" (UID: \"292a0e4d-f68d-4043-9b6c-9467330e9aa6\") " pod="openshift-ingress-canary/ingress-canary-rn87x"
Sep 11 04:40:45.807608 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.807516    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:40:45.807608 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.807559    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:40:45.810248 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.809821    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 04:40:45.810248 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.809821    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6kl86\""
Sep 11 04:40:45.810248 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.810112    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 04:40:45.810248 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.810178    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 04:40:45.884734 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.884689    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls\") pod \"dns-default-tgr28\" (UID: \"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca\") " pod="openshift-dns/dns-default-tgr28"
Sep 11 04:40:45.884931 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.884742    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4v7m\" (UniqueName: \"kubernetes.io/projected/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-kube-api-access-t4v7m\") pod \"dns-default-tgr28\" (UID: \"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca\") " pod="openshift-dns/dns-default-tgr28"
Sep 11 04:40:45.884931 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.884774    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-tmp-dir\") pod \"dns-default-tgr28\" (UID: \"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca\") " pod="openshift-dns/dns-default-tgr28"
Sep 11 04:40:45.884931 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.884797    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/292a0e4d-f68d-4043-9b6c-9467330e9aa6-cert\") pod \"ingress-canary-rn87x\" (UID: \"292a0e4d-f68d-4043-9b6c-9467330e9aa6\") " pod="openshift-ingress-canary/ingress-canary-rn87x"
Sep 11 04:40:45.884931 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.884834    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-config-volume\") pod \"dns-default-tgr28\" (UID: \"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca\") " pod="openshift-dns/dns-default-tgr28"
Sep 11 04:40:45.884931 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:45.884863    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 04:40:45.885192 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:45.884937    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls podName:23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca nodeName:}" failed. No retries permitted until 2026-09-11 04:40:46.384916625 +0000 UTC m=+36.038176302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls") pod "dns-default-tgr28" (UID: "23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca") : secret "dns-default-metrics-tls" not found
Sep 11 04:40:45.885192 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.884869    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnffd\" (UniqueName: \"kubernetes.io/projected/292a0e4d-f68d-4043-9b6c-9467330e9aa6-kube-api-access-jnffd\") pod \"ingress-canary-rn87x\" (UID: \"292a0e4d-f68d-4043-9b6c-9467330e9aa6\") " pod="openshift-ingress-canary/ingress-canary-rn87x"
Sep 11 04:40:45.885270 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.885189    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-tmp-dir\") pod \"dns-default-tgr28\" (UID: \"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca\") " pod="openshift-dns/dns-default-tgr28"
Sep 11 04:40:45.885721 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.885699    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-config-volume\") pod \"dns-default-tgr28\" (UID: \"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca\") " pod="openshift-dns/dns-default-tgr28"
Sep 11 04:40:45.889815 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.889795    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/292a0e4d-f68d-4043-9b6c-9467330e9aa6-cert\") pod \"ingress-canary-rn87x\" (UID: \"292a0e4d-f68d-4043-9b6c-9467330e9aa6\") " pod="openshift-ingress-canary/ingress-canary-rn87x"
Sep 11 04:40:45.895733 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.895704    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4v7m\" (UniqueName: \"kubernetes.io/projected/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-kube-api-access-t4v7m\") pod \"dns-default-tgr28\" (UID: \"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca\") " pod="openshift-dns/dns-default-tgr28"
Sep 11 04:40:45.895897 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.895876    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnffd\" (UniqueName: \"kubernetes.io/projected/292a0e4d-f68d-4043-9b6c-9467330e9aa6-kube-api-access-jnffd\") pod \"ingress-canary-rn87x\" (UID: \"292a0e4d-f68d-4043-9b6c-9467330e9aa6\") " pod="openshift-ingress-canary/ingress-canary-rn87x"
Sep 11 04:40:45.998962 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:45.998930    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rn87x"
Sep 11 04:40:46.389277 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:46.389238    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls\") pod \"dns-default-tgr28\" (UID: \"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca\") " pod="openshift-dns/dns-default-tgr28"
Sep 11 04:40:46.389495 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:46.389402    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 04:40:46.389495 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:46.389473    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls podName:23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca nodeName:}" failed. No retries permitted until 2026-09-11 04:40:47.389454443 +0000 UTC m=+37.042714117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls") pod "dns-default-tgr28" (UID: "23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca") : secret "dns-default-metrics-tls" not found
Sep 11 04:40:46.807955 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:46.807923    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:40:46.810795 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:46.810764    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 04:40:46.811708 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:46.810866    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rs4qk\""
Sep 11 04:40:46.998718 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:46.998646    2554 generic.go:356] "Generic (PLEG): container finished" podID="e1c2694b-8c0f-4f81-8a76-956c1615be81" containerID="0d6d312d6d078ec3b201bd7c080a2b252e5d051b4ba6f43364f0108d1d9b38c3" exitCode=0
Sep 11 04:40:46.998718 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:46.998682    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88qn" event={"ID":"e1c2694b-8c0f-4f81-8a76-956c1615be81","Type":"ContainerDied","Data":"0d6d312d6d078ec3b201bd7c080a2b252e5d051b4ba6f43364f0108d1d9b38c3"}
Sep 11 04:40:47.016283 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:47.016254    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rn87x"]
Sep 11 04:40:47.021505 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:40:47.021477    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod292a0e4d_f68d_4043_9b6c_9467330e9aa6.slice/crio-62f2cddb377b85c8d5a197a39529ca6de7b6049e7e627beddb4e8d2f41580462 WatchSource:0}: Error finding container 62f2cddb377b85c8d5a197a39529ca6de7b6049e7e627beddb4e8d2f41580462: Status 404 returned error can't find the container with id 62f2cddb377b85c8d5a197a39529ca6de7b6049e7e627beddb4e8d2f41580462
Sep 11 04:40:47.397624 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:47.397361    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls\") pod \"dns-default-tgr28\" (UID: \"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca\") " pod="openshift-dns/dns-default-tgr28"
Sep 11 04:40:47.397766 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:47.397438    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 04:40:47.397766 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:47.397696    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls podName:23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca nodeName:}" failed. No retries permitted until 2026-09-11 04:40:49.397679149 +0000 UTC m=+39.050938813 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls") pod "dns-default-tgr28" (UID: "23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca") : secret "dns-default-metrics-tls" not found
Sep 11 04:40:48.002783 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:48.002745    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rn87x" event={"ID":"292a0e4d-f68d-4043-9b6c-9467330e9aa6","Type":"ContainerStarted","Data":"62f2cddb377b85c8d5a197a39529ca6de7b6049e7e627beddb4e8d2f41580462"}
Sep 11 04:40:48.006389 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:48.006356    2554 generic.go:356] "Generic (PLEG): container finished" podID="e1c2694b-8c0f-4f81-8a76-956c1615be81" containerID="f77ee5db8c93bf936e033f3cd8ae5a94411c9788246d0f09e4ac34ee30358e34" exitCode=0
Sep 11 04:40:48.006529 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:48.006412    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88qn" event={"ID":"e1c2694b-8c0f-4f81-8a76-956c1615be81","Type":"ContainerDied","Data":"f77ee5db8c93bf936e033f3cd8ae5a94411c9788246d0f09e4ac34ee30358e34"}
Sep 11 04:40:49.013670 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:49.013630    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88qn" event={"ID":"e1c2694b-8c0f-4f81-8a76-956c1615be81","Type":"ContainerStarted","Data":"2d120289a3aad5d310a4480d5c402d6b9a1690ee18a86f46bf4d6756b84aad9d"}
Sep 11 04:40:49.037826 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:49.037524    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t88qn" podStartSLOduration=8.703552566 podStartE2EDuration="39.03749968s" totalImagesPullingTime="30.333947114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 04:40:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:40:49.036955666 +0000 UTC m=+38.690215345" watchObservedRunningTime="2026-09-11 04:40:49.03749968 +0000 UTC m=+38.690759364"
Sep 11 04:40:49.411803 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:49.411764    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls\") pod \"dns-default-tgr28\" (UID: \"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca\") " pod="openshift-dns/dns-default-tgr28"
Sep 11 04:40:49.411963 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:49.411890    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 04:40:49.411963 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:49.411947    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls podName:23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca nodeName:}" failed. No retries permitted until 2026-09-11 04:40:53.411931926 +0000 UTC m=+43.065191590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls") pod "dns-default-tgr28" (UID: "23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca") : secret "dns-default-metrics-tls" not found
Sep 11 04:40:50.018078 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:50.017975    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rn87x" event={"ID":"292a0e4d-f68d-4043-9b6c-9467330e9aa6","Type":"ContainerStarted","Data":"f07c94aa9d6e62cb36c178e15b4bf4c6cb91104bcdbffab7e077176aee625cc2"}
Sep 11 04:40:50.035783 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:50.035733    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rn87x" podStartSLOduration=2.3829953440000002 podStartE2EDuration="5.035715417s" totalImagesPullingTime="2.652720073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:40:50.03455513 +0000 UTC m=+39.687814811" watchObservedRunningTime="2026-09-11 04:40:50.035715417 +0000 UTC m=+39.688975096"
Sep 11 04:40:53.441512 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:40:53.441468    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls\") pod \"dns-default-tgr28\" (UID: \"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca\") " pod="openshift-dns/dns-default-tgr28"
Sep 11 04:40:53.441894 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:53.441590    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 04:40:53.441894 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:40:53.441651    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls podName:23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca nodeName:}" failed. No retries permitted until 2026-09-11 04:41:01.441637824 +0000 UTC m=+51.094897482 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls") pod "dns-default-tgr28" (UID: "23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca") : secret "dns-default-metrics-tls" not found
Sep 11 04:41:01.500465 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:01.500424    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls\") pod \"dns-default-tgr28\" (UID: \"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca\") " pod="openshift-dns/dns-default-tgr28"
Sep 11 04:41:01.500919 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:01.500537    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 04:41:01.500919 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:01.500600    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls podName:23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca nodeName:}" failed. No retries permitted until 2026-09-11 04:41:17.500585419 +0000 UTC m=+67.153845077 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls") pod "dns-default-tgr28" (UID: "23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca") : secret "dns-default-metrics-tls" not found
Sep 11 04:41:04.502703 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.502671    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb"]
Sep 11 04:41:04.504540 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.504522    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb"
Sep 11 04:41:04.507361 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.507133    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 11 04:41:04.507361 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.507161    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qc6lr\""
Sep 11 04:41:04.508363 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.507532    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 11 04:41:04.508363 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.507567    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 11 04:41:04.511882 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.511842    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb"]
Sep 11 04:41:04.523232 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.523205    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nfmf\" (UniqueName: \"kubernetes.io/projected/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-kube-api-access-5nfmf\") pod \"cluster-samples-operator-86499c89c4-mgvsb\" (UID: \"6b6d5b8c-fedc-423c-aaaa-f2924d596ad4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb"
Sep 11 04:41:04.523378 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.523262    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mgvsb\" (UID: \"6b6d5b8c-fedc-423c-aaaa-f2924d596ad4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb"
Sep 11 04:41:04.606797 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.606764    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-55cd4498b4-c6wv9"]
Sep 11 04:41:04.608657 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.608642    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:04.610682 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.610650    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 04:41:04.610965 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.610944    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 04:41:04.611023 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.611010    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 04:41:04.611230 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.611211    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 04:41:04.611365 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.611231    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 04:41:04.611365 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.611236    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 04:41:04.611365 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.611245    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xrr9j\""
Sep 11 04:41:04.623735 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.623705    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55cd4498b4-c6wv9"]
Sep 11 04:41:04.624063 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.624044    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nfmf\" (UniqueName: \"kubernetes.io/projected/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-kube-api-access-5nfmf\") pod \"cluster-samples-operator-86499c89c4-mgvsb\" (UID: \"6b6d5b8c-fedc-423c-aaaa-f2924d596ad4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb"
Sep 11 04:41:04.624158 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.624088    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-default-certificate\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:04.624158 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.624116    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-stats-auth\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:04.624260 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.624185    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-metrics-certs\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:04.624260 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.624211    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8pf5\" (UniqueName: \"kubernetes.io/projected/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-kube-api-access-k8pf5\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:04.624367 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.624257    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mgvsb\" (UID: \"6b6d5b8c-fedc-423c-aaaa-f2924d596ad4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb"
Sep 11 04:41:04.624367 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:04.624342    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 04:41:04.624367 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.624347    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:04.624471 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:04.624398    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-samples-operator-tls podName:6b6d5b8c-fedc-423c-aaaa-f2924d596ad4 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:05.124382617 +0000 UTC m=+54.777642274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-mgvsb" (UID: "6b6d5b8c-fedc-423c-aaaa-f2924d596ad4") : secret "samples-operator-tls" not found
Sep 11 04:41:04.637349 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.637302    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nfmf\" (UniqueName: \"kubernetes.io/projected/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-kube-api-access-5nfmf\") pod \"cluster-samples-operator-86499c89c4-mgvsb\" (UID: \"6b6d5b8c-fedc-423c-aaaa-f2924d596ad4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb"
Sep 11 04:41:04.703937 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.703898    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-vxkzj"]
Sep 11 04:41:04.705753 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.705738    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vxkzj"
Sep 11 04:41:04.708505 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.708485    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 11 04:41:04.708904 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.708772    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 11 04:41:04.709343 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.709302    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8zrzs\""
Sep 11 04:41:04.709431 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.709401    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 11 04:41:04.709504 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.709480    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 11 04:41:04.717760 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.717738    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-vxkzj"]
Sep 11 04:41:04.724661 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.724638    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/278f1e65-4970-4a6c-b085-e6792ba5065d-config\") pod \"service-ca-operator-cf7c776b7-vxkzj\" (UID: \"278f1e65-4970-4a6c-b085-e6792ba5065d\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vxkzj"
Sep 11 04:41:04.724794 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.724664    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w685h\" (UniqueName: \"kubernetes.io/projected/278f1e65-4970-4a6c-b085-e6792ba5065d-kube-api-access-w685h\") pod \"service-ca-operator-cf7c776b7-vxkzj\" (UID: \"278f1e65-4970-4a6c-b085-e6792ba5065d\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vxkzj"
Sep 11 04:41:04.724794 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.724702    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-metrics-certs\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:04.724794 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.724746    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8pf5\" (UniqueName: \"kubernetes.io/projected/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-kube-api-access-k8pf5\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:04.724951 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.724825    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:04.724951 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:04.724844    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 04:41:04.724951 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.724867    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/278f1e65-4970-4a6c-b085-e6792ba5065d-serving-cert\") pod \"service-ca-operator-cf7c776b7-vxkzj\" (UID: \"278f1e65-4970-4a6c-b085-e6792ba5065d\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vxkzj"
Sep 11 04:41:04.724951 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:04.724898    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-metrics-certs podName:8ddc8e86-ba33-4a96-80b5-c05cc07cd824 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:05.224882833 +0000 UTC m=+54.878142508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-metrics-certs") pod "router-default-55cd4498b4-c6wv9" (UID: "8ddc8e86-ba33-4a96-80b5-c05cc07cd824") : secret "router-metrics-certs-default" not found
Sep 11 04:41:04.725138 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:04.724966    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle podName:8ddc8e86-ba33-4a96-80b5-c05cc07cd824 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:05.224950609 +0000 UTC m=+54.878210267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle") pod "router-default-55cd4498b4-c6wv9" (UID: "8ddc8e86-ba33-4a96-80b5-c05cc07cd824") : configmap references non-existent config key: service-ca.crt
Sep 11 04:41:04.725138 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.724995    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-default-certificate\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:04.725138 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.725011    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-stats-auth\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:04.727742 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.727712    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-stats-auth\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:04.727838 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.727741    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-default-certificate\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:04.737819 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.737789    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8pf5\" (UniqueName: \"kubernetes.io/projected/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-kube-api-access-k8pf5\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:04.825415 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.825294    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/278f1e65-4970-4a6c-b085-e6792ba5065d-config\") pod \"service-ca-operator-cf7c776b7-vxkzj\" (UID: \"278f1e65-4970-4a6c-b085-e6792ba5065d\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vxkzj"
Sep 11 04:41:04.825415 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.825359    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w685h\" (UniqueName: \"kubernetes.io/projected/278f1e65-4970-4a6c-b085-e6792ba5065d-kube-api-access-w685h\") pod \"service-ca-operator-cf7c776b7-vxkzj\" (UID: \"278f1e65-4970-4a6c-b085-e6792ba5065d\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vxkzj"
Sep 11 04:41:04.825648 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.825487    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/278f1e65-4970-4a6c-b085-e6792ba5065d-serving-cert\") pod \"service-ca-operator-cf7c776b7-vxkzj\" (UID: \"278f1e65-4970-4a6c-b085-e6792ba5065d\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vxkzj"
Sep 11 04:41:04.825885 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.825862    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/278f1e65-4970-4a6c-b085-e6792ba5065d-config\") pod \"service-ca-operator-cf7c776b7-vxkzj\" (UID: \"278f1e65-4970-4a6c-b085-e6792ba5065d\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vxkzj"
Sep 11 04:41:04.827800 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.827781    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/278f1e65-4970-4a6c-b085-e6792ba5065d-serving-cert\") pod \"service-ca-operator-cf7c776b7-vxkzj\" (UID: \"278f1e65-4970-4a6c-b085-e6792ba5065d\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vxkzj"
Sep 11 04:41:04.833502 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:04.833480    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w685h\" (UniqueName: \"kubernetes.io/projected/278f1e65-4970-4a6c-b085-e6792ba5065d-kube-api-access-w685h\") pod \"service-ca-operator-cf7c776b7-vxkzj\" (UID: \"278f1e65-4970-4a6c-b085-e6792ba5065d\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vxkzj"
Sep 11 04:41:05.014973 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:05.014934    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vxkzj"
Sep 11 04:41:05.127313 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:05.127236    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mgvsb\" (UID: \"6b6d5b8c-fedc-423c-aaaa-f2924d596ad4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb"
Sep 11 04:41:05.127562 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:05.127365    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 04:41:05.127562 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:05.127430    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-samples-operator-tls podName:6b6d5b8c-fedc-423c-aaaa-f2924d596ad4 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:06.127415202 +0000 UTC m=+55.780674864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-mgvsb" (UID: "6b6d5b8c-fedc-423c-aaaa-f2924d596ad4") : secret "samples-operator-tls" not found
Sep 11 04:41:05.228205 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:05.228163    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:05.228398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:05.228262    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-metrics-certs\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:05.228398 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:05.228357    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle podName:8ddc8e86-ba33-4a96-80b5-c05cc07cd824 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:06.22831163 +0000 UTC m=+55.881571288 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle") pod "router-default-55cd4498b4-c6wv9" (UID: "8ddc8e86-ba33-4a96-80b5-c05cc07cd824") : configmap references non-existent config key: service-ca.crt
Sep 11 04:41:05.228398 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:05.228374    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 04:41:05.228515 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:05.228414    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-metrics-certs podName:8ddc8e86-ba33-4a96-80b5-c05cc07cd824 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:06.228403931 +0000 UTC m=+55.881663593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-metrics-certs") pod "router-default-55cd4498b4-c6wv9" (UID: "8ddc8e86-ba33-4a96-80b5-c05cc07cd824") : secret "router-metrics-certs-default" not found
Sep 11 04:41:05.284127 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:05.284092    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-vxkzj"]
Sep 11 04:41:05.287900 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:41:05.287871    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod278f1e65_4970_4a6c_b085_e6792ba5065d.slice/crio-fdcb6fc46a22faa0805bd7d59b355794b6dbbd2d878e2c240fcffe122c8865b0 WatchSource:0}: Error finding container fdcb6fc46a22faa0805bd7d59b355794b6dbbd2d878e2c240fcffe122c8865b0: Status 404 returned error can't find the container with id fdcb6fc46a22faa0805bd7d59b355794b6dbbd2d878e2c240fcffe122c8865b0
Sep 11 04:41:06.057980 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:06.057936    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vxkzj" event={"ID":"278f1e65-4970-4a6c-b085-e6792ba5065d","Type":"ContainerStarted","Data":"fdcb6fc46a22faa0805bd7d59b355794b6dbbd2d878e2c240fcffe122c8865b0"}
Sep 11 04:41:06.134789 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:06.134746    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mgvsb\" (UID: \"6b6d5b8c-fedc-423c-aaaa-f2924d596ad4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb"
Sep 11 04:41:06.134979 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:06.134941    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 04:41:06.135043 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:06.135031    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-samples-operator-tls podName:6b6d5b8c-fedc-423c-aaaa-f2924d596ad4 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:08.135007403 +0000 UTC m=+57.788267084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-mgvsb" (UID: "6b6d5b8c-fedc-423c-aaaa-f2924d596ad4") : secret "samples-operator-tls" not found
Sep 11 04:41:06.235718 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:06.235675    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-metrics-certs\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:06.235901 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:06.235751    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:06.235901 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:06.235843    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 04:41:06.236010 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:06.235925    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-metrics-certs podName:8ddc8e86-ba33-4a96-80b5-c05cc07cd824 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:08.235905386 +0000 UTC m=+57.889165060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-metrics-certs") pod "router-default-55cd4498b4-c6wv9" (UID: "8ddc8e86-ba33-4a96-80b5-c05cc07cd824") : secret "router-metrics-certs-default" not found
Sep 11 04:41:06.236010 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:06.235949    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle podName:8ddc8e86-ba33-4a96-80b5-c05cc07cd824 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:08.235940493 +0000 UTC m=+57.889200154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle") pod "router-default-55cd4498b4-c6wv9" (UID: "8ddc8e86-ba33-4a96-80b5-c05cc07cd824") : configmap references non-existent config key: service-ca.crt
Sep 11 04:41:08.064427 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:08.064388    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vxkzj" event={"ID":"278f1e65-4970-4a6c-b085-e6792ba5065d","Type":"ContainerStarted","Data":"40a6533fb8e9a20151dcc5c46a4bb08a6ca7fb78b8a9ff5565827deb7b2db449"}
Sep 11 04:41:08.081701 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:08.081647    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vxkzj" podStartSLOduration=2.293686979 podStartE2EDuration="4.081630083s" totalImagesPullingTime="1.787943104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:41:08.081065911 +0000 UTC m=+57.734325592" watchObservedRunningTime="2026-09-11 04:41:08.081630083 +0000 UTC m=+57.734889763"
Sep 11 04:41:08.149053 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:08.149015    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mgvsb\" (UID: \"6b6d5b8c-fedc-423c-aaaa-f2924d596ad4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb"
Sep 11 04:41:08.149238 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:08.149179    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 04:41:08.149305 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:08.149254    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-samples-operator-tls podName:6b6d5b8c-fedc-423c-aaaa-f2924d596ad4 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:12.149235143 +0000 UTC m=+61.802494818 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-mgvsb" (UID: "6b6d5b8c-fedc-423c-aaaa-f2924d596ad4") : secret "samples-operator-tls" not found
Sep 11 04:41:08.250286 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:08.250249    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-metrics-certs\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:08.250477 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:08.250303    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:08.250477 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:08.250429    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 04:41:08.250549 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:08.250490    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle podName:8ddc8e86-ba33-4a96-80b5-c05cc07cd824 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:12.250473307 +0000 UTC m=+61.903732965 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle") pod "router-default-55cd4498b4-c6wv9" (UID: "8ddc8e86-ba33-4a96-80b5-c05cc07cd824") : configmap references non-existent config key: service-ca.crt
Sep 11 04:41:08.250549 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:08.250510    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-metrics-certs podName:8ddc8e86-ba33-4a96-80b5-c05cc07cd824 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:12.250504142 +0000 UTC m=+61.903763799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-metrics-certs") pod "router-default-55cd4498b4-c6wv9" (UID: "8ddc8e86-ba33-4a96-80b5-c05cc07cd824") : secret "router-metrics-certs-default" not found
Sep 11 04:41:09.990412 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:09.990386    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2x5gc"
Sep 11 04:41:10.029846 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.029813    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-txlgl"]
Sep 11 04:41:10.066025 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.065987    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-txlgl"]
Sep 11 04:41:10.066162 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.066092    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:10.068456 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.068430    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 04:41:10.068688 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.068475    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 04:41:10.068688 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.068657    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 04:41:10.068688 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.068659    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 04:41:10.068904 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.068888    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h277b\""
Sep 11 04:41:10.164971 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.164936    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4932d639-195a-476e-9814-49bc2c1a19d7-data-volume\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:10.164971 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.164972    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4932d639-195a-476e-9814-49bc2c1a19d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:10.165185 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.165005    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4932d639-195a-476e-9814-49bc2c1a19d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:10.165185 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.165157    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj7gq\" (UniqueName: \"kubernetes.io/projected/4932d639-195a-476e-9814-49bc2c1a19d7-kube-api-access-wj7gq\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:10.165248 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.165191    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4932d639-195a-476e-9814-49bc2c1a19d7-crio-socket\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:10.265749 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.265670    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4932d639-195a-476e-9814-49bc2c1a19d7-crio-socket\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:10.265749 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.265722    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4932d639-195a-476e-9814-49bc2c1a19d7-data-volume\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:10.265749 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.265743    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4932d639-195a-476e-9814-49bc2c1a19d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:10.265954 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.265815    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4932d639-195a-476e-9814-49bc2c1a19d7-crio-socket\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:10.265954 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:10.265854    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 04:41:10.265954 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.265861    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4932d639-195a-476e-9814-49bc2c1a19d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:10.265954 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:10.265924    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4932d639-195a-476e-9814-49bc2c1a19d7-insights-runtime-extractor-tls podName:4932d639-195a-476e-9814-49bc2c1a19d7 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:10.765904849 +0000 UTC m=+60.419164522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4932d639-195a-476e-9814-49bc2c1a19d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txlgl" (UID: "4932d639-195a-476e-9814-49bc2c1a19d7") : secret "insights-runtime-extractor-tls" not found
Sep 11 04:41:10.266093 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:10.265956    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 04:41:10.266093 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:10.266004    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4932d639-195a-476e-9814-49bc2c1a19d7-kube-rbac-proxy-cm podName:4932d639-195a-476e-9814-49bc2c1a19d7 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:10.765991647 +0000 UTC m=+60.419251332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4932d639-195a-476e-9814-49bc2c1a19d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-txlgl" (UID: "4932d639-195a-476e-9814-49bc2c1a19d7") : configmap "kube-rbac-proxy" not found
Sep 11 04:41:10.266093 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.266027    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj7gq\" (UniqueName: \"kubernetes.io/projected/4932d639-195a-476e-9814-49bc2c1a19d7-kube-api-access-wj7gq\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:10.266093 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.266050    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4932d639-195a-476e-9814-49bc2c1a19d7-data-volume\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:10.276183 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.276156    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj7gq\" (UniqueName: \"kubernetes.io/projected/4932d639-195a-476e-9814-49bc2c1a19d7-kube-api-access-wj7gq\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:10.770143 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.770104    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4932d639-195a-476e-9814-49bc2c1a19d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:10.770143 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:10.770150    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4932d639-195a-476e-9814-49bc2c1a19d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:10.770373 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:10.770227    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 04:41:10.770373 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:10.770262    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 04:41:10.770373 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:10.770280    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4932d639-195a-476e-9814-49bc2c1a19d7-kube-rbac-proxy-cm podName:4932d639-195a-476e-9814-49bc2c1a19d7 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:11.770266243 +0000 UTC m=+61.423525901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4932d639-195a-476e-9814-49bc2c1a19d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-txlgl" (UID: "4932d639-195a-476e-9814-49bc2c1a19d7") : configmap "kube-rbac-proxy" not found
Sep 11 04:41:10.770373 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:10.770316    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4932d639-195a-476e-9814-49bc2c1a19d7-insights-runtime-extractor-tls podName:4932d639-195a-476e-9814-49bc2c1a19d7 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:11.770300686 +0000 UTC m=+61.423560344 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4932d639-195a-476e-9814-49bc2c1a19d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txlgl" (UID: "4932d639-195a-476e-9814-49bc2c1a19d7") : secret "insights-runtime-extractor-tls" not found
Sep 11 04:41:11.777498 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:11.777459    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4932d639-195a-476e-9814-49bc2c1a19d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:11.777889 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:11.777511    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4932d639-195a-476e-9814-49bc2c1a19d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:11.777889 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:11.777594    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 04:41:11.777889 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:11.777647    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 04:41:11.777889 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:11.777662    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4932d639-195a-476e-9814-49bc2c1a19d7-kube-rbac-proxy-cm podName:4932d639-195a-476e-9814-49bc2c1a19d7 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:13.777643566 +0000 UTC m=+63.430903224 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4932d639-195a-476e-9814-49bc2c1a19d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-txlgl" (UID: "4932d639-195a-476e-9814-49bc2c1a19d7") : configmap "kube-rbac-proxy" not found
Sep 11 04:41:11.777889 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:11.777738    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4932d639-195a-476e-9814-49bc2c1a19d7-insights-runtime-extractor-tls podName:4932d639-195a-476e-9814-49bc2c1a19d7 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:13.777718 +0000 UTC m=+63.430977668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4932d639-195a-476e-9814-49bc2c1a19d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txlgl" (UID: "4932d639-195a-476e-9814-49bc2c1a19d7") : secret "insights-runtime-extractor-tls" not found
Sep 11 04:41:12.180280 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:12.180246    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mgvsb\" (UID: \"6b6d5b8c-fedc-423c-aaaa-f2924d596ad4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb"
Sep 11 04:41:12.180463 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:12.180416    2554 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 04:41:12.180509 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:12.180481    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-samples-operator-tls podName:6b6d5b8c-fedc-423c-aaaa-f2924d596ad4 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:20.180466332 +0000 UTC m=+69.833725989 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-mgvsb" (UID: "6b6d5b8c-fedc-423c-aaaa-f2924d596ad4") : secret "samples-operator-tls" not found
Sep 11 04:41:12.197787 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:12.197763    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zmltd_4c9e693e-282c-44df-9ecd-485c40bc15a0/dns-node-resolver/0.log"
Sep 11 04:41:12.281125 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:12.281093    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-metrics-certs\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:12.281262 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:12.281140    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:12.281262 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:12.281256    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle podName:8ddc8e86-ba33-4a96-80b5-c05cc07cd824 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:20.281243297 +0000 UTC m=+69.934502954 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle") pod "router-default-55cd4498b4-c6wv9" (UID: "8ddc8e86-ba33-4a96-80b5-c05cc07cd824") : configmap references non-existent config key: service-ca.crt
Sep 11 04:41:12.281443 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:12.281268    2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 04:41:12.281443 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:12.281371    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-metrics-certs podName:8ddc8e86-ba33-4a96-80b5-c05cc07cd824 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:20.281353365 +0000 UTC m=+69.934613037 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-metrics-certs") pod "router-default-55cd4498b4-c6wv9" (UID: "8ddc8e86-ba33-4a96-80b5-c05cc07cd824") : secret "router-metrics-certs-default" not found
Sep 11 04:41:13.196964 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:13.196939    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ddk77_b096f3e4-4f74-419a-b6ff-c7d246dfa1d1/node-ca/0.log"
Sep 11 04:41:13.794016 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:13.793978    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4932d639-195a-476e-9814-49bc2c1a19d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:13.794016 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:13.794021    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4932d639-195a-476e-9814-49bc2c1a19d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:13.794236 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:13.794106    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 04:41:13.794236 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:13.794142    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 04:41:13.794236 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:13.794160    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4932d639-195a-476e-9814-49bc2c1a19d7-kube-rbac-proxy-cm podName:4932d639-195a-476e-9814-49bc2c1a19d7 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:17.794146119 +0000 UTC m=+67.447405791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4932d639-195a-476e-9814-49bc2c1a19d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-txlgl" (UID: "4932d639-195a-476e-9814-49bc2c1a19d7") : configmap "kube-rbac-proxy" not found
Sep 11 04:41:13.794236 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:13.794195    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4932d639-195a-476e-9814-49bc2c1a19d7-insights-runtime-extractor-tls podName:4932d639-195a-476e-9814-49bc2c1a19d7 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:17.794182414 +0000 UTC m=+67.447442076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4932d639-195a-476e-9814-49bc2c1a19d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txlgl" (UID: "4932d639-195a-476e-9814-49bc2c1a19d7") : secret "insights-runtime-extractor-tls" not found
Sep 11 04:41:13.797647 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:13.797619    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rn87x_292a0e4d-f68d-4043-9b6c-9467330e9aa6/serve-healthcheck-canary/0.log"
Sep 11 04:41:16.518052 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:16.518003    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs\") pod \"network-metrics-daemon-2r4m7\" (UID: \"8aaff5eb-511c-4772-84b1-d51c257ef1c8\") " pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:41:16.520284 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:16.520267    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 04:41:16.528495 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:16.528468    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 04:41:16.528551 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:16.528543    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs podName:8aaff5eb-511c-4772-84b1-d51c257ef1c8 nodeName:}" failed. No retries permitted until 2026-09-11 04:42:20.528520484 +0000 UTC m=+130.181780146 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs") pod "network-metrics-daemon-2r4m7" (UID: "8aaff5eb-511c-4772-84b1-d51c257ef1c8") : secret "metrics-daemon-secret" not found
Sep 11 04:41:16.618947 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:16.618911    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret\") pod \"global-pull-secret-syncer-d66qg\" (UID: \"216c51f9-f976-4b58-a9ab-96bef1bf776c\") " pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:41:16.621212 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:16.621192    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 04:41:16.632159 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:16.632127    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/216c51f9-f976-4b58-a9ab-96bef1bf776c-original-pull-secret\") pod \"global-pull-secret-syncer-d66qg\" (UID: \"216c51f9-f976-4b58-a9ab-96bef1bf776c\") " pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:41:16.720105 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:16.720062    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w77hh\" (UniqueName: \"kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh\") pod \"network-check-target-tgt9r\" (UID: \"e0bd904c-02f2-47ab-8605-4791b0ea678e\") " pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:41:16.722275 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:16.722258    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 04:41:16.723807 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:16.723794    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d66qg"
Sep 11 04:41:16.732444 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:16.732424    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 04:41:16.743773 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:16.743746    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w77hh\" (UniqueName: \"kubernetes.io/projected/e0bd904c-02f2-47ab-8605-4791b0ea678e-kube-api-access-w77hh\") pod \"network-check-target-tgt9r\" (UID: \"e0bd904c-02f2-47ab-8605-4791b0ea678e\") " pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:41:16.990863 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:16.990833    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d66qg"]
Sep 11 04:41:16.994054 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:41:16.994024    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod216c51f9_f976_4b58_a9ab_96bef1bf776c.slice/crio-79472c2fde52de11ab6bd6b732e671a01dcc633772a8a08ba57560948c539ca3 WatchSource:0}: Error finding container 79472c2fde52de11ab6bd6b732e671a01dcc633772a8a08ba57560948c539ca3: Status 404 returned error can't find the container with id 79472c2fde52de11ab6bd6b732e671a01dcc633772a8a08ba57560948c539ca3
Sep 11 04:41:17.021981 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:17.021908    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6kl86\""
Sep 11 04:41:17.029709 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:17.029684    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:41:17.087873 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:17.087844    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d66qg" event={"ID":"216c51f9-f976-4b58-a9ab-96bef1bf776c","Type":"ContainerStarted","Data":"79472c2fde52de11ab6bd6b732e671a01dcc633772a8a08ba57560948c539ca3"}
Sep 11 04:41:17.294580 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:17.294508    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tgt9r"]
Sep 11 04:41:17.298355 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:41:17.298296    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0bd904c_02f2_47ab_8605_4791b0ea678e.slice/crio-f029c94e970a66f7911abcad23b58d6ea4534576584546182cdb148d6a95bc69 WatchSource:0}: Error finding container f029c94e970a66f7911abcad23b58d6ea4534576584546182cdb148d6a95bc69: Status 404 returned error can't find the container with id f029c94e970a66f7911abcad23b58d6ea4534576584546182cdb148d6a95bc69
Sep 11 04:41:17.525180 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:17.525140    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls\") pod \"dns-default-tgr28\" (UID: \"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca\") " pod="openshift-dns/dns-default-tgr28"
Sep 11 04:41:17.525600 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:17.525267    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 04:41:17.525600 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:17.525320    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls podName:23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca nodeName:}" failed. No retries permitted until 2026-09-11 04:41:49.525306687 +0000 UTC m=+99.178566345 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls") pod "dns-default-tgr28" (UID: "23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca") : secret "dns-default-metrics-tls" not found
Sep 11 04:41:17.828066 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:17.828023    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4932d639-195a-476e-9814-49bc2c1a19d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:17.828241 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:17.828090    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4932d639-195a-476e-9814-49bc2c1a19d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:17.828320 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:17.828251    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 04:41:17.828320 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:17.828308    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4932d639-195a-476e-9814-49bc2c1a19d7-kube-rbac-proxy-cm podName:4932d639-195a-476e-9814-49bc2c1a19d7 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:25.828295288 +0000 UTC m=+75.481554945 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4932d639-195a-476e-9814-49bc2c1a19d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-txlgl" (UID: "4932d639-195a-476e-9814-49bc2c1a19d7") : configmap "kube-rbac-proxy" not found
Sep 11 04:41:17.828748 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:17.828730    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 04:41:17.828820 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:17.828785    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4932d639-195a-476e-9814-49bc2c1a19d7-insights-runtime-extractor-tls podName:4932d639-195a-476e-9814-49bc2c1a19d7 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:25.828770118 +0000 UTC m=+75.482029781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4932d639-195a-476e-9814-49bc2c1a19d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-txlgl" (UID: "4932d639-195a-476e-9814-49bc2c1a19d7") : secret "insights-runtime-extractor-tls" not found
Sep 11 04:41:18.092603 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:18.092480    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tgt9r" event={"ID":"e0bd904c-02f2-47ab-8605-4791b0ea678e","Type":"ContainerStarted","Data":"f029c94e970a66f7911abcad23b58d6ea4534576584546182cdb148d6a95bc69"}
Sep 11 04:41:20.249429 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:20.249389    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mgvsb\" (UID: \"6b6d5b8c-fedc-423c-aaaa-f2924d596ad4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb"
Sep 11 04:41:20.252472 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:20.252439    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b6d5b8c-fedc-423c-aaaa-f2924d596ad4-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-mgvsb\" (UID: \"6b6d5b8c-fedc-423c-aaaa-f2924d596ad4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb"
Sep 11 04:41:20.350879 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:20.350830    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-metrics-certs\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:20.351072 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:20.350899    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:20.351072 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:20.351046    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle podName:8ddc8e86-ba33-4a96-80b5-c05cc07cd824 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:36.351021844 +0000 UTC m=+86.004281518 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle") pod "router-default-55cd4498b4-c6wv9" (UID: "8ddc8e86-ba33-4a96-80b5-c05cc07cd824") : configmap references non-existent config key: service-ca.crt
Sep 11 04:41:20.353946 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:20.353916    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-metrics-certs\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:20.418792 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:20.418763    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qc6lr\""
Sep 11 04:41:20.426603 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:20.426583    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb"
Sep 11 04:41:22.481047 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:22.481012    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb"]
Sep 11 04:41:23.106388 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:23.106349    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tgt9r" event={"ID":"e0bd904c-02f2-47ab-8605-4791b0ea678e","Type":"ContainerStarted","Data":"99b21d8a0e7bcc284261fd648cd508355f64d54171f2934ec1b1c2db907fa9a9"}
Sep 11 04:41:23.106587 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:23.106416    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:41:23.108060 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:23.108026    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d66qg" event={"ID":"216c51f9-f976-4b58-a9ab-96bef1bf776c","Type":"ContainerStarted","Data":"a3a9b6d303fbb18171b4049bb27001d36ad70e154f1fa12792f5f63005e48ec1"}
Sep 11 04:41:23.109774 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:23.109742    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb" event={"ID":"6b6d5b8c-fedc-423c-aaaa-f2924d596ad4","Type":"ContainerStarted","Data":"b0476a44685590e71a62a783ae1653ab4474d9027e2268deb71b395fd3861bc6"}
Sep 11 04:41:23.124685 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:23.124627    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tgt9r" podStartSLOduration=67.206157048 podStartE2EDuration="1m12.124606601s" totalImagesPullingTime="4.918449553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:41:23.123261531 +0000 UTC m=+72.776521212" watchObservedRunningTime="2026-09-11 04:41:23.124606601 +0000 UTC m=+72.777866283"
Sep 11 04:41:23.136832 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:23.136774    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-d66qg" podStartSLOduration=66.90142771 podStartE2EDuration="1m12.136758597s" totalImagesPullingTime="5.235330887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 04:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:41:23.135628375 +0000 UTC m=+72.788888056" watchObservedRunningTime="2026-09-11 04:41:23.136758597 +0000 UTC m=+72.790018292"
Sep 11 04:41:25.118370 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:25.118311    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb" event={"ID":"6b6d5b8c-fedc-423c-aaaa-f2924d596ad4","Type":"ContainerStarted","Data":"e9d3fbeceeeaa153ac723db5a8f4d9ff2ad78f2e89a808007406e0ad5b59a470"}
Sep 11 04:41:25.118773 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:25.118389    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb" event={"ID":"6b6d5b8c-fedc-423c-aaaa-f2924d596ad4","Type":"ContainerStarted","Data":"1a51b522debee42f234145e00676eb3f7a8d6185f9c2b7dbe9ee14381d3fa0c7"}
Sep 11 04:41:25.135273 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:25.135222    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-mgvsb" podStartSLOduration=19.149844352 podStartE2EDuration="21.135204279s" totalImagesPullingTime="1.985359927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:41:25.134477667 +0000 UTC m=+74.787737346" watchObservedRunningTime="2026-09-11 04:41:25.135204279 +0000 UTC m=+74.788463959"
Sep 11 04:41:25.894416 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:25.894359    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4932d639-195a-476e-9814-49bc2c1a19d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:25.894416 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:25.894416    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4932d639-195a-476e-9814-49bc2c1a19d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:25.894894 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:25.894869    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4932d639-195a-476e-9814-49bc2c1a19d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:25.896798 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:25.896778    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4932d639-195a-476e-9814-49bc2c1a19d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-txlgl\" (UID: \"4932d639-195a-476e-9814-49bc2c1a19d7\") " pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:25.977172 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:25.977141    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h277b\""
Sep 11 04:41:25.985774 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:25.985724    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-txlgl"
Sep 11 04:41:26.253745 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:26.253660    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-txlgl"]
Sep 11 04:41:26.256262 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:41:26.256243    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4932d639_195a_476e_9814_49bc2c1a19d7.slice/crio-2a56e4630f7ef35b2f8f946f681e63cf8bf9c702f66c7a8378803dd44162840d WatchSource:0}: Error finding container 2a56e4630f7ef35b2f8f946f681e63cf8bf9c702f66c7a8378803dd44162840d: Status 404 returned error can't find the container with id 2a56e4630f7ef35b2f8f946f681e63cf8bf9c702f66c7a8378803dd44162840d
Sep 11 04:41:27.126054 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:27.126016    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-txlgl" event={"ID":"4932d639-195a-476e-9814-49bc2c1a19d7","Type":"ContainerStarted","Data":"4956f75de69dc9b09bd62cbeb4f10ae7d1671993d21cd40eed1fc9dffa3bb042"}
Sep 11 04:41:27.126228 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:27.126102    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-txlgl" event={"ID":"4932d639-195a-476e-9814-49bc2c1a19d7","Type":"ContainerStarted","Data":"8be2fa6bae38efc0a02c28f3b9209b943cc583bfe657867e0913b370351a6339"}
Sep 11 04:41:27.126228 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:27.126123    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-txlgl" event={"ID":"4932d639-195a-476e-9814-49bc2c1a19d7","Type":"ContainerStarted","Data":"2a56e4630f7ef35b2f8f946f681e63cf8bf9c702f66c7a8378803dd44162840d"}
Sep 11 04:41:29.135312 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:29.135273    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-txlgl" event={"ID":"4932d639-195a-476e-9814-49bc2c1a19d7","Type":"ContainerStarted","Data":"24d3b61a60da2f0d9c30b4140638b29d8a43c2a519a342d806da59d01e349925"}
Sep 11 04:41:29.155886 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:29.155831    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-txlgl" podStartSLOduration=17.187771421 podStartE2EDuration="19.155813188s" totalImagesPullingTime="1.968041767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 04:41:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:41:29.154680309 +0000 UTC m=+78.807939988" watchObservedRunningTime="2026-09-11 04:41:29.155813188 +0000 UTC m=+78.809072867"
Sep 11 04:41:33.194034 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.193915    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-4zdjm"]
Sep 11 04:41:33.198149 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.198122    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4zdjm"
Sep 11 04:41:33.198988 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.198967    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-cbc665978-7l2zs"]
Sep 11 04:41:33.200565 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.200549    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 11 04:41:33.201299 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.201277    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-l927x\""
Sep 11 04:41:33.201402 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.201317    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 11 04:41:33.201684 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.201666    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cbc665978-7l2zs"
Sep 11 04:41:33.205268 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.205242    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 04:41:33.205383 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.205317    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 04:41:33.205618 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.205601    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 04:41:33.205696 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.205615    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 11 04:41:33.210807 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.210786    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-4zdjm"]
Sep 11 04:41:33.215712 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.215684    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-cbc665978-7l2zs"]
Sep 11 04:41:33.247310 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.247279    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-576d49cb45-z98tv"]
Sep 11 04:41:33.247535 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.247515    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ce86f3ad-0822-47e8-bdbf-6a5a308dfa4a-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-4zdjm\" (UID: \"ce86f3ad-0822-47e8-bdbf-6a5a308dfa4a\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4zdjm"
Sep 11 04:41:33.247583 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.247544    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7940c22b-9f83-42ea-aec0-472e99d275a3-tmp\") pod \"klusterlet-addon-workmgr-cbc665978-7l2zs\" (UID: \"7940c22b-9f83-42ea-aec0-472e99d275a3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cbc665978-7l2zs"
Sep 11 04:41:33.247583 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.247563    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7940c22b-9f83-42ea-aec0-472e99d275a3-klusterlet-config\") pod \"klusterlet-addon-workmgr-cbc665978-7l2zs\" (UID: \"7940c22b-9f83-42ea-aec0-472e99d275a3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cbc665978-7l2zs"
Sep 11 04:41:33.247658 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.247581    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p549\" (UniqueName: \"kubernetes.io/projected/7940c22b-9f83-42ea-aec0-472e99d275a3-kube-api-access-2p549\") pod \"klusterlet-addon-workmgr-cbc665978-7l2zs\" (UID: \"7940c22b-9f83-42ea-aec0-472e99d275a3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cbc665978-7l2zs"
Sep 11 04:41:33.247703 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.247680    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ce86f3ad-0822-47e8-bdbf-6a5a308dfa4a-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-4zdjm\" (UID: \"ce86f3ad-0822-47e8-bdbf-6a5a308dfa4a\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4zdjm"
Sep 11 04:41:33.250251 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.250238    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.252519 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.252499    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 04:41:33.252765 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.252742    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 04:41:33.252765 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.252756    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 04:41:33.252927 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.252832    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fnkc4\""
Sep 11 04:41:33.258016 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.258000    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 04:41:33.265858 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.265839    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-576d49cb45-z98tv"]
Sep 11 04:41:33.348548 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.348513    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ce86f3ad-0822-47e8-bdbf-6a5a308dfa4a-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-4zdjm\" (UID: \"ce86f3ad-0822-47e8-bdbf-6a5a308dfa4a\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4zdjm"
Sep 11 04:41:33.348727 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.348557    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97f4da98-983c-4308-b836-f1c557dbc28b-trusted-ca\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.348727 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.348580    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7940c22b-9f83-42ea-aec0-472e99d275a3-tmp\") pod \"klusterlet-addon-workmgr-cbc665978-7l2zs\" (UID: \"7940c22b-9f83-42ea-aec0-472e99d275a3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cbc665978-7l2zs"
Sep 11 04:41:33.348727 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.348597    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bffl\" (UniqueName: \"kubernetes.io/projected/97f4da98-983c-4308-b836-f1c557dbc28b-kube-api-access-7bffl\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.348727 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.348657    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97f4da98-983c-4308-b836-f1c557dbc28b-bound-sa-token\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.348727 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.348699    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7940c22b-9f83-42ea-aec0-472e99d275a3-klusterlet-config\") pod \"klusterlet-addon-workmgr-cbc665978-7l2zs\" (UID: \"7940c22b-9f83-42ea-aec0-472e99d275a3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cbc665978-7l2zs"
Sep 11 04:41:33.348727 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.348730    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97f4da98-983c-4308-b836-f1c557dbc28b-image-registry-private-configuration\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.348938 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.348756    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97f4da98-983c-4308-b836-f1c557dbc28b-ca-trust-extracted\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.348938 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.348807    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97f4da98-983c-4308-b836-f1c557dbc28b-registry-tls\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.348938 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.348830    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97f4da98-983c-4308-b836-f1c557dbc28b-registry-certificates\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.348938 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.348861    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p549\" (UniqueName: \"kubernetes.io/projected/7940c22b-9f83-42ea-aec0-472e99d275a3-kube-api-access-2p549\") pod \"klusterlet-addon-workmgr-cbc665978-7l2zs\" (UID: \"7940c22b-9f83-42ea-aec0-472e99d275a3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cbc665978-7l2zs"
Sep 11 04:41:33.348938 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.348923    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ce86f3ad-0822-47e8-bdbf-6a5a308dfa4a-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-4zdjm\" (UID: \"ce86f3ad-0822-47e8-bdbf-6a5a308dfa4a\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4zdjm"
Sep 11 04:41:33.349115 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.348955    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97f4da98-983c-4308-b836-f1c557dbc28b-installation-pull-secrets\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.349115 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.349061    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7940c22b-9f83-42ea-aec0-472e99d275a3-tmp\") pod \"klusterlet-addon-workmgr-cbc665978-7l2zs\" (UID: \"7940c22b-9f83-42ea-aec0-472e99d275a3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cbc665978-7l2zs"
Sep 11 04:41:33.349308 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.349292    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ce86f3ad-0822-47e8-bdbf-6a5a308dfa4a-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-4zdjm\" (UID: \"ce86f3ad-0822-47e8-bdbf-6a5a308dfa4a\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4zdjm"
Sep 11 04:41:33.351389 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.351373    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7940c22b-9f83-42ea-aec0-472e99d275a3-klusterlet-config\") pod \"klusterlet-addon-workmgr-cbc665978-7l2zs\" (UID: \"7940c22b-9f83-42ea-aec0-472e99d275a3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cbc665978-7l2zs"
Sep 11 04:41:33.351437 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.351379    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ce86f3ad-0822-47e8-bdbf-6a5a308dfa4a-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-4zdjm\" (UID: \"ce86f3ad-0822-47e8-bdbf-6a5a308dfa4a\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4zdjm"
Sep 11 04:41:33.359597 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.359567    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p549\" (UniqueName: \"kubernetes.io/projected/7940c22b-9f83-42ea-aec0-472e99d275a3-kube-api-access-2p549\") pod \"klusterlet-addon-workmgr-cbc665978-7l2zs\" (UID: \"7940c22b-9f83-42ea-aec0-472e99d275a3\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cbc665978-7l2zs"
Sep 11 04:41:33.450225 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.450141    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97f4da98-983c-4308-b836-f1c557dbc28b-registry-tls\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.450225 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.450176    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97f4da98-983c-4308-b836-f1c557dbc28b-registry-certificates\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.450451 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.450312    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97f4da98-983c-4308-b836-f1c557dbc28b-installation-pull-secrets\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.450451 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.450409    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97f4da98-983c-4308-b836-f1c557dbc28b-trusted-ca\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.450451 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.450446    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bffl\" (UniqueName: \"kubernetes.io/projected/97f4da98-983c-4308-b836-f1c557dbc28b-kube-api-access-7bffl\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.450577 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.450480    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97f4da98-983c-4308-b836-f1c557dbc28b-bound-sa-token\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.450653 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.450613    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97f4da98-983c-4308-b836-f1c557dbc28b-image-registry-private-configuration\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.450729 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.450666    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97f4da98-983c-4308-b836-f1c557dbc28b-ca-trust-extracted\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.451029 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.450998    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/97f4da98-983c-4308-b836-f1c557dbc28b-registry-certificates\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.451116 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.451049    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/97f4da98-983c-4308-b836-f1c557dbc28b-ca-trust-extracted\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.451657 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.451632    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/97f4da98-983c-4308-b836-f1c557dbc28b-trusted-ca\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.452925 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.452904    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/97f4da98-983c-4308-b836-f1c557dbc28b-installation-pull-secrets\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.453009 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.452967    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/97f4da98-983c-4308-b836-f1c557dbc28b-registry-tls\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.453104 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.453089    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/97f4da98-983c-4308-b836-f1c557dbc28b-image-registry-private-configuration\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.458845 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.458824    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bffl\" (UniqueName: \"kubernetes.io/projected/97f4da98-983c-4308-b836-f1c557dbc28b-kube-api-access-7bffl\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.459438 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.459418    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97f4da98-983c-4308-b836-f1c557dbc28b-bound-sa-token\") pod \"image-registry-576d49cb45-z98tv\" (UID: \"97f4da98-983c-4308-b836-f1c557dbc28b\") " pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.508687 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.508647    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4zdjm"
Sep 11 04:41:33.513951 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.513931    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cbc665978-7l2zs"
Sep 11 04:41:33.559921 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.559691    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:33.783909 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.783886    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-4zdjm"]
Sep 11 04:41:33.786400 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:41:33.786367    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce86f3ad_0822_47e8_bdbf_6a5a308dfa4a.slice/crio-8f89826e9f611acef928e0608b417c28b403a929035d80ee06b52c59b357c1f7 WatchSource:0}: Error finding container 8f89826e9f611acef928e0608b417c28b403a929035d80ee06b52c59b357c1f7: Status 404 returned error can't find the container with id 8f89826e9f611acef928e0608b417c28b403a929035d80ee06b52c59b357c1f7
Sep 11 04:41:33.803081 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.802977    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-cbc665978-7l2zs"]
Sep 11 04:41:33.804872 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:41:33.804849    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7940c22b_9f83_42ea_aec0_472e99d275a3.slice/crio-6ad77e335723e428ecf4997fe90e806939356c0264e5d602d9020390ba26009c WatchSource:0}: Error finding container 6ad77e335723e428ecf4997fe90e806939356c0264e5d602d9020390ba26009c: Status 404 returned error can't find the container with id 6ad77e335723e428ecf4997fe90e806939356c0264e5d602d9020390ba26009c
Sep 11 04:41:33.863723 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:33.863690    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-576d49cb45-z98tv"]
Sep 11 04:41:33.866858 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:41:33.866830    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97f4da98_983c_4308_b836_f1c557dbc28b.slice/crio-5a1a69c81c111dea1ca05fcc97d1959c69f2e1f4f5e6e2feef8f13dde779a40c WatchSource:0}: Error finding container 5a1a69c81c111dea1ca05fcc97d1959c69f2e1f4f5e6e2feef8f13dde779a40c: Status 404 returned error can't find the container with id 5a1a69c81c111dea1ca05fcc97d1959c69f2e1f4f5e6e2feef8f13dde779a40c
Sep 11 04:41:34.152761 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:34.152666    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cbc665978-7l2zs" event={"ID":"7940c22b-9f83-42ea-aec0-472e99d275a3","Type":"ContainerStarted","Data":"6ad77e335723e428ecf4997fe90e806939356c0264e5d602d9020390ba26009c"}
Sep 11 04:41:34.154314 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:34.154279    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576d49cb45-z98tv" event={"ID":"97f4da98-983c-4308-b836-f1c557dbc28b","Type":"ContainerStarted","Data":"1cc551b13dcae2cf1c2205d4c11fcd3c81aeb5cd1a695d9e449248dcd43a4061"}
Sep 11 04:41:34.154466 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:34.154352    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576d49cb45-z98tv" event={"ID":"97f4da98-983c-4308-b836-f1c557dbc28b","Type":"ContainerStarted","Data":"5a1a69c81c111dea1ca05fcc97d1959c69f2e1f4f5e6e2feef8f13dde779a40c"}
Sep 11 04:41:34.154466 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:34.154380    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:41:34.155540 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:34.155510    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4zdjm" event={"ID":"ce86f3ad-0822-47e8-bdbf-6a5a308dfa4a","Type":"ContainerStarted","Data":"8f89826e9f611acef928e0608b417c28b403a929035d80ee06b52c59b357c1f7"}
Sep 11 04:41:34.173172 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:34.173115    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-576d49cb45-z98tv" podStartSLOduration=1.173097657 podStartE2EDuration="1.173097657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:41:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:41:34.172041792 +0000 UTC m=+83.825301473" watchObservedRunningTime="2026-09-11 04:41:34.173097657 +0000 UTC m=+83.826357337"
Sep 11 04:41:35.162024 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:35.161985    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4zdjm" event={"ID":"ce86f3ad-0822-47e8-bdbf-6a5a308dfa4a","Type":"ContainerStarted","Data":"7498844bdd5c41189e73a6200bc1006b815768c2c54fd392339b5177cb4b4779"}
Sep 11 04:41:36.374004 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:36.373955    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:36.374686 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:36.374665    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ddc8e86-ba33-4a96-80b5-c05cc07cd824-service-ca-bundle\") pod \"router-default-55cd4498b4-c6wv9\" (UID: \"8ddc8e86-ba33-4a96-80b5-c05cc07cd824\") " pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:36.420885 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:36.420851    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-xrr9j\""
Sep 11 04:41:36.428738 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:36.428668    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:37.727108 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:37.726818    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4zdjm" podStartSLOduration=3.485894989 podStartE2EDuration="4.726794644s" totalImagesPullingTime="1.240899655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:41:35.182257445 +0000 UTC m=+84.835517126" watchObservedRunningTime="2026-09-11 04:41:37.726794644 +0000 UTC m=+87.380054328"
Sep 11 04:41:37.727554 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:37.727259    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-55cd4498b4-c6wv9"]
Sep 11 04:41:37.731579 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:41:37.731539    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ddc8e86_ba33_4a96_80b5_c05cc07cd824.slice/crio-5f5d4a48963f9cce1e1d89f0e8d5a229e8f46ca18af8db139d2eeb844eb12175 WatchSource:0}: Error finding container 5f5d4a48963f9cce1e1d89f0e8d5a229e8f46ca18af8db139d2eeb844eb12175: Status 404 returned error can't find the container with id 5f5d4a48963f9cce1e1d89f0e8d5a229e8f46ca18af8db139d2eeb844eb12175
Sep 11 04:41:38.174437 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:38.174401    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55cd4498b4-c6wv9" event={"ID":"8ddc8e86-ba33-4a96-80b5-c05cc07cd824","Type":"ContainerStarted","Data":"6a88d75f32e7af7596a5b3b9139f4964e3365d4d44aef4d73dc59905391b9d2d"}
Sep 11 04:41:38.174642 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:38.174452    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-55cd4498b4-c6wv9" event={"ID":"8ddc8e86-ba33-4a96-80b5-c05cc07cd824","Type":"ContainerStarted","Data":"5f5d4a48963f9cce1e1d89f0e8d5a229e8f46ca18af8db139d2eeb844eb12175"}
Sep 11 04:41:38.176016 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:38.175969    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cbc665978-7l2zs" event={"ID":"7940c22b-9f83-42ea-aec0-472e99d275a3","Type":"ContainerStarted","Data":"4f36abb2bebc988050a60dbe2f2ced4f65e14ef5e381663cf1baf08efe61a01a"}
Sep 11 04:41:38.176159 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:38.176140    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cbc665978-7l2zs"
Sep 11 04:41:38.177741 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:38.177722    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cbc665978-7l2zs"
Sep 11 04:41:38.192855 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:38.192811    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-55cd4498b4-c6wv9" podStartSLOduration=34.192794709 podStartE2EDuration="34.192794709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:41:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:41:38.191906144 +0000 UTC m=+87.845165825" watchObservedRunningTime="2026-09-11 04:41:38.192794709 +0000 UTC m=+87.846054403"
Sep 11 04:41:38.206866 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:38.206803    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cbc665978-7l2zs" podStartSLOduration=1.487519459 podStartE2EDuration="5.206784567s" totalImagesPullingTime="3.719265108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:41:38.206676778 +0000 UTC m=+87.859936458" watchObservedRunningTime="2026-09-11 04:41:38.206784567 +0000 UTC m=+87.860044249"
Sep 11 04:41:38.429443 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:38.429321    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:38.431993 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:38.431972    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:39.179405 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:39.179369    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:39.180618 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:39.180594    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-55cd4498b4-c6wv9"
Sep 11 04:41:44.398741 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.398709    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h"]
Sep 11 04:41:44.404223 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.404202    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h"
Sep 11 04:41:44.406608 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.406576    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 11 04:41:44.406758 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.406588    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 11 04:41:44.407466 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.407448    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 04:41:44.407564 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.407501    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 04:41:44.407564 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.407453    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 04:41:44.407670 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.407595    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7bp25\""
Sep 11 04:41:44.410636 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.410615    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h"]
Sep 11 04:41:44.544875 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.544831    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rtcz\" (UniqueName: \"kubernetes.io/projected/d16c317f-48cb-443a-a681-600640b0f4d4-kube-api-access-2rtcz\") pod \"prometheus-operator-68bcd7f987-jhp2h\" (UID: \"d16c317f-48cb-443a-a681-600640b0f4d4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h"
Sep 11 04:41:44.545081 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.544896    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d16c317f-48cb-443a-a681-600640b0f4d4-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-jhp2h\" (UID: \"d16c317f-48cb-443a-a681-600640b0f4d4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h"
Sep 11 04:41:44.545081 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.544990    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d16c317f-48cb-443a-a681-600640b0f4d4-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-jhp2h\" (UID: \"d16c317f-48cb-443a-a681-600640b0f4d4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h"
Sep 11 04:41:44.545081 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.545062    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d16c317f-48cb-443a-a681-600640b0f4d4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-jhp2h\" (UID: \"d16c317f-48cb-443a-a681-600640b0f4d4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h"
Sep 11 04:41:44.645821 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.645782    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d16c317f-48cb-443a-a681-600640b0f4d4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-jhp2h\" (UID: \"d16c317f-48cb-443a-a681-600640b0f4d4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h"
Sep 11 04:41:44.645821 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.645829    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rtcz\" (UniqueName: \"kubernetes.io/projected/d16c317f-48cb-443a-a681-600640b0f4d4-kube-api-access-2rtcz\") pod \"prometheus-operator-68bcd7f987-jhp2h\" (UID: \"d16c317f-48cb-443a-a681-600640b0f4d4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h"
Sep 11 04:41:44.646082 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.645954    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d16c317f-48cb-443a-a681-600640b0f4d4-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-jhp2h\" (UID: \"d16c317f-48cb-443a-a681-600640b0f4d4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h"
Sep 11 04:41:44.646082 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.646022    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d16c317f-48cb-443a-a681-600640b0f4d4-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-jhp2h\" (UID: \"d16c317f-48cb-443a-a681-600640b0f4d4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h"
Sep 11 04:41:44.646636 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.646608    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d16c317f-48cb-443a-a681-600640b0f4d4-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-jhp2h\" (UID: \"d16c317f-48cb-443a-a681-600640b0f4d4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h"
Sep 11 04:41:44.648368 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.648347    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d16c317f-48cb-443a-a681-600640b0f4d4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-jhp2h\" (UID: \"d16c317f-48cb-443a-a681-600640b0f4d4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h"
Sep 11 04:41:44.648465 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.648448    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d16c317f-48cb-443a-a681-600640b0f4d4-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-jhp2h\" (UID: \"d16c317f-48cb-443a-a681-600640b0f4d4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h"
Sep 11 04:41:44.653916 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.653866    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rtcz\" (UniqueName: \"kubernetes.io/projected/d16c317f-48cb-443a-a681-600640b0f4d4-kube-api-access-2rtcz\") pod \"prometheus-operator-68bcd7f987-jhp2h\" (UID: \"d16c317f-48cb-443a-a681-600640b0f4d4\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h"
Sep 11 04:41:44.713718 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.713681    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h"
Sep 11 04:41:44.985588 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:44.985549    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h"]
Sep 11 04:41:44.986360 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:41:44.986315    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd16c317f_48cb_443a_a681_600640b0f4d4.slice/crio-6aba181cb6e71ea158d46aebda070881d6bdf8a174e47fd144182a3977a02961 WatchSource:0}: Error finding container 6aba181cb6e71ea158d46aebda070881d6bdf8a174e47fd144182a3977a02961: Status 404 returned error can't find the container with id 6aba181cb6e71ea158d46aebda070881d6bdf8a174e47fd144182a3977a02961
Sep 11 04:41:45.198247 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:45.198212    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h" event={"ID":"d16c317f-48cb-443a-a681-600640b0f4d4","Type":"ContainerStarted","Data":"6aba181cb6e71ea158d46aebda070881d6bdf8a174e47fd144182a3977a02961"}
Sep 11 04:41:47.208814 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:47.208775    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h" event={"ID":"d16c317f-48cb-443a-a681-600640b0f4d4","Type":"ContainerStarted","Data":"3f95e0f51a328b472c36c007b88fa8e64b5a23a18c2fd76e40c4da3257ab8ffa"}
Sep 11 04:41:47.209183 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:47.208838    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h" event={"ID":"d16c317f-48cb-443a-a681-600640b0f4d4","Type":"ContainerStarted","Data":"e68b0b2663728a17aaa0ea54134ccf88fa85f1207f4d9c31d77664dae90086f6"}
Sep 11 04:41:47.223967 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:47.223915    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-jhp2h" podStartSLOduration=1.925393384 podStartE2EDuration="3.223895744s" totalImagesPullingTime="1.29850236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:41:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:41:47.223067981 +0000 UTC m=+96.876327668" watchObservedRunningTime="2026-09-11 04:41:47.223895744 +0000 UTC m=+96.877155426"
Sep 11 04:41:48.753771 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.753723    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"]
Sep 11 04:41:48.757340 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.757307    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:48.759584 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.759561    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 11 04:41:48.760273 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.760257    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 11 04:41:48.760829 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.760813    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7692t\""
Sep 11 04:41:48.760829 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.760819    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 11 04:41:48.771172 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.771140    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9hjhv"]
Sep 11 04:41:48.774399 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.774383    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.776492 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.776465    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"]
Sep 11 04:41:48.784984 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.784963    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 04:41:48.785387 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.785363    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 04:41:48.785558 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.785539    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 04:41:48.786152 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.786135    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hr4hw\""
Sep 11 04:41:48.881414 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.881362    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83032487-731e-4348-aff3-97c6064398f6-node-exporter-tls\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.881414 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.881417    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/78245237-7e15-4ec3-8954-4d51dca681e3-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:48.881652 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.881453    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83032487-731e-4348-aff3-97c6064398f6-root\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.881652 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.881502    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83032487-731e-4348-aff3-97c6064398f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.881652 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.881564    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83032487-731e-4348-aff3-97c6064398f6-node-exporter-wtmp\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.881652 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.881599    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83032487-731e-4348-aff3-97c6064398f6-metrics-client-ca\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.881652 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.881620    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83032487-731e-4348-aff3-97c6064398f6-sys\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.881652 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.881637    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83032487-731e-4348-aff3-97c6064398f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.881905 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.881661    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83032487-731e-4348-aff3-97c6064398f6-node-exporter-textfile\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.881905 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.881748    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/78245237-7e15-4ec3-8954-4d51dca681e3-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:48.881905 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.881766    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfkq4\" (UniqueName: \"kubernetes.io/projected/83032487-731e-4348-aff3-97c6064398f6-kube-api-access-qfkq4\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.881905 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.881783    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/78245237-7e15-4ec3-8954-4d51dca681e3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:48.881905 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.881807    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78245237-7e15-4ec3-8954-4d51dca681e3-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:48.881905 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.881822    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5zs9\" (UniqueName: \"kubernetes.io/projected/78245237-7e15-4ec3-8954-4d51dca681e3-kube-api-access-z5zs9\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:48.881905 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.881841    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78245237-7e15-4ec3-8954-4d51dca681e3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:48.982416 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.982374    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83032487-731e-4348-aff3-97c6064398f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.982416 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.982422    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83032487-731e-4348-aff3-97c6064398f6-node-exporter-wtmp\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.982647 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.982437    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83032487-731e-4348-aff3-97c6064398f6-metrics-client-ca\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.982647 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.982457    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83032487-731e-4348-aff3-97c6064398f6-sys\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.982647 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.982483    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83032487-731e-4348-aff3-97c6064398f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.982647 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.982512    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83032487-731e-4348-aff3-97c6064398f6-node-exporter-textfile\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.982647 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.982538    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83032487-731e-4348-aff3-97c6064398f6-sys\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.982647 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.982567    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/78245237-7e15-4ec3-8954-4d51dca681e3-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:48.982647 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.982588    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83032487-731e-4348-aff3-97c6064398f6-node-exporter-wtmp\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.982647 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.982609    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfkq4\" (UniqueName: \"kubernetes.io/projected/83032487-731e-4348-aff3-97c6064398f6-kube-api-access-qfkq4\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.982647 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:48.982649    2554 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 11 04:41:48.982999 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:48.982707    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78245237-7e15-4ec3-8954-4d51dca681e3-kube-state-metrics-tls podName:78245237-7e15-4ec3-8954-4d51dca681e3 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:49.482689958 +0000 UTC m=+99.135949630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/78245237-7e15-4ec3-8954-4d51dca681e3-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-rpz4w" (UID: "78245237-7e15-4ec3-8954-4d51dca681e3") : secret "kube-state-metrics-tls" not found
Sep 11 04:41:48.982999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.982647    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/78245237-7e15-4ec3-8954-4d51dca681e3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:48.982999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.982856    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78245237-7e15-4ec3-8954-4d51dca681e3-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:48.982999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.982882    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5zs9\" (UniqueName: \"kubernetes.io/projected/78245237-7e15-4ec3-8954-4d51dca681e3-kube-api-access-z5zs9\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:48.982999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.982915    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78245237-7e15-4ec3-8954-4d51dca681e3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:48.982999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.982928    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83032487-731e-4348-aff3-97c6064398f6-node-exporter-textfile\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.982999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.982980    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83032487-731e-4348-aff3-97c6064398f6-node-exporter-tls\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.983377 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.983007    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/78245237-7e15-4ec3-8954-4d51dca681e3-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:48.983377 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.983047    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83032487-731e-4348-aff3-97c6064398f6-root\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.983377 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.983080    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83032487-731e-4348-aff3-97c6064398f6-node-exporter-accelerators-collector-config\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.983377 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.983143    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83032487-731e-4348-aff3-97c6064398f6-root\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.983593 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.983459    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/78245237-7e15-4ec3-8954-4d51dca681e3-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:48.983654 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.983626    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83032487-731e-4348-aff3-97c6064398f6-metrics-client-ca\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.983715 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.983650    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/78245237-7e15-4ec3-8954-4d51dca681e3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:48.983844 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.983821    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78245237-7e15-4ec3-8954-4d51dca681e3-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:48.985363 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.985316    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83032487-731e-4348-aff3-97c6064398f6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.986013 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.985994    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78245237-7e15-4ec3-8954-4d51dca681e3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:48.986108 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.986041    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83032487-731e-4348-aff3-97c6064398f6-node-exporter-tls\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.991058 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.991036    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfkq4\" (UniqueName: \"kubernetes.io/projected/83032487-731e-4348-aff3-97c6064398f6-kube-api-access-qfkq4\") pod \"node-exporter-9hjhv\" (UID: \"83032487-731e-4348-aff3-97c6064398f6\") " pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:48.991149 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:48.991064    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5zs9\" (UniqueName: \"kubernetes.io/projected/78245237-7e15-4ec3-8954-4d51dca681e3-kube-api-access-z5zs9\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:49.084368 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:49.084260    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9hjhv"
Sep 11 04:41:49.097811 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:41:49.097783    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83032487_731e_4348_aff3_97c6064398f6.slice/crio-444e3bab8f7e8760cca67793a0614b1ed461d5f4f172d7ae8cab01465b4c02dc WatchSource:0}: Error finding container 444e3bab8f7e8760cca67793a0614b1ed461d5f4f172d7ae8cab01465b4c02dc: Status 404 returned error can't find the container with id 444e3bab8f7e8760cca67793a0614b1ed461d5f4f172d7ae8cab01465b4c02dc
Sep 11 04:41:49.217198 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:49.217162    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9hjhv" event={"ID":"83032487-731e-4348-aff3-97c6064398f6","Type":"ContainerStarted","Data":"444e3bab8f7e8760cca67793a0614b1ed461d5f4f172d7ae8cab01465b4c02dc"}
Sep 11 04:41:49.488091 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:49.488052    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/78245237-7e15-4ec3-8954-4d51dca681e3-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:49.488303 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:49.488223    2554 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 11 04:41:49.488303 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:41:49.488291    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78245237-7e15-4ec3-8954-4d51dca681e3-kube-state-metrics-tls podName:78245237-7e15-4ec3-8954-4d51dca681e3 nodeName:}" failed. No retries permitted until 2026-09-11 04:41:50.488273304 +0000 UTC m=+100.141532968 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/78245237-7e15-4ec3-8954-4d51dca681e3-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-rpz4w" (UID: "78245237-7e15-4ec3-8954-4d51dca681e3") : secret "kube-state-metrics-tls" not found
Sep 11 04:41:49.588919 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:49.588877    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls\") pod \"dns-default-tgr28\" (UID: \"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca\") " pod="openshift-dns/dns-default-tgr28"
Sep 11 04:41:49.591634 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:49.591596    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca-metrics-tls\") pod \"dns-default-tgr28\" (UID: \"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca\") " pod="openshift-dns/dns-default-tgr28"
Sep 11 04:41:49.891235 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:49.891163    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v459k\""
Sep 11 04:41:49.900193 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:49.900158    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tgr28"
Sep 11 04:41:50.317422 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:50.317281    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tgr28"]
Sep 11 04:41:50.325418 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:41:50.325388    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ecb1e0_fa96_4cf1_8c0b_8ccd2e0d4aca.slice/crio-75028133b18ac060fa929ff6ddbbab8fa85755215597ce584e130fcb649fa51e WatchSource:0}: Error finding container 75028133b18ac060fa929ff6ddbbab8fa85755215597ce584e130fcb649fa51e: Status 404 returned error can't find the container with id 75028133b18ac060fa929ff6ddbbab8fa85755215597ce584e130fcb649fa51e
Sep 11 04:41:50.496102 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:50.496071    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/78245237-7e15-4ec3-8954-4d51dca681e3-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:50.498602 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:50.498576    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/78245237-7e15-4ec3-8954-4d51dca681e3-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-rpz4w\" (UID: \"78245237-7e15-4ec3-8954-4d51dca681e3\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:50.566349 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:50.566302    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"
Sep 11 04:41:50.847907 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:50.847876    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w"]
Sep 11 04:41:50.850961 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:41:50.850910    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78245237_7e15_4ec3_8954_4d51dca681e3.slice/crio-7000e96fb16cd73126a8f0090cdf19ebdfaa1437183a08f3f326996625f12bf3 WatchSource:0}: Error finding container 7000e96fb16cd73126a8f0090cdf19ebdfaa1437183a08f3f326996625f12bf3: Status 404 returned error can't find the container with id 7000e96fb16cd73126a8f0090cdf19ebdfaa1437183a08f3f326996625f12bf3
Sep 11 04:41:51.226499 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:51.226466    2554 generic.go:356] "Generic (PLEG): container finished" podID="83032487-731e-4348-aff3-97c6064398f6" containerID="908ddfe7c158fd5fe9b94cfcecb0d30816ab756b63bb10f4818f15b4b2bc4756" exitCode=0
Sep 11 04:41:51.226956 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:51.226562    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9hjhv" event={"ID":"83032487-731e-4348-aff3-97c6064398f6","Type":"ContainerDied","Data":"908ddfe7c158fd5fe9b94cfcecb0d30816ab756b63bb10f4818f15b4b2bc4756"}
Sep 11 04:41:51.228369 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:51.228313    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w" event={"ID":"78245237-7e15-4ec3-8954-4d51dca681e3","Type":"ContainerStarted","Data":"7000e96fb16cd73126a8f0090cdf19ebdfaa1437183a08f3f326996625f12bf3"}
Sep 11 04:41:51.229980 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:51.229952    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tgr28" event={"ID":"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca","Type":"ContainerStarted","Data":"75028133b18ac060fa929ff6ddbbab8fa85755215597ce584e130fcb649fa51e"}
Sep 11 04:41:52.241193 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:52.241159    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9hjhv" event={"ID":"83032487-731e-4348-aff3-97c6064398f6","Type":"ContainerStarted","Data":"81923c884de740c2b0b70d870c1391f7f5eee71884cec94351eedd150015020c"}
Sep 11 04:41:52.241671 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:52.241233    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9hjhv" event={"ID":"83032487-731e-4348-aff3-97c6064398f6","Type":"ContainerStarted","Data":"3f0e4c31b4cdae5bb6176f52e112e1f035e8e2bf592326361ef358cfdab23b5a"}
Sep 11 04:41:52.259556 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:52.259489    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9hjhv" podStartSLOduration=3.008661515 podStartE2EDuration="4.259468142s" totalImagesPullingTime="1.16368981s" totalInitContainerRuntime="87.116817ms" isStatefulPod=true podCreationTimestamp="2026-09-11 04:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:41:52.259363106 +0000 UTC m=+101.912622791" watchObservedRunningTime="2026-09-11 04:41:52.259468142 +0000 UTC m=+101.912727803"
Sep 11 04:41:53.247254 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:53.247216    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w" event={"ID":"78245237-7e15-4ec3-8954-4d51dca681e3","Type":"ContainerStarted","Data":"280632f817b195ae70642767736af7d1610a34d0139b6e1ee0236c0b13cf1735"}
Sep 11 04:41:53.247733 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:53.247282    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w" event={"ID":"78245237-7e15-4ec3-8954-4d51dca681e3","Type":"ContainerStarted","Data":"3f5b9ea307dc897d4be7c0af7f4bcdffa70b8d0d5fd2164586ecad6f6745365c"}
Sep 11 04:41:53.249284 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:53.249260    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tgr28" event={"ID":"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca","Type":"ContainerStarted","Data":"ec643b50e3f764b630570d2501f1c4efbf41a339d40c4004bf30470815aa10cc"}
Sep 11 04:41:53.249427 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:53.249306    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tgr28" event={"ID":"23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca","Type":"ContainerStarted","Data":"ce0235b0a4c64f66fd36080bf36d1df2b62a9b3f4acb17bdac98dedcf8a52ce4"}
Sep 11 04:41:53.267192 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:53.267093    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tgr28" podStartSLOduration=65.749066037 podStartE2EDuration="1m8.267074103s" totalImagesPullingTime="2.518008066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:40:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:41:53.266634798 +0000 UTC m=+102.919894474" watchObservedRunningTime="2026-09-11 04:41:53.267074103 +0000 UTC m=+102.920333784"
Sep 11 04:41:54.115933 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:54.115906    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tgt9r"
Sep 11 04:41:54.255209 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:54.255121    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w" event={"ID":"78245237-7e15-4ec3-8954-4d51dca681e3","Type":"ContainerStarted","Data":"aca9f2294114f76d2ae3df47d4500f8b8c61f9d32a9f086719baea90f9548220"}
Sep 11 04:41:54.255683 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:54.255516    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tgr28"
Sep 11 04:41:54.278537 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:54.278477    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-rpz4w" podStartSLOduration=4.283653755 podStartE2EDuration="6.278460984s" totalImagesPullingTime="1.994807229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:41:54.277520376 +0000 UTC m=+103.930780085" watchObservedRunningTime="2026-09-11 04:41:54.278460984 +0000 UTC m=+103.931720711"
Sep 11 04:41:55.167015 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:41:55.166978    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-576d49cb45-z98tv"
Sep 11 04:42:02.759714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:02.759676    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-hwpst"]
Sep 11 04:42:02.762862 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:02.762841    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-hwpst"
Sep 11 04:42:02.765058 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:02.765031    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 04:42:02.765232 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:02.765215    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-pxqxp\""
Sep 11 04:42:02.765284 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:02.765230    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 04:42:02.771461 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:02.771439    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-hwpst"]
Sep 11 04:42:02.898391 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:02.898320    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bbxb\" (UniqueName: \"kubernetes.io/projected/eeec2d7a-a6bd-4972-932d-6f4c218bace2-kube-api-access-4bbxb\") pod \"downloads-76f99584f4-hwpst\" (UID: \"eeec2d7a-a6bd-4972-932d-6f4c218bace2\") " pod="openshift-console/downloads-76f99584f4-hwpst"
Sep 11 04:42:02.999796 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:02.999757    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bbxb\" (UniqueName: \"kubernetes.io/projected/eeec2d7a-a6bd-4972-932d-6f4c218bace2-kube-api-access-4bbxb\") pod \"downloads-76f99584f4-hwpst\" (UID: \"eeec2d7a-a6bd-4972-932d-6f4c218bace2\") " pod="openshift-console/downloads-76f99584f4-hwpst"
Sep 11 04:42:03.008042 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:03.008014    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bbxb\" (UniqueName: \"kubernetes.io/projected/eeec2d7a-a6bd-4972-932d-6f4c218bace2-kube-api-access-4bbxb\") pod \"downloads-76f99584f4-hwpst\" (UID: \"eeec2d7a-a6bd-4972-932d-6f4c218bace2\") " pod="openshift-console/downloads-76f99584f4-hwpst"
Sep 11 04:42:03.072565 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:03.072477    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-hwpst"
Sep 11 04:42:03.341854 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:03.341830    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-hwpst"]
Sep 11 04:42:03.344242 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:42:03.344212    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeec2d7a_a6bd_4972_932d_6f4c218bace2.slice/crio-2aae604ab9ec200e0d8e87141e9f16169668151af8648074bf8fddf61253b918 WatchSource:0}: Error finding container 2aae604ab9ec200e0d8e87141e9f16169668151af8648074bf8fddf61253b918: Status 404 returned error can't find the container with id 2aae604ab9ec200e0d8e87141e9f16169668151af8648074bf8fddf61253b918
Sep 11 04:42:04.261425 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:04.261388    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tgr28"
Sep 11 04:42:04.297449 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:04.297410    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-hwpst" event={"ID":"eeec2d7a-a6bd-4972-932d-6f4c218bace2","Type":"ContainerStarted","Data":"2aae604ab9ec200e0d8e87141e9f16169668151af8648074bf8fddf61253b918"}
Sep 11 04:42:08.491304 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.491267    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-675b78bc47-kgv48"]
Sep 11 04:42:08.495009 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.494987    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:08.498166 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.498097    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 04:42:08.498166 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.498128    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 04:42:08.498403 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.498178    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 04:42:08.498403 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.498128    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 04:42:08.498519 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.498484    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5f9r2\""
Sep 11 04:42:08.498519 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.498501    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 04:42:08.507055 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.507031    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-675b78bc47-kgv48"]
Sep 11 04:42:08.544898 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.544866    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e928611d-a93f-46d9-aee9-ec5b878da949-console-oauth-config\") pod \"console-675b78bc47-kgv48\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") " pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:08.545087 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.544911    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e928611d-a93f-46d9-aee9-ec5b878da949-service-ca\") pod \"console-675b78bc47-kgv48\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") " pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:08.545087 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.544961    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e928611d-a93f-46d9-aee9-ec5b878da949-console-config\") pod \"console-675b78bc47-kgv48\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") " pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:08.545087 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.545007    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e928611d-a93f-46d9-aee9-ec5b878da949-oauth-serving-cert\") pod \"console-675b78bc47-kgv48\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") " pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:08.545087 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.545053    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz8n8\" (UniqueName: \"kubernetes.io/projected/e928611d-a93f-46d9-aee9-ec5b878da949-kube-api-access-sz8n8\") pod \"console-675b78bc47-kgv48\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") " pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:08.545263 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.545097    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e928611d-a93f-46d9-aee9-ec5b878da949-console-serving-cert\") pod \"console-675b78bc47-kgv48\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") " pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:08.646390 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.646352    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e928611d-a93f-46d9-aee9-ec5b878da949-console-serving-cert\") pod \"console-675b78bc47-kgv48\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") " pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:08.646569 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.646435    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e928611d-a93f-46d9-aee9-ec5b878da949-console-oauth-config\") pod \"console-675b78bc47-kgv48\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") " pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:08.646569 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.646464    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e928611d-a93f-46d9-aee9-ec5b878da949-service-ca\") pod \"console-675b78bc47-kgv48\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") " pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:08.646569 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.646514    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e928611d-a93f-46d9-aee9-ec5b878da949-console-config\") pod \"console-675b78bc47-kgv48\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") " pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:08.646569 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.646540    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e928611d-a93f-46d9-aee9-ec5b878da949-oauth-serving-cert\") pod \"console-675b78bc47-kgv48\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") " pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:08.646569 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.646566    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz8n8\" (UniqueName: \"kubernetes.io/projected/e928611d-a93f-46d9-aee9-ec5b878da949-kube-api-access-sz8n8\") pod \"console-675b78bc47-kgv48\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") " pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:08.647619 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.647573    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e928611d-a93f-46d9-aee9-ec5b878da949-console-config\") pod \"console-675b78bc47-kgv48\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") " pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:08.647619 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.647573    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e928611d-a93f-46d9-aee9-ec5b878da949-oauth-serving-cert\") pod \"console-675b78bc47-kgv48\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") " pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:08.647817 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.647790    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e928611d-a93f-46d9-aee9-ec5b878da949-service-ca\") pod \"console-675b78bc47-kgv48\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") " pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:08.649396 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.649372    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e928611d-a93f-46d9-aee9-ec5b878da949-console-serving-cert\") pod \"console-675b78bc47-kgv48\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") " pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:08.650004 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.649979    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e928611d-a93f-46d9-aee9-ec5b878da949-console-oauth-config\") pod \"console-675b78bc47-kgv48\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") " pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:08.654641 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.654619    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz8n8\" (UniqueName: \"kubernetes.io/projected/e928611d-a93f-46d9-aee9-ec5b878da949-kube-api-access-sz8n8\") pod \"console-675b78bc47-kgv48\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") " pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:08.807505 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:08.807414    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:09.087536 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:09.087455    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-675b78bc47-kgv48"]
Sep 11 04:42:09.090648 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:42:09.090619    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode928611d_a93f_46d9_aee9_ec5b878da949.slice/crio-0c409e6a5ca732f776938d3e978904fbebece477d67b1e3ddcd978f288819b36 WatchSource:0}: Error finding container 0c409e6a5ca732f776938d3e978904fbebece477d67b1e3ddcd978f288819b36: Status 404 returned error can't find the container with id 0c409e6a5ca732f776938d3e978904fbebece477d67b1e3ddcd978f288819b36
Sep 11 04:42:09.319711 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:09.319675    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675b78bc47-kgv48" event={"ID":"e928611d-a93f-46d9-aee9-ec5b878da949","Type":"ContainerStarted","Data":"0c409e6a5ca732f776938d3e978904fbebece477d67b1e3ddcd978f288819b36"}
Sep 11 04:42:13.339164 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:13.339114    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675b78bc47-kgv48" event={"ID":"e928611d-a93f-46d9-aee9-ec5b878da949","Type":"ContainerStarted","Data":"afa65dcca7e4b2271024bbe61071b68512f2564d004f36ba896725d500bdd8b0"}
Sep 11 04:42:13.357261 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:13.357190    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-675b78bc47-kgv48" podStartSLOduration=2.008142719 podStartE2EDuration="5.357166244s" totalImagesPullingTime="3.349023525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:42:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:42:13.357098183 +0000 UTC m=+123.010357863" watchObservedRunningTime="2026-09-11 04:42:13.357166244 +0000 UTC m=+123.010425924"
Sep 11 04:42:15.108988 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:15.108933    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55cd4498b4-c6wv9_8ddc8e86-ba33-4a96-80b5-c05cc07cd824/router/0.log"
Sep 11 04:42:15.124223 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:15.124200    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rn87x_292a0e4d-f68d-4043-9b6c-9467330e9aa6/serve-healthcheck-canary/0.log"
Sep 11 04:42:18.813249 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:18.813215    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:18.813735 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:18.813283    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:18.813735 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:18.813581    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:19.366993 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:19.366960    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:20.551798 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:20.551764    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs\") pod \"network-metrics-daemon-2r4m7\" (UID: \"8aaff5eb-511c-4772-84b1-d51c257ef1c8\") " pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:42:20.553967 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:20.553943    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8aaff5eb-511c-4772-84b1-d51c257ef1c8-metrics-certs\") pod \"network-metrics-daemon-2r4m7\" (UID: \"8aaff5eb-511c-4772-84b1-d51c257ef1c8\") " pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:42:20.725128 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:20.725098    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rs4qk\""
Sep 11 04:42:20.734090 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:20.733965    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2r4m7"
Sep 11 04:42:21.013933 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:21.013853    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2r4m7"]
Sep 11 04:42:21.018080 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:42:21.018048    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aaff5eb_511c_4772_84b1_d51c257ef1c8.slice/crio-bd4ec630cdac0c2b1dc859e2c88d6dfd03e0cf2b7c6ea7318ee32458722e41dd WatchSource:0}: Error finding container bd4ec630cdac0c2b1dc859e2c88d6dfd03e0cf2b7c6ea7318ee32458722e41dd: Status 404 returned error can't find the container with id bd4ec630cdac0c2b1dc859e2c88d6dfd03e0cf2b7c6ea7318ee32458722e41dd
Sep 11 04:42:21.372776 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:21.372676    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-hwpst" event={"ID":"eeec2d7a-a6bd-4972-932d-6f4c218bace2","Type":"ContainerStarted","Data":"5a75d01c9008c9baf9745eab5b07865d57ec3b2b17adf5e5abb9897f3c360710"}
Sep 11 04:42:21.373013 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:21.372994    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-hwpst"
Sep 11 04:42:21.374322 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:21.374287    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2r4m7" event={"ID":"8aaff5eb-511c-4772-84b1-d51c257ef1c8","Type":"ContainerStarted","Data":"bd4ec630cdac0c2b1dc859e2c88d6dfd03e0cf2b7c6ea7318ee32458722e41dd"}
Sep 11 04:42:21.391632 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:21.391578    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-hwpst" podStartSLOduration=2.256447846 podStartE2EDuration="19.391562179s" totalImagesPullingTime="17.135114333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:42:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:42:21.389202516 +0000 UTC m=+131.042462197" watchObservedRunningTime="2026-09-11 04:42:21.391562179 +0000 UTC m=+131.044821858"
Sep 11 04:42:21.394901 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:21.394876    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-hwpst"
Sep 11 04:42:22.381765 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:22.381721    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2r4m7" event={"ID":"8aaff5eb-511c-4772-84b1-d51c257ef1c8","Type":"ContainerStarted","Data":"c4cb655074b32fe755d8619171c916950c2b24c14fd170a4c609ad9c7c8d0bd1"}
Sep 11 04:42:22.382200 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:22.381798    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2r4m7" event={"ID":"8aaff5eb-511c-4772-84b1-d51c257ef1c8","Type":"ContainerStarted","Data":"91483baa79d07c0cbe2e5213b6ed21d75f11bc7230321ed3e068bbd72a4d455c"}
Sep 11 04:42:23.400732 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:23.400666    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2r4m7" podStartSLOduration=132.356820019 podStartE2EDuration="2m13.40064291s" totalImagesPullingTime="1.043822891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:42:23.400037429 +0000 UTC m=+133.053297111" watchObservedRunningTime="2026-09-11 04:42:23.40064291 +0000 UTC m=+133.053902591"
Sep 11 04:42:27.964255 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:27.964217    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-675b78bc47-kgv48"]
Sep 11 04:42:28.416781 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:28.416750    2554 generic.go:356] "Generic (PLEG): container finished" podID="278f1e65-4970-4a6c-b085-e6792ba5065d" containerID="40a6533fb8e9a20151dcc5c46a4bb08a6ca7fb78b8a9ff5565827deb7b2db449" exitCode=0
Sep 11 04:42:28.416954 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:28.416829    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vxkzj" event={"ID":"278f1e65-4970-4a6c-b085-e6792ba5065d","Type":"ContainerDied","Data":"40a6533fb8e9a20151dcc5c46a4bb08a6ca7fb78b8a9ff5565827deb7b2db449"}
Sep 11 04:42:28.417267 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:28.417247    2554 scope.go:117] "RemoveContainer" containerID="40a6533fb8e9a20151dcc5c46a4bb08a6ca7fb78b8a9ff5565827deb7b2db449"
Sep 11 04:42:29.422881 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:29.422847    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-vxkzj" event={"ID":"278f1e65-4970-4a6c-b085-e6792ba5065d","Type":"ContainerStarted","Data":"dc550f2e4a087e3329404dce121ba0052bacd7dae9067f440bf158dbd4022ea8"}
Sep 11 04:42:52.994062 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:52.994003    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-675b78bc47-kgv48" podUID="e928611d-a93f-46d9-aee9-ec5b878da949" containerName="console" containerID="cri-o://afa65dcca7e4b2271024bbe61071b68512f2564d004f36ba896725d500bdd8b0" gracePeriod=15
Sep 11 04:42:53.272105 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.272029    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:53.430973 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.430933    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e928611d-a93f-46d9-aee9-ec5b878da949-console-serving-cert\") pod \"e928611d-a93f-46d9-aee9-ec5b878da949\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") "
Sep 11 04:42:53.430973 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.430981    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e928611d-a93f-46d9-aee9-ec5b878da949-console-config\") pod \"e928611d-a93f-46d9-aee9-ec5b878da949\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") "
Sep 11 04:42:53.431231 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.431035    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e928611d-a93f-46d9-aee9-ec5b878da949-oauth-serving-cert\") pod \"e928611d-a93f-46d9-aee9-ec5b878da949\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") "
Sep 11 04:42:53.431231 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.431060    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sz8n8\" (UniqueName: \"kubernetes.io/projected/e928611d-a93f-46d9-aee9-ec5b878da949-kube-api-access-sz8n8\") pod \"e928611d-a93f-46d9-aee9-ec5b878da949\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") "
Sep 11 04:42:53.431231 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.431093    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e928611d-a93f-46d9-aee9-ec5b878da949-console-oauth-config\") pod \"e928611d-a93f-46d9-aee9-ec5b878da949\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") "
Sep 11 04:42:53.431231 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.431121    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e928611d-a93f-46d9-aee9-ec5b878da949-service-ca\") pod \"e928611d-a93f-46d9-aee9-ec5b878da949\" (UID: \"e928611d-a93f-46d9-aee9-ec5b878da949\") "
Sep 11 04:42:53.431559 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.431516    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e928611d-a93f-46d9-aee9-ec5b878da949-console-config" (OuterVolumeSpecName: "console-config") pod "e928611d-a93f-46d9-aee9-ec5b878da949" (UID: "e928611d-a93f-46d9-aee9-ec5b878da949"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:42:53.431674 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.431533    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e928611d-a93f-46d9-aee9-ec5b878da949-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e928611d-a93f-46d9-aee9-ec5b878da949" (UID: "e928611d-a93f-46d9-aee9-ec5b878da949"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:42:53.431674 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.431583    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e928611d-a93f-46d9-aee9-ec5b878da949-service-ca" (OuterVolumeSpecName: "service-ca") pod "e928611d-a93f-46d9-aee9-ec5b878da949" (UID: "e928611d-a93f-46d9-aee9-ec5b878da949"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:42:53.433593 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.433561    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e928611d-a93f-46d9-aee9-ec5b878da949-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e928611d-a93f-46d9-aee9-ec5b878da949" (UID: "e928611d-a93f-46d9-aee9-ec5b878da949"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:42:53.433685 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.433660    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e928611d-a93f-46d9-aee9-ec5b878da949-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e928611d-a93f-46d9-aee9-ec5b878da949" (UID: "e928611d-a93f-46d9-aee9-ec5b878da949"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:42:53.433685 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.433672    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e928611d-a93f-46d9-aee9-ec5b878da949-kube-api-access-sz8n8" (OuterVolumeSpecName: "kube-api-access-sz8n8") pod "e928611d-a93f-46d9-aee9-ec5b878da949" (UID: "e928611d-a93f-46d9-aee9-ec5b878da949"). InnerVolumeSpecName "kube-api-access-sz8n8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:42:53.515261 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.515223    2554 generic.go:356] "Generic (PLEG): container finished" podID="e928611d-a93f-46d9-aee9-ec5b878da949" containerID="afa65dcca7e4b2271024bbe61071b68512f2564d004f36ba896725d500bdd8b0" exitCode=0
Sep 11 04:42:53.515446 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.515269    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675b78bc47-kgv48"
Sep 11 04:42:53.515446 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.515302    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675b78bc47-kgv48" event={"ID":"e928611d-a93f-46d9-aee9-ec5b878da949","Type":"ContainerDied","Data":"afa65dcca7e4b2271024bbe61071b68512f2564d004f36ba896725d500bdd8b0"}
Sep 11 04:42:53.515446 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.515375    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675b78bc47-kgv48" event={"ID":"e928611d-a93f-46d9-aee9-ec5b878da949","Type":"ContainerDied","Data":"0c409e6a5ca732f776938d3e978904fbebece477d67b1e3ddcd978f288819b36"}
Sep 11 04:42:53.515446 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.515418    2554 scope.go:117] "RemoveContainer" containerID="afa65dcca7e4b2271024bbe61071b68512f2564d004f36ba896725d500bdd8b0"
Sep 11 04:42:53.524474 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.524456    2554 scope.go:117] "RemoveContainer" containerID="afa65dcca7e4b2271024bbe61071b68512f2564d004f36ba896725d500bdd8b0"
Sep 11 04:42:53.524779 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:42:53.524751    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afa65dcca7e4b2271024bbe61071b68512f2564d004f36ba896725d500bdd8b0\": container with ID starting with afa65dcca7e4b2271024bbe61071b68512f2564d004f36ba896725d500bdd8b0 not found: ID does not exist" containerID="afa65dcca7e4b2271024bbe61071b68512f2564d004f36ba896725d500bdd8b0"
Sep 11 04:42:53.524825 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.524790    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afa65dcca7e4b2271024bbe61071b68512f2564d004f36ba896725d500bdd8b0"} err="failed to get container status \"afa65dcca7e4b2271024bbe61071b68512f2564d004f36ba896725d500bdd8b0\": rpc error: code = NotFound desc = could not find container \"afa65dcca7e4b2271024bbe61071b68512f2564d004f36ba896725d500bdd8b0\": container with ID starting with afa65dcca7e4b2271024bbe61071b68512f2564d004f36ba896725d500bdd8b0 not found: ID does not exist"
Sep 11 04:42:53.532564 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.532543    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e928611d-a93f-46d9-aee9-ec5b878da949-console-serving-cert\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:42:53.532564 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.532563    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e928611d-a93f-46d9-aee9-ec5b878da949-console-config\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:42:53.532687 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.532572    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e928611d-a93f-46d9-aee9-ec5b878da949-oauth-serving-cert\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:42:53.532687 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.532581    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sz8n8\" (UniqueName: \"kubernetes.io/projected/e928611d-a93f-46d9-aee9-ec5b878da949-kube-api-access-sz8n8\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:42:53.532687 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.532589    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e928611d-a93f-46d9-aee9-ec5b878da949-console-oauth-config\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:42:53.532687 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.532597    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e928611d-a93f-46d9-aee9-ec5b878da949-service-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:42:53.535836 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.535815    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-675b78bc47-kgv48"]
Sep 11 04:42:53.538893 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:53.538873    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-675b78bc47-kgv48"]
Sep 11 04:42:54.811498 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:42:54.811465    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e928611d-a93f-46d9-aee9-ec5b878da949" path="/var/lib/kubelet/pods/e928611d-a93f-46d9-aee9-ec5b878da949/volumes"
Sep 11 04:44:50.015724 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:50.015687    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gt7mr"]
Sep 11 04:44:50.016196 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:50.016061    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e928611d-a93f-46d9-aee9-ec5b878da949" containerName="console"
Sep 11 04:44:50.016196 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:50.016076    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e928611d-a93f-46d9-aee9-ec5b878da949" containerName="console"
Sep 11 04:44:50.016196 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:50.016130    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e928611d-a93f-46d9-aee9-ec5b878da949" containerName="console"
Sep 11 04:44:50.022319 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:50.022294    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gt7mr"
Sep 11 04:44:50.025176 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:50.025135    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 04:44:50.025531 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:50.025507    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 04:44:50.025827 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:50.025592    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-j4j7v\""
Sep 11 04:44:50.034848 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:50.034815    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gt7mr"]
Sep 11 04:44:50.107933 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:50.107896    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpmfz\" (UniqueName: \"kubernetes.io/projected/bf527ec8-f743-4e24-9820-07d15a017c97-kube-api-access-tpmfz\") pod \"cert-manager-operator-controller-manager-55c444bf86-gt7mr\" (UID: \"bf527ec8-f743-4e24-9820-07d15a017c97\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gt7mr"
Sep 11 04:44:50.108103 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:50.107949    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf527ec8-f743-4e24-9820-07d15a017c97-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gt7mr\" (UID: \"bf527ec8-f743-4e24-9820-07d15a017c97\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gt7mr"
Sep 11 04:44:50.209286 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:50.209241    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpmfz\" (UniqueName: \"kubernetes.io/projected/bf527ec8-f743-4e24-9820-07d15a017c97-kube-api-access-tpmfz\") pod \"cert-manager-operator-controller-manager-55c444bf86-gt7mr\" (UID: \"bf527ec8-f743-4e24-9820-07d15a017c97\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gt7mr"
Sep 11 04:44:50.209481 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:50.209296    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf527ec8-f743-4e24-9820-07d15a017c97-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gt7mr\" (UID: \"bf527ec8-f743-4e24-9820-07d15a017c97\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gt7mr"
Sep 11 04:44:50.209660 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:50.209643    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf527ec8-f743-4e24-9820-07d15a017c97-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gt7mr\" (UID: \"bf527ec8-f743-4e24-9820-07d15a017c97\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gt7mr"
Sep 11 04:44:50.217955 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:50.217929    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpmfz\" (UniqueName: \"kubernetes.io/projected/bf527ec8-f743-4e24-9820-07d15a017c97-kube-api-access-tpmfz\") pod \"cert-manager-operator-controller-manager-55c444bf86-gt7mr\" (UID: \"bf527ec8-f743-4e24-9820-07d15a017c97\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gt7mr"
Sep 11 04:44:50.335879 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:50.335792    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gt7mr"
Sep 11 04:44:50.614372 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:50.614276    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gt7mr"]
Sep 11 04:44:50.617619 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:44:50.617591    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf527ec8_f743_4e24_9820_07d15a017c97.slice/crio-f53b68072b927bbd88450b473a50302de0d99bb11722eff9ee7b83fc64319c9b WatchSource:0}: Error finding container f53b68072b927bbd88450b473a50302de0d99bb11722eff9ee7b83fc64319c9b: Status 404 returned error can't find the container with id f53b68072b927bbd88450b473a50302de0d99bb11722eff9ee7b83fc64319c9b
Sep 11 04:44:50.945235 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:50.945203    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gt7mr" event={"ID":"bf527ec8-f743-4e24-9820-07d15a017c97","Type":"ContainerStarted","Data":"f53b68072b927bbd88450b473a50302de0d99bb11722eff9ee7b83fc64319c9b"}
Sep 11 04:44:53.961264 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:53.961219    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gt7mr" event={"ID":"bf527ec8-f743-4e24-9820-07d15a017c97","Type":"ContainerStarted","Data":"05a89872b5e9404361e4b23406d2d48af059b956d068426797bb3f56054a107d"}
Sep 11 04:44:53.984210 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:53.984145    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gt7mr" podStartSLOduration=2.448419539 podStartE2EDuration="4.984121225s" totalImagesPullingTime="2.535701686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:44:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:44:53.982451029 +0000 UTC m=+283.635710710" watchObservedRunningTime="2026-09-11 04:44:53.984121225 +0000 UTC m=+283.637380906"
Sep 11 04:44:54.150470 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:54.150430    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7bx57"]
Sep 11 04:44:54.152773 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:54.152758    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7bx57"
Sep 11 04:44:54.155100 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:54.155074    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 04:44:54.155281 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:54.155264    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-kq725\""
Sep 11 04:44:54.155343 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:54.155311    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 04:44:54.162893 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:54.162868    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7bx57"]
Sep 11 04:44:54.244008 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:54.243923    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ed26e21-045d-40cd-9525-e59deb8265ae-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7bx57\" (UID: \"5ed26e21-045d-40cd-9525-e59deb8265ae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7bx57"
Sep 11 04:44:54.244008 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:54.243962    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkt4f\" (UniqueName: \"kubernetes.io/projected/5ed26e21-045d-40cd-9525-e59deb8265ae-kube-api-access-qkt4f\") pod \"cert-manager-webhook-6486ffd997-7bx57\" (UID: \"5ed26e21-045d-40cd-9525-e59deb8265ae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7bx57"
Sep 11 04:44:54.344973 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:54.344930    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ed26e21-045d-40cd-9525-e59deb8265ae-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7bx57\" (UID: \"5ed26e21-045d-40cd-9525-e59deb8265ae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7bx57"
Sep 11 04:44:54.345175 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:54.344988    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkt4f\" (UniqueName: \"kubernetes.io/projected/5ed26e21-045d-40cd-9525-e59deb8265ae-kube-api-access-qkt4f\") pod \"cert-manager-webhook-6486ffd997-7bx57\" (UID: \"5ed26e21-045d-40cd-9525-e59deb8265ae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7bx57"
Sep 11 04:44:54.362706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:54.362677    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ed26e21-045d-40cd-9525-e59deb8265ae-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-7bx57\" (UID: \"5ed26e21-045d-40cd-9525-e59deb8265ae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7bx57"
Sep 11 04:44:54.362956 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:54.362937    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkt4f\" (UniqueName: \"kubernetes.io/projected/5ed26e21-045d-40cd-9525-e59deb8265ae-kube-api-access-qkt4f\") pod \"cert-manager-webhook-6486ffd997-7bx57\" (UID: \"5ed26e21-045d-40cd-9525-e59deb8265ae\") " pod="cert-manager/cert-manager-webhook-6486ffd997-7bx57"
Sep 11 04:44:54.476599 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:54.476565    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-7bx57"
Sep 11 04:44:54.757080 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:54.757048    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-7bx57"]
Sep 11 04:44:54.759967 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:44:54.759940    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ed26e21_045d_40cd_9525_e59deb8265ae.slice/crio-440146aedca83a98ccce664ede965842b90b7e51309cb970a711fcb03829c9a0 WatchSource:0}: Error finding container 440146aedca83a98ccce664ede965842b90b7e51309cb970a711fcb03829c9a0: Status 404 returned error can't find the container with id 440146aedca83a98ccce664ede965842b90b7e51309cb970a711fcb03829c9a0
Sep 11 04:44:54.966453 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:54.966416    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7bx57" event={"ID":"5ed26e21-045d-40cd-9525-e59deb8265ae","Type":"ContainerStarted","Data":"440146aedca83a98ccce664ede965842b90b7e51309cb970a711fcb03829c9a0"}
Sep 11 04:44:57.984264 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:57.984231    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-7bx57" event={"ID":"5ed26e21-045d-40cd-9525-e59deb8265ae","Type":"ContainerStarted","Data":"5642c153f59e48cb2c7f29d6d9ebb9d0cfbffff938aa0a05f0089cb21ee582dd"}
Sep 11 04:44:57.984814 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:57.984350    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7bx57"
Sep 11 04:44:57.999803 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:44:57.999755    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-7bx57" podStartSLOduration=1.293699988 podStartE2EDuration="3.9997395s" totalImagesPullingTime="2.706039512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:44:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:44:57.999305556 +0000 UTC m=+287.652565235" watchObservedRunningTime="2026-09-11 04:44:57.9997395 +0000 UTC m=+287.652999179"
Sep 11 04:45:03.990444 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:03.990416    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-7bx57"
Sep 11 04:45:10.725857 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:10.725827    2554 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 04:45:26.648639 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.648602    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"]
Sep 11 04:45:26.652784 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.652693    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"
Sep 11 04:45:26.655017 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.654987    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 04:45:26.655145 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.655080    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 04:45:26.655285 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.655264    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4g22g\""
Sep 11 04:45:26.655369 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.655281    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 04:45:26.655369 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.655270    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 04:45:26.665010 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.664986    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"]
Sep 11 04:45:26.810606 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.810574    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/89fc663f-2cbc-427a-9fd0-1cc0d52eef3f-manifests\") pod \"opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh\" (UID: \"89fc663f-2cbc-427a-9fd0-1cc0d52eef3f\") " pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"
Sep 11 04:45:26.810606 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.810610    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89fc663f-2cbc-427a-9fd0-1cc0d52eef3f-tmp\") pod \"opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh\" (UID: \"89fc663f-2cbc-427a-9fd0-1cc0d52eef3f\") " pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"
Sep 11 04:45:26.810802 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.810639    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99vmx\" (UniqueName: \"kubernetes.io/projected/89fc663f-2cbc-427a-9fd0-1cc0d52eef3f-kube-api-access-99vmx\") pod \"opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh\" (UID: \"89fc663f-2cbc-427a-9fd0-1cc0d52eef3f\") " pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"
Sep 11 04:45:26.810802 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.810692    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89fc663f-2cbc-427a-9fd0-1cc0d52eef3f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh\" (UID: \"89fc663f-2cbc-427a-9fd0-1cc0d52eef3f\") " pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"
Sep 11 04:45:26.810802 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.810709    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/89fc663f-2cbc-427a-9fd0-1cc0d52eef3f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh\" (UID: \"89fc663f-2cbc-427a-9fd0-1cc0d52eef3f\") " pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"
Sep 11 04:45:26.911537 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.911506    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89fc663f-2cbc-427a-9fd0-1cc0d52eef3f-tmp\") pod \"opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh\" (UID: \"89fc663f-2cbc-427a-9fd0-1cc0d52eef3f\") " pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"
Sep 11 04:45:26.911693 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.911552    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99vmx\" (UniqueName: \"kubernetes.io/projected/89fc663f-2cbc-427a-9fd0-1cc0d52eef3f-kube-api-access-99vmx\") pod \"opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh\" (UID: \"89fc663f-2cbc-427a-9fd0-1cc0d52eef3f\") " pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"
Sep 11 04:45:26.911693 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.911596    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89fc663f-2cbc-427a-9fd0-1cc0d52eef3f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh\" (UID: \"89fc663f-2cbc-427a-9fd0-1cc0d52eef3f\") " pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"
Sep 11 04:45:26.911786 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.911714    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/89fc663f-2cbc-427a-9fd0-1cc0d52eef3f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh\" (UID: \"89fc663f-2cbc-427a-9fd0-1cc0d52eef3f\") " pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"
Sep 11 04:45:26.911841 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.911806    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/89fc663f-2cbc-427a-9fd0-1cc0d52eef3f-manifests\") pod \"opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh\" (UID: \"89fc663f-2cbc-427a-9fd0-1cc0d52eef3f\") " pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"
Sep 11 04:45:26.912187 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.912160    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/89fc663f-2cbc-427a-9fd0-1cc0d52eef3f-manifests\") pod \"opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh\" (UID: \"89fc663f-2cbc-427a-9fd0-1cc0d52eef3f\") " pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"
Sep 11 04:45:26.913995 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.913968    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89fc663f-2cbc-427a-9fd0-1cc0d52eef3f-tmp\") pod \"opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh\" (UID: \"89fc663f-2cbc-427a-9fd0-1cc0d52eef3f\") " pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"
Sep 11 04:45:26.914232 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.914216    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/89fc663f-2cbc-427a-9fd0-1cc0d52eef3f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh\" (UID: \"89fc663f-2cbc-427a-9fd0-1cc0d52eef3f\") " pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"
Sep 11 04:45:26.914388 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.914368    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/89fc663f-2cbc-427a-9fd0-1cc0d52eef3f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh\" (UID: \"89fc663f-2cbc-427a-9fd0-1cc0d52eef3f\") " pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"
Sep 11 04:45:26.919430 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.919407    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99vmx\" (UniqueName: \"kubernetes.io/projected/89fc663f-2cbc-427a-9fd0-1cc0d52eef3f-kube-api-access-99vmx\") pod \"opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh\" (UID: \"89fc663f-2cbc-427a-9fd0-1cc0d52eef3f\") " pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"
Sep 11 04:45:26.963016 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:26.962976    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"
Sep 11 04:45:27.239399 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:27.239377    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"]
Sep 11 04:45:27.247809 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:27.247771    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 04:45:28.108843 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:28.108810    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh" event={"ID":"89fc663f-2cbc-427a-9fd0-1cc0d52eef3f","Type":"ContainerStarted","Data":"bc5bce66e6473ef207374cd052f7343eebfc9d7f8d6710efb4a3f65400ad344a"}
Sep 11 04:45:31.125730 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:31.125691    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh" event={"ID":"89fc663f-2cbc-427a-9fd0-1cc0d52eef3f","Type":"ContainerStarted","Data":"d9d001b2f40ffe83e9f1620bb9a05214f2af12d96cfec578f85b8d22ccfee554"}
Sep 11 04:45:32.131265 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:32.131230    2554 generic.go:356] "Generic (PLEG): container finished" podID="89fc663f-2cbc-427a-9fd0-1cc0d52eef3f" containerID="d9d001b2f40ffe83e9f1620bb9a05214f2af12d96cfec578f85b8d22ccfee554" exitCode=0
Sep 11 04:45:32.131733 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:32.131351    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh" event={"ID":"89fc663f-2cbc-427a-9fd0-1cc0d52eef3f","Type":"ContainerDied","Data":"d9d001b2f40ffe83e9f1620bb9a05214f2af12d96cfec578f85b8d22ccfee554"}
Sep 11 04:45:33.137323 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:33.137282    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh" event={"ID":"89fc663f-2cbc-427a-9fd0-1cc0d52eef3f","Type":"ContainerStarted","Data":"2d125ba59f3790e9f01a08810771bae1596599ced93d0a513c7fce4b13b97004"}
Sep 11 04:45:33.137807 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:33.137493    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"
Sep 11 04:45:33.160611 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:33.160542    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh" podStartSLOduration=2.748239478 podStartE2EDuration="7.1605215s" totalImagesPullingTime="3.362797606s" totalInitContainerRuntime="1.049484416s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:45:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:45:33.158687177 +0000 UTC m=+322.811946857" watchObservedRunningTime="2026-09-11 04:45:33.1605215 +0000 UTC m=+322.813781181"
Sep 11 04:45:44.143575 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:44.143528    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh"
Sep 11 04:45:46.093917 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:46.093879    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-fcb5f7d79-gdwv2"]
Sep 11 04:45:46.102625 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:46.102593    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-fcb5f7d79-gdwv2"
Sep 11 04:45:46.105419 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:46.105394    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 04:45:46.105975 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:46.105955    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 04:45:46.118166 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:46.118138    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-fcb5f7d79-gdwv2"]
Sep 11 04:45:46.170307 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:46.170263    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk6c4\" (UniqueName: \"kubernetes.io/projected/dd7c1a0b-849c-4966-95ce-ea9f77b86406-kube-api-access-jk6c4\") pod \"kube-auth-proxy-fcb5f7d79-gdwv2\" (UID: \"dd7c1a0b-849c-4966-95ce-ea9f77b86406\") " pod="openshift-ingress/kube-auth-proxy-fcb5f7d79-gdwv2"
Sep 11 04:45:46.170307 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:46.170311    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd7c1a0b-849c-4966-95ce-ea9f77b86406-tmp\") pod \"kube-auth-proxy-fcb5f7d79-gdwv2\" (UID: \"dd7c1a0b-849c-4966-95ce-ea9f77b86406\") " pod="openshift-ingress/kube-auth-proxy-fcb5f7d79-gdwv2"
Sep 11 04:45:46.170535 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:46.170412    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd7c1a0b-849c-4966-95ce-ea9f77b86406-tls-certs\") pod \"kube-auth-proxy-fcb5f7d79-gdwv2\" (UID: \"dd7c1a0b-849c-4966-95ce-ea9f77b86406\") " pod="openshift-ingress/kube-auth-proxy-fcb5f7d79-gdwv2"
Sep 11 04:45:46.271150 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:46.271112    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk6c4\" (UniqueName: \"kubernetes.io/projected/dd7c1a0b-849c-4966-95ce-ea9f77b86406-kube-api-access-jk6c4\") pod \"kube-auth-proxy-fcb5f7d79-gdwv2\" (UID: \"dd7c1a0b-849c-4966-95ce-ea9f77b86406\") " pod="openshift-ingress/kube-auth-proxy-fcb5f7d79-gdwv2"
Sep 11 04:45:46.271378 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:46.271163    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd7c1a0b-849c-4966-95ce-ea9f77b86406-tmp\") pod \"kube-auth-proxy-fcb5f7d79-gdwv2\" (UID: \"dd7c1a0b-849c-4966-95ce-ea9f77b86406\") " pod="openshift-ingress/kube-auth-proxy-fcb5f7d79-gdwv2"
Sep 11 04:45:46.271514 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:46.271371    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd7c1a0b-849c-4966-95ce-ea9f77b86406-tls-certs\") pod \"kube-auth-proxy-fcb5f7d79-gdwv2\" (UID: \"dd7c1a0b-849c-4966-95ce-ea9f77b86406\") " pod="openshift-ingress/kube-auth-proxy-fcb5f7d79-gdwv2"
Sep 11 04:45:46.271514 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:45:46.271493    2554 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 11 04:45:46.271609 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:45:46.271559    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd7c1a0b-849c-4966-95ce-ea9f77b86406-tls-certs podName:dd7c1a0b-849c-4966-95ce-ea9f77b86406 nodeName:}" failed. No retries permitted until 2026-09-11 04:45:46.771545201 +0000 UTC m=+336.424804859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/dd7c1a0b-849c-4966-95ce-ea9f77b86406-tls-certs") pod "kube-auth-proxy-fcb5f7d79-gdwv2" (UID: "dd7c1a0b-849c-4966-95ce-ea9f77b86406") : secret "kube-auth-proxy-tls" not found
Sep 11 04:45:46.273775 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:46.273748    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd7c1a0b-849c-4966-95ce-ea9f77b86406-tmp\") pod \"kube-auth-proxy-fcb5f7d79-gdwv2\" (UID: \"dd7c1a0b-849c-4966-95ce-ea9f77b86406\") " pod="openshift-ingress/kube-auth-proxy-fcb5f7d79-gdwv2"
Sep 11 04:45:46.279486 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:46.279465    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk6c4\" (UniqueName: \"kubernetes.io/projected/dd7c1a0b-849c-4966-95ce-ea9f77b86406-kube-api-access-jk6c4\") pod \"kube-auth-proxy-fcb5f7d79-gdwv2\" (UID: \"dd7c1a0b-849c-4966-95ce-ea9f77b86406\") " pod="openshift-ingress/kube-auth-proxy-fcb5f7d79-gdwv2"
Sep 11 04:45:46.774167 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:46.774119    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd7c1a0b-849c-4966-95ce-ea9f77b86406-tls-certs\") pod \"kube-auth-proxy-fcb5f7d79-gdwv2\" (UID: \"dd7c1a0b-849c-4966-95ce-ea9f77b86406\") " pod="openshift-ingress/kube-auth-proxy-fcb5f7d79-gdwv2"
Sep 11 04:45:46.777071 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:46.777043    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd7c1a0b-849c-4966-95ce-ea9f77b86406-tls-certs\") pod \"kube-auth-proxy-fcb5f7d79-gdwv2\" (UID: \"dd7c1a0b-849c-4966-95ce-ea9f77b86406\") " pod="openshift-ingress/kube-auth-proxy-fcb5f7d79-gdwv2"
Sep 11 04:45:47.013212 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.013158    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-fcb5f7d79-gdwv2"
Sep 11 04:45:47.296581 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.296558    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-fcb5f7d79-gdwv2"]
Sep 11 04:45:47.299051 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:45:47.299016    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd7c1a0b_849c_4966_95ce_ea9f77b86406.slice/crio-e9cf0bdede23aa3af4b1566d9dbabb2a1dbc4de8dc6c8926260e1a07e9461766 WatchSource:0}: Error finding container e9cf0bdede23aa3af4b1566d9dbabb2a1dbc4de8dc6c8926260e1a07e9461766: Status 404 returned error can't find the container with id e9cf0bdede23aa3af4b1566d9dbabb2a1dbc4de8dc6c8926260e1a07e9461766
Sep 11 04:45:47.514388 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.514350    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"]
Sep 11 04:45:47.517229 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.517213    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.519389 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.519364    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 04:45:47.519389 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.519383    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 04:45:47.519597 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.519368    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 04:45:47.519719 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.519705    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 04:45:47.519864 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.519846    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2brz8\""
Sep 11 04:45:47.530111 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.530086    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"]
Sep 11 04:45:47.579837 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.579795    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bc8b498-58c3-4b0a-a012-940617288983-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.580008 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.579842    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w5nc\" (UniqueName: \"kubernetes.io/projected/0bc8b498-58c3-4b0a-a012-940617288983-kube-api-access-5w5nc\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.580008 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.579873    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0bc8b498-58c3-4b0a-a012-940617288983-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.580008 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.579990    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bc8b498-58c3-4b0a-a012-940617288983-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.580186 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.580033    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0bc8b498-58c3-4b0a-a012-940617288983-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.580186 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.580059    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0bc8b498-58c3-4b0a-a012-940617288983-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.580186 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.580088    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0bc8b498-58c3-4b0a-a012-940617288983-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.680993 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.680956    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bc8b498-58c3-4b0a-a012-940617288983-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.680993 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.680991    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w5nc\" (UniqueName: \"kubernetes.io/projected/0bc8b498-58c3-4b0a-a012-940617288983-kube-api-access-5w5nc\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.681268 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.681028    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0bc8b498-58c3-4b0a-a012-940617288983-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.681268 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.681076    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bc8b498-58c3-4b0a-a012-940617288983-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.681268 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.681107    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0bc8b498-58c3-4b0a-a012-940617288983-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.681268 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.681129    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0bc8b498-58c3-4b0a-a012-940617288983-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.681268 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.681145    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0bc8b498-58c3-4b0a-a012-940617288983-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.681885 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.681849    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0bc8b498-58c3-4b0a-a012-940617288983-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.683913 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.683889    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0bc8b498-58c3-4b0a-a012-940617288983-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.684010 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.683942    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0bc8b498-58c3-4b0a-a012-940617288983-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.684049 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.684028    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bc8b498-58c3-4b0a-a012-940617288983-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.684151 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.684135    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0bc8b498-58c3-4b0a-a012-940617288983-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.688769 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.688743    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bc8b498-58c3-4b0a-a012-940617288983-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.689052 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.689035    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w5nc\" (UniqueName: \"kubernetes.io/projected/0bc8b498-58c3-4b0a-a012-940617288983-kube-api-access-5w5nc\") pod \"istiod-openshift-gateway-7b7995d5cd-cs5xt\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:47.827684 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:47.827586    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:48.120633 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:48.120552    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"]
Sep 11 04:45:48.125304 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:45:48.125273    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc8b498_58c3_4b0a_a012_940617288983.slice/crio-c082df42b2fd9cddb53cd9ffc81c55012b15a6db5c06f95e4bb6c940fc17f02f WatchSource:0}: Error finding container c082df42b2fd9cddb53cd9ffc81c55012b15a6db5c06f95e4bb6c940fc17f02f: Status 404 returned error can't find the container with id c082df42b2fd9cddb53cd9ffc81c55012b15a6db5c06f95e4bb6c940fc17f02f
Sep 11 04:45:48.211445 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:48.211398    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt" event={"ID":"0bc8b498-58c3-4b0a-a012-940617288983","Type":"ContainerStarted","Data":"c082df42b2fd9cddb53cd9ffc81c55012b15a6db5c06f95e4bb6c940fc17f02f"}
Sep 11 04:45:48.213175 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:48.213144    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-fcb5f7d79-gdwv2" event={"ID":"dd7c1a0b-849c-4966-95ce-ea9f77b86406","Type":"ContainerStarted","Data":"e9cf0bdede23aa3af4b1566d9dbabb2a1dbc4de8dc6c8926260e1a07e9461766"}
Sep 11 04:45:50.224681 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:50.224641    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-fcb5f7d79-gdwv2" event={"ID":"dd7c1a0b-849c-4966-95ce-ea9f77b86406","Type":"ContainerStarted","Data":"33d2ff12409e6442bde8a364071b3a69ef4f7c66b563e2cc6ddc5ae444f3f5ed"}
Sep 11 04:45:50.241908 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:50.241810    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-fcb5f7d79-gdwv2" podStartSLOduration=1.55971375 podStartE2EDuration="4.241792425s" totalImagesPullingTime="2.682078675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:45:50.240271263 +0000 UTC m=+339.893530941" watchObservedRunningTime="2026-09-11 04:45:50.241792425 +0000 UTC m=+339.895052106"
Sep 11 04:45:51.778619 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:51.778583    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:45:51.778880 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:51.778650    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:45:52.235622 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:52.235590    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt" event={"ID":"0bc8b498-58c3-4b0a-a012-940617288983","Type":"ContainerStarted","Data":"37853f4c6c817748c1a9f70a07eca0bfea73dce0ed62ed0d906004dac2771d20"}
Sep 11 04:45:52.235830 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:52.235811    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:45:52.237474 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:52.237446    2554 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-cs5xt container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 04:45:52.237604 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:52.237495    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt" podUID="0bc8b498-58c3-4b0a-a012-940617288983" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 04:45:52.254800 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:52.254744    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt" podStartSLOduration=1.604470681 podStartE2EDuration="5.254727127s" totalImagesPullingTime="3.650256446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:45:52.253536107 +0000 UTC m=+341.906795788" watchObservedRunningTime="2026-09-11 04:45:52.254727127 +0000 UTC m=+341.907986807"
Sep 11 04:45:53.240626 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:45:53.240600    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:46:06.800057 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:06.799984    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fpb28"]
Sep 11 04:46:06.803158 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:06.803141    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpb28"
Sep 11 04:46:06.805484 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:06.805462    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 11 04:46:06.805617 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:06.805528    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-nmjsf\""
Sep 11 04:46:06.815575 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:06.815544    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fpb28"]
Sep 11 04:46:06.819296 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:06.819270    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6n5lv"]
Sep 11 04:46:06.822459 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:06.822440    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6n5lv"
Sep 11 04:46:06.824873 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:06.824856    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-5dpxr\""
Sep 11 04:46:06.825299 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:06.825282    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 11 04:46:06.835540 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:06.835508    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6n5lv"]
Sep 11 04:46:06.850959 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:06.850931    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bhpn\" (UniqueName: \"kubernetes.io/projected/50fa7de3-d758-40aa-909f-d025d698aea9-kube-api-access-4bhpn\") pod \"kserve-controller-manager-d6f4b65b8-fpb28\" (UID: \"50fa7de3-d758-40aa-909f-d025d698aea9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpb28"
Sep 11 04:46:06.851133 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:06.850966    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50fa7de3-d758-40aa-909f-d025d698aea9-cert\") pod \"kserve-controller-manager-d6f4b65b8-fpb28\" (UID: \"50fa7de3-d758-40aa-909f-d025d698aea9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpb28"
Sep 11 04:46:06.952297 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:06.952259    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-489v4\" (UniqueName: \"kubernetes.io/projected/8a12362a-dc5b-4e4e-8551-37108f2e0fb6-kube-api-access-489v4\") pod \"llmisvc-controller-manager-777c6bd7d5-6n5lv\" (UID: \"8a12362a-dc5b-4e4e-8551-37108f2e0fb6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6n5lv"
Sep 11 04:46:06.952527 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:06.952313    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bhpn\" (UniqueName: \"kubernetes.io/projected/50fa7de3-d758-40aa-909f-d025d698aea9-kube-api-access-4bhpn\") pod \"kserve-controller-manager-d6f4b65b8-fpb28\" (UID: \"50fa7de3-d758-40aa-909f-d025d698aea9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpb28"
Sep 11 04:46:06.952527 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:06.952460    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50fa7de3-d758-40aa-909f-d025d698aea9-cert\") pod \"kserve-controller-manager-d6f4b65b8-fpb28\" (UID: \"50fa7de3-d758-40aa-909f-d025d698aea9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpb28"
Sep 11 04:46:06.952527 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:06.952500    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a12362a-dc5b-4e4e-8551-37108f2e0fb6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6n5lv\" (UID: \"8a12362a-dc5b-4e4e-8551-37108f2e0fb6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6n5lv"
Sep 11 04:46:06.952672 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:46:06.952598    2554 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 11 04:46:06.952672 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:46:06.952655    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50fa7de3-d758-40aa-909f-d025d698aea9-cert podName:50fa7de3-d758-40aa-909f-d025d698aea9 nodeName:}" failed. No retries permitted until 2026-09-11 04:46:07.452639162 +0000 UTC m=+357.105898833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/50fa7de3-d758-40aa-909f-d025d698aea9-cert") pod "kserve-controller-manager-d6f4b65b8-fpb28" (UID: "50fa7de3-d758-40aa-909f-d025d698aea9") : secret "kserve-webhook-server-cert" not found
Sep 11 04:46:06.986994 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:06.986954    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bhpn\" (UniqueName: \"kubernetes.io/projected/50fa7de3-d758-40aa-909f-d025d698aea9-kube-api-access-4bhpn\") pod \"kserve-controller-manager-d6f4b65b8-fpb28\" (UID: \"50fa7de3-d758-40aa-909f-d025d698aea9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpb28"
Sep 11 04:46:07.053976 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:07.053890    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a12362a-dc5b-4e4e-8551-37108f2e0fb6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6n5lv\" (UID: \"8a12362a-dc5b-4e4e-8551-37108f2e0fb6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6n5lv"
Sep 11 04:46:07.054124 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:07.053979    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-489v4\" (UniqueName: \"kubernetes.io/projected/8a12362a-dc5b-4e4e-8551-37108f2e0fb6-kube-api-access-489v4\") pod \"llmisvc-controller-manager-777c6bd7d5-6n5lv\" (UID: \"8a12362a-dc5b-4e4e-8551-37108f2e0fb6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6n5lv"
Sep 11 04:46:07.056596 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:07.056573    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a12362a-dc5b-4e4e-8551-37108f2e0fb6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6n5lv\" (UID: \"8a12362a-dc5b-4e4e-8551-37108f2e0fb6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6n5lv"
Sep 11 04:46:07.067619 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:07.067583    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-489v4\" (UniqueName: \"kubernetes.io/projected/8a12362a-dc5b-4e4e-8551-37108f2e0fb6-kube-api-access-489v4\") pod \"llmisvc-controller-manager-777c6bd7d5-6n5lv\" (UID: \"8a12362a-dc5b-4e4e-8551-37108f2e0fb6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6n5lv"
Sep 11 04:46:07.132700 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:07.132655    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6n5lv"
Sep 11 04:46:07.409361 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:07.409233    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6n5lv"]
Sep 11 04:46:07.411972 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:46:07.411941    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8a12362a_dc5b_4e4e_8551_37108f2e0fb6.slice/crio-c75a87adb200c068d6eb6535825e7a1bb39c4f97d41b775586b6651ec6e1e7de WatchSource:0}: Error finding container c75a87adb200c068d6eb6535825e7a1bb39c4f97d41b775586b6651ec6e1e7de: Status 404 returned error can't find the container with id c75a87adb200c068d6eb6535825e7a1bb39c4f97d41b775586b6651ec6e1e7de
Sep 11 04:46:07.457196 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:07.457160    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50fa7de3-d758-40aa-909f-d025d698aea9-cert\") pod \"kserve-controller-manager-d6f4b65b8-fpb28\" (UID: \"50fa7de3-d758-40aa-909f-d025d698aea9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpb28"
Sep 11 04:46:07.459792 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:07.459771    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50fa7de3-d758-40aa-909f-d025d698aea9-cert\") pod \"kserve-controller-manager-d6f4b65b8-fpb28\" (UID: \"50fa7de3-d758-40aa-909f-d025d698aea9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpb28"
Sep 11 04:46:07.713997 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:07.713901    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpb28"
Sep 11 04:46:07.994583 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:07.994551    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fpb28"]
Sep 11 04:46:07.997149 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:46:07.997124    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50fa7de3_d758_40aa_909f_d025d698aea9.slice/crio-66f2a9a901f68981577cd43ab3ab3611bd51f06bd3b460d010e9ef883c56aa4f WatchSource:0}: Error finding container 66f2a9a901f68981577cd43ab3ab3611bd51f06bd3b460d010e9ef883c56aa4f: Status 404 returned error can't find the container with id 66f2a9a901f68981577cd43ab3ab3611bd51f06bd3b460d010e9ef883c56aa4f
Sep 11 04:46:08.304832 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:08.304738    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpb28" event={"ID":"50fa7de3-d758-40aa-909f-d025d698aea9","Type":"ContainerStarted","Data":"66f2a9a901f68981577cd43ab3ab3611bd51f06bd3b460d010e9ef883c56aa4f"}
Sep 11 04:46:08.305901 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:08.305881    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6n5lv" event={"ID":"8a12362a-dc5b-4e4e-8551-37108f2e0fb6","Type":"ContainerStarted","Data":"c75a87adb200c068d6eb6535825e7a1bb39c4f97d41b775586b6651ec6e1e7de"}
Sep 11 04:46:08.860154 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:08.860115    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"]
Sep 11 04:46:08.860471 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:08.860372    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt" podUID="0bc8b498-58c3-4b0a-a012-940617288983" containerName="discovery" containerID="cri-o://37853f4c6c817748c1a9f70a07eca0bfea73dce0ed62ed0d906004dac2771d20" gracePeriod=30
Sep 11 04:46:09.130041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.130014    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:46:09.273266 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.273233    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w5nc\" (UniqueName: \"kubernetes.io/projected/0bc8b498-58c3-4b0a-a012-940617288983-kube-api-access-5w5nc\") pod \"0bc8b498-58c3-4b0a-a012-940617288983\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") "
Sep 11 04:46:09.273266 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.273272    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0bc8b498-58c3-4b0a-a012-940617288983-istio-kubeconfig\") pod \"0bc8b498-58c3-4b0a-a012-940617288983\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") "
Sep 11 04:46:09.273527 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.273315    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0bc8b498-58c3-4b0a-a012-940617288983-istio-csr-dns-cert\") pod \"0bc8b498-58c3-4b0a-a012-940617288983\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") "
Sep 11 04:46:09.273527 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.273483    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bc8b498-58c3-4b0a-a012-940617288983-local-certs\") pod \"0bc8b498-58c3-4b0a-a012-940617288983\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") "
Sep 11 04:46:09.273637 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.273536    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0bc8b498-58c3-4b0a-a012-940617288983-cacerts\") pod \"0bc8b498-58c3-4b0a-a012-940617288983\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") "
Sep 11 04:46:09.273637 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.273579    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0bc8b498-58c3-4b0a-a012-940617288983-istio-csr-ca-configmap\") pod \"0bc8b498-58c3-4b0a-a012-940617288983\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") "
Sep 11 04:46:09.273637 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.273623    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bc8b498-58c3-4b0a-a012-940617288983-istio-token\") pod \"0bc8b498-58c3-4b0a-a012-940617288983\" (UID: \"0bc8b498-58c3-4b0a-a012-940617288983\") "
Sep 11 04:46:09.274241 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.274029    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bc8b498-58c3-4b0a-a012-940617288983-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "0bc8b498-58c3-4b0a-a012-940617288983" (UID: "0bc8b498-58c3-4b0a-a012-940617288983"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:46:09.276018 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.275985    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bc8b498-58c3-4b0a-a012-940617288983-cacerts" (OuterVolumeSpecName: "cacerts") pod "0bc8b498-58c3-4b0a-a012-940617288983" (UID: "0bc8b498-58c3-4b0a-a012-940617288983"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:46:09.276161 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.276022    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bc8b498-58c3-4b0a-a012-940617288983-kube-api-access-5w5nc" (OuterVolumeSpecName: "kube-api-access-5w5nc") pod "0bc8b498-58c3-4b0a-a012-940617288983" (UID: "0bc8b498-58c3-4b0a-a012-940617288983"). InnerVolumeSpecName "kube-api-access-5w5nc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:46:09.276161 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.276120    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bc8b498-58c3-4b0a-a012-940617288983-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "0bc8b498-58c3-4b0a-a012-940617288983" (UID: "0bc8b498-58c3-4b0a-a012-940617288983"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:46:09.276161 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.276130    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bc8b498-58c3-4b0a-a012-940617288983-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "0bc8b498-58c3-4b0a-a012-940617288983" (UID: "0bc8b498-58c3-4b0a-a012-940617288983"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:46:09.276349 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.276233    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0bc8b498-58c3-4b0a-a012-940617288983-local-certs" (OuterVolumeSpecName: "local-certs") pod "0bc8b498-58c3-4b0a-a012-940617288983" (UID: "0bc8b498-58c3-4b0a-a012-940617288983"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:46:09.276506 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.276490    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bc8b498-58c3-4b0a-a012-940617288983-istio-token" (OuterVolumeSpecName: "istio-token") pod "0bc8b498-58c3-4b0a-a012-940617288983" (UID: "0bc8b498-58c3-4b0a-a012-940617288983"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:46:09.311538 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.311501    2554 generic.go:356] "Generic (PLEG): container finished" podID="0bc8b498-58c3-4b0a-a012-940617288983" containerID="37853f4c6c817748c1a9f70a07eca0bfea73dce0ed62ed0d906004dac2771d20" exitCode=0
Sep 11 04:46:09.311688 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.311550    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"
Sep 11 04:46:09.311688 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.311547    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt" event={"ID":"0bc8b498-58c3-4b0a-a012-940617288983","Type":"ContainerDied","Data":"37853f4c6c817748c1a9f70a07eca0bfea73dce0ed62ed0d906004dac2771d20"}
Sep 11 04:46:09.311790 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.311705    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt" event={"ID":"0bc8b498-58c3-4b0a-a012-940617288983","Type":"ContainerDied","Data":"c082df42b2fd9cddb53cd9ffc81c55012b15a6db5c06f95e4bb6c940fc17f02f"}
Sep 11 04:46:09.311790 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.311747    2554 scope.go:117] "RemoveContainer" containerID="37853f4c6c817748c1a9f70a07eca0bfea73dce0ed62ed0d906004dac2771d20"
Sep 11 04:46:09.320887 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.320776    2554 scope.go:117] "RemoveContainer" containerID="37853f4c6c817748c1a9f70a07eca0bfea73dce0ed62ed0d906004dac2771d20"
Sep 11 04:46:09.321282 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:46:09.321257    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37853f4c6c817748c1a9f70a07eca0bfea73dce0ed62ed0d906004dac2771d20\": container with ID starting with 37853f4c6c817748c1a9f70a07eca0bfea73dce0ed62ed0d906004dac2771d20 not found: ID does not exist" containerID="37853f4c6c817748c1a9f70a07eca0bfea73dce0ed62ed0d906004dac2771d20"
Sep 11 04:46:09.321282 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.321293    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37853f4c6c817748c1a9f70a07eca0bfea73dce0ed62ed0d906004dac2771d20"} err="failed to get container status \"37853f4c6c817748c1a9f70a07eca0bfea73dce0ed62ed0d906004dac2771d20\": rpc error: code = NotFound desc = could not find container \"37853f4c6c817748c1a9f70a07eca0bfea73dce0ed62ed0d906004dac2771d20\": container with ID starting with 37853f4c6c817748c1a9f70a07eca0bfea73dce0ed62ed0d906004dac2771d20 not found: ID does not exist"
Sep 11 04:46:09.334218 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.334178    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"]
Sep 11 04:46:09.337561 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.337539    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-cs5xt"]
Sep 11 04:46:09.374752 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.374687    2554 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0bc8b498-58c3-4b0a-a012-940617288983-local-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:46:09.374752 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.374713    2554 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0bc8b498-58c3-4b0a-a012-940617288983-cacerts\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:46:09.374752 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.374723    2554 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0bc8b498-58c3-4b0a-a012-940617288983-istio-csr-ca-configmap\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:46:09.374752 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.374733    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0bc8b498-58c3-4b0a-a012-940617288983-istio-token\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:46:09.374752 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.374742    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w5nc\" (UniqueName: \"kubernetes.io/projected/0bc8b498-58c3-4b0a-a012-940617288983-kube-api-access-5w5nc\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:46:09.374752 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.374751    2554 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0bc8b498-58c3-4b0a-a012-940617288983-istio-kubeconfig\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:46:09.375025 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:09.374759    2554 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0bc8b498-58c3-4b0a-a012-940617288983-istio-csr-dns-cert\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:46:10.814020 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:10.813985    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bc8b498-58c3-4b0a-a012-940617288983" path="/var/lib/kubelet/pods/0bc8b498-58c3-4b0a-a012-940617288983/volumes"
Sep 11 04:46:11.323965 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:11.323933    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpb28" event={"ID":"50fa7de3-d758-40aa-909f-d025d698aea9","Type":"ContainerStarted","Data":"6ff40b714bb0b0f62074a841d1bbb5fc5f4d43137f4975f09287e1f84593003c"}
Sep 11 04:46:11.324194 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:11.324000    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpb28"
Sep 11 04:46:11.340248 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:11.340195    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpb28" podStartSLOduration=2.647360697 podStartE2EDuration="5.340179325s" totalImagesPullingTime="2.692818628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:46:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:46:11.339095593 +0000 UTC m=+360.992355273" watchObservedRunningTime="2026-09-11 04:46:11.340179325 +0000 UTC m=+360.993439004"
Sep 11 04:46:12.329305 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:12.329263    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6n5lv" event={"ID":"8a12362a-dc5b-4e4e-8551-37108f2e0fb6","Type":"ContainerStarted","Data":"eecb0c4e1dd151c61b9d6e163f63e69361d7c9f2b97b5c0b74fdb4ea82b1304c"}
Sep 11 04:46:12.329779 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:12.329412    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6n5lv"
Sep 11 04:46:12.345807 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:12.345746    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6n5lv" podStartSLOduration=2.3704406860000002 podStartE2EDuration="6.345719925s" totalImagesPullingTime="3.975279239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:46:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:46:12.345065459 +0000 UTC m=+361.998325140" watchObservedRunningTime="2026-09-11 04:46:12.345719925 +0000 UTC m=+361.998979607"
Sep 11 04:46:42.334444 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:42.334408    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fpb28"
Sep 11 04:46:43.336076 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:46:43.336041    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6n5lv"
Sep 11 04:47:15.470958 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.470921    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"]
Sep 11 04:47:15.471459 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.471213    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc8b498-58c3-4b0a-a012-940617288983" containerName="discovery"
Sep 11 04:47:15.471459 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.471224    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc8b498-58c3-4b0a-a012-940617288983" containerName="discovery"
Sep 11 04:47:15.471459 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.471291    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc8b498-58c3-4b0a-a012-940617288983" containerName="discovery"
Sep 11 04:47:15.473186 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.473171    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:15.475380 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.475358    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 04:47:15.475501 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.475382    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 04:47:15.475501 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.475360    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wvcgs\""
Sep 11 04:47:15.486267 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.486242    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"]
Sep 11 04:47:15.615163 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.615125    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da8619dc-d9d5-49ee-a00c-8d9df6fd4c58-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fftc8\" (UID: \"da8619dc-d9d5-49ee-a00c-8d9df6fd4c58\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:15.615389 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.615185    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkllc\" (UniqueName: \"kubernetes.io/projected/da8619dc-d9d5-49ee-a00c-8d9df6fd4c58-kube-api-access-lkllc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fftc8\" (UID: \"da8619dc-d9d5-49ee-a00c-8d9df6fd4c58\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:15.716260 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.716225    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da8619dc-d9d5-49ee-a00c-8d9df6fd4c58-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fftc8\" (UID: \"da8619dc-d9d5-49ee-a00c-8d9df6fd4c58\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:15.716484 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.716314    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkllc\" (UniqueName: \"kubernetes.io/projected/da8619dc-d9d5-49ee-a00c-8d9df6fd4c58-kube-api-access-lkllc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fftc8\" (UID: \"da8619dc-d9d5-49ee-a00c-8d9df6fd4c58\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:15.716647 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.716625    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da8619dc-d9d5-49ee-a00c-8d9df6fd4c58-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fftc8\" (UID: \"da8619dc-d9d5-49ee-a00c-8d9df6fd4c58\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:15.724722 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.724670    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkllc\" (UniqueName: \"kubernetes.io/projected/da8619dc-d9d5-49ee-a00c-8d9df6fd4c58-kube-api-access-lkllc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-fftc8\" (UID: \"da8619dc-d9d5-49ee-a00c-8d9df6fd4c58\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:15.783668 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.783628    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:15.988170 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.988093    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f94454b9d-kmvmj"]
Sep 11 04:47:15.990585 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.990569    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:15.993535 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.993498    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 04:47:15.993672 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.993594    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 04:47:15.993672 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.993615    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 04:47:15.993672 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.993498    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5f9r2\""
Sep 11 04:47:15.993672 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.993661    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 04:47:15.994237 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:15.994223    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 04:47:16.001303 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.001278    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 04:47:16.007597 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.007572    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f94454b9d-kmvmj"]
Sep 11 04:47:16.067511 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.067484    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"]
Sep 11 04:47:16.070491 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:47:16.070459    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda8619dc_d9d5_49ee_a00c_8d9df6fd4c58.slice/crio-f02beaad702d731a395d85bf939215c32ab3001ff95cd9e1628e6e713e3bc4f3 WatchSource:0}: Error finding container f02beaad702d731a395d85bf939215c32ab3001ff95cd9e1628e6e713e3bc4f3: Status 404 returned error can't find the container with id f02beaad702d731a395d85bf939215c32ab3001ff95cd9e1628e6e713e3bc4f3
Sep 11 04:47:16.119057 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.119018    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6fc2935-4bb8-48d8-90c9-590a78745582-console-serving-cert\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.119057 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.119063    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6fc2935-4bb8-48d8-90c9-590a78745582-oauth-serving-cert\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.119268 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.119090    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s75wc\" (UniqueName: \"kubernetes.io/projected/c6fc2935-4bb8-48d8-90c9-590a78745582-kube-api-access-s75wc\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.119268 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.119148    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6fc2935-4bb8-48d8-90c9-590a78745582-console-oauth-config\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.119268 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.119203    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6fc2935-4bb8-48d8-90c9-590a78745582-console-config\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.119268 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.119234    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6fc2935-4bb8-48d8-90c9-590a78745582-trusted-ca-bundle\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.119268 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.119262    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6fc2935-4bb8-48d8-90c9-590a78745582-service-ca\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.220715 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.220678    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6fc2935-4bb8-48d8-90c9-590a78745582-console-oauth-config\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.220925 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.220724    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6fc2935-4bb8-48d8-90c9-590a78745582-console-config\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.220925 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.220743    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6fc2935-4bb8-48d8-90c9-590a78745582-trusted-ca-bundle\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.220925 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.220759    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6fc2935-4bb8-48d8-90c9-590a78745582-service-ca\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.220925 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.220807    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6fc2935-4bb8-48d8-90c9-590a78745582-console-serving-cert\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.220925 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.220828    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6fc2935-4bb8-48d8-90c9-590a78745582-oauth-serving-cert\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.220925 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.220856    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s75wc\" (UniqueName: \"kubernetes.io/projected/c6fc2935-4bb8-48d8-90c9-590a78745582-kube-api-access-s75wc\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.221605 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.221577    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6fc2935-4bb8-48d8-90c9-590a78745582-console-config\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.221713 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.221633    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6fc2935-4bb8-48d8-90c9-590a78745582-oauth-serving-cert\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.221713 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.221690    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6fc2935-4bb8-48d8-90c9-590a78745582-trusted-ca-bundle\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.221789 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.221730    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6fc2935-4bb8-48d8-90c9-590a78745582-service-ca\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.223305 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.223279    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6fc2935-4bb8-48d8-90c9-590a78745582-console-oauth-config\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.223464 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.223448    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6fc2935-4bb8-48d8-90c9-590a78745582-console-serving-cert\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.242973 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.242924    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s75wc\" (UniqueName: \"kubernetes.io/projected/c6fc2935-4bb8-48d8-90c9-590a78745582-kube-api-access-s75wc\") pod \"console-7f94454b9d-kmvmj\" (UID: \"c6fc2935-4bb8-48d8-90c9-590a78745582\") " pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.302646 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.302605    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:16.580699 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.580665    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f94454b9d-kmvmj"]
Sep 11 04:47:16.583274 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:47:16.583235    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6fc2935_4bb8_48d8_90c9_590a78745582.slice/crio-80ad01f0d554bcf143b677433bf4b9443327d497066afc5406d973c60b651cdc WatchSource:0}: Error finding container 80ad01f0d554bcf143b677433bf4b9443327d497066afc5406d973c60b651cdc: Status 404 returned error can't find the container with id 80ad01f0d554bcf143b677433bf4b9443327d497066afc5406d973c60b651cdc
Sep 11 04:47:16.605761 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.605723    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8" event={"ID":"da8619dc-d9d5-49ee-a00c-8d9df6fd4c58","Type":"ContainerStarted","Data":"f02beaad702d731a395d85bf939215c32ab3001ff95cd9e1628e6e713e3bc4f3"}
Sep 11 04:47:16.606901 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:16.606866    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f94454b9d-kmvmj" event={"ID":"c6fc2935-4bb8-48d8-90c9-590a78745582","Type":"ContainerStarted","Data":"80ad01f0d554bcf143b677433bf4b9443327d497066afc5406d973c60b651cdc"}
Sep 11 04:47:17.614981 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:17.614915    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f94454b9d-kmvmj" event={"ID":"c6fc2935-4bb8-48d8-90c9-590a78745582","Type":"ContainerStarted","Data":"7880c6e79e1a5163ead5eec8f047fe51e8f68aed6b2d94cc56c34e77a0081de5"}
Sep 11 04:47:17.635881 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:17.635808    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f94454b9d-kmvmj" podStartSLOduration=2.635786456 podStartE2EDuration="2.635786456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:47:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:47:17.634392252 +0000 UTC m=+427.287651934" watchObservedRunningTime="2026-09-11 04:47:17.635786456 +0000 UTC m=+427.289046140"
Sep 11 04:47:17.868468 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:17.868391    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bwgqb"]
Sep 11 04:47:17.875455 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:17.875419    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-bwgqb"
Sep 11 04:47:17.877673 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:17.877648    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-h67kp\""
Sep 11 04:47:17.882258 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:17.882142    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bwgqb"]
Sep 11 04:47:17.944887 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:17.944493    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9htdk\" (UniqueName: \"kubernetes.io/projected/86f6964a-d794-4ad9-815b-b17d7c2ad9f1-kube-api-access-9htdk\") pod \"authorino-operator-76b478bd78-bwgqb\" (UID: \"86f6964a-d794-4ad9-815b-b17d7c2ad9f1\") " pod="kuadrant-system/authorino-operator-76b478bd78-bwgqb"
Sep 11 04:47:18.045571 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:18.045531    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9htdk\" (UniqueName: \"kubernetes.io/projected/86f6964a-d794-4ad9-815b-b17d7c2ad9f1-kube-api-access-9htdk\") pod \"authorino-operator-76b478bd78-bwgqb\" (UID: \"86f6964a-d794-4ad9-815b-b17d7c2ad9f1\") " pod="kuadrant-system/authorino-operator-76b478bd78-bwgqb"
Sep 11 04:47:18.057322 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:18.057287    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9htdk\" (UniqueName: \"kubernetes.io/projected/86f6964a-d794-4ad9-815b-b17d7c2ad9f1-kube-api-access-9htdk\") pod \"authorino-operator-76b478bd78-bwgqb\" (UID: \"86f6964a-d794-4ad9-815b-b17d7c2ad9f1\") " pod="kuadrant-system/authorino-operator-76b478bd78-bwgqb"
Sep 11 04:47:18.191351 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:18.191281    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-bwgqb"
Sep 11 04:47:18.710301 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:18.710227    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-bwgqb"]
Sep 11 04:47:18.713534 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:47:18.713500    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86f6964a_d794_4ad9_815b_b17d7c2ad9f1.slice/crio-a3add6d2702b23c962dc04a917e4f7f34ba8b6e659994565ff727f14fe81460e WatchSource:0}: Error finding container a3add6d2702b23c962dc04a917e4f7f34ba8b6e659994565ff727f14fe81460e: Status 404 returned error can't find the container with id a3add6d2702b23c962dc04a917e4f7f34ba8b6e659994565ff727f14fe81460e
Sep 11 04:47:19.627087 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:19.627039    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-bwgqb" event={"ID":"86f6964a-d794-4ad9-815b-b17d7c2ad9f1","Type":"ContainerStarted","Data":"a3add6d2702b23c962dc04a917e4f7f34ba8b6e659994565ff727f14fe81460e"}
Sep 11 04:47:20.291007 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:20.290972    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x57zt"]
Sep 11 04:47:20.293600 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:20.293570    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x57zt"
Sep 11 04:47:20.296316 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:20.296288    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-t2clh\""
Sep 11 04:47:20.296316 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:20.296292    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 04:47:20.312085 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:20.312053    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x57zt"]
Sep 11 04:47:20.370119 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:20.370033    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx5bw\" (UniqueName: \"kubernetes.io/projected/04a7f9d0-06d0-44c5-85bb-fca2ce26bdb1-kube-api-access-gx5bw\") pod \"dns-operator-controller-manager-7b84cd7c9c-x57zt\" (UID: \"04a7f9d0-06d0-44c5-85bb-fca2ce26bdb1\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x57zt"
Sep 11 04:47:20.471505 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:20.471466    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx5bw\" (UniqueName: \"kubernetes.io/projected/04a7f9d0-06d0-44c5-85bb-fca2ce26bdb1-kube-api-access-gx5bw\") pod \"dns-operator-controller-manager-7b84cd7c9c-x57zt\" (UID: \"04a7f9d0-06d0-44c5-85bb-fca2ce26bdb1\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x57zt"
Sep 11 04:47:20.480278 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:20.480236    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx5bw\" (UniqueName: \"kubernetes.io/projected/04a7f9d0-06d0-44c5-85bb-fca2ce26bdb1-kube-api-access-gx5bw\") pod \"dns-operator-controller-manager-7b84cd7c9c-x57zt\" (UID: \"04a7f9d0-06d0-44c5-85bb-fca2ce26bdb1\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x57zt"
Sep 11 04:47:20.607228 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:20.607192    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x57zt"
Sep 11 04:47:20.634524 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:20.634438    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8" event={"ID":"da8619dc-d9d5-49ee-a00c-8d9df6fd4c58","Type":"ContainerStarted","Data":"7d5b2729ab997aad75d43dd6e11cce9804d934ab1338b169d2683f3d3278638a"}
Sep 11 04:47:20.634691 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:20.634562    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:20.654598 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:20.654529    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8" podStartSLOduration=1.619497027 podStartE2EDuration="5.654503964s" totalImagesPullingTime="4.035006937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:47:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:47:20.653503753 +0000 UTC m=+430.306763419" watchObservedRunningTime="2026-09-11 04:47:20.654503964 +0000 UTC m=+430.307763645"
Sep 11 04:47:21.036985 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:21.036956    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x57zt"]
Sep 11 04:47:21.040159 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:47:21.040136    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a7f9d0_06d0_44c5_85bb_fca2ce26bdb1.slice/crio-a12b1e3d984a2d88a43a4a9e3a703ebfc142db0f264ac9c9632d5321e6a756ff WatchSource:0}: Error finding container a12b1e3d984a2d88a43a4a9e3a703ebfc142db0f264ac9c9632d5321e6a756ff: Status 404 returned error can't find the container with id a12b1e3d984a2d88a43a4a9e3a703ebfc142db0f264ac9c9632d5321e6a756ff
Sep 11 04:47:21.641770 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:21.641735    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-bwgqb" event={"ID":"86f6964a-d794-4ad9-815b-b17d7c2ad9f1","Type":"ContainerStarted","Data":"b341b3d8b99956da2f147074b73778ff209465f4bc0fa9dc222509b54e0b53ef"}
Sep 11 04:47:21.642228 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:21.641835    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-bwgqb"
Sep 11 04:47:21.643377 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:21.643324    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x57zt" event={"ID":"04a7f9d0-06d0-44c5-85bb-fca2ce26bdb1","Type":"ContainerStarted","Data":"a12b1e3d984a2d88a43a4a9e3a703ebfc142db0f264ac9c9632d5321e6a756ff"}
Sep 11 04:47:21.659929 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:21.659875    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-bwgqb" podStartSLOduration=2.567997293 podStartE2EDuration="4.659854781s" totalImagesPullingTime="2.091857488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:47:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:47:21.657676051 +0000 UTC m=+431.310935741" watchObservedRunningTime="2026-09-11 04:47:21.659854781 +0000 UTC m=+431.313114460"
Sep 11 04:47:22.399988 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:22.399951    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"]
Sep 11 04:47:22.404001 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:22.403976    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"
Sep 11 04:47:22.406481 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:22.406454    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kh5lj\""
Sep 11 04:47:22.414798 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:22.414776    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"]
Sep 11 04:47:22.490378 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:22.490312    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzp9p\" (UniqueName: \"kubernetes.io/projected/5ef322b3-c09f-4d6a-a05e-997d557356ca-kube-api-access-mzp9p\") pod \"limitador-operator-controller-manager-74495c69f8-ngkp7\" (UID: \"5ef322b3-c09f-4d6a-a05e-997d557356ca\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"
Sep 11 04:47:22.591205 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:22.591173    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzp9p\" (UniqueName: \"kubernetes.io/projected/5ef322b3-c09f-4d6a-a05e-997d557356ca-kube-api-access-mzp9p\") pod \"limitador-operator-controller-manager-74495c69f8-ngkp7\" (UID: \"5ef322b3-c09f-4d6a-a05e-997d557356ca\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"
Sep 11 04:47:22.604914 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:22.604882    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzp9p\" (UniqueName: \"kubernetes.io/projected/5ef322b3-c09f-4d6a-a05e-997d557356ca-kube-api-access-mzp9p\") pod \"limitador-operator-controller-manager-74495c69f8-ngkp7\" (UID: \"5ef322b3-c09f-4d6a-a05e-997d557356ca\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"
Sep 11 04:47:22.649811 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:22.649775    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x57zt" event={"ID":"04a7f9d0-06d0-44c5-85bb-fca2ce26bdb1","Type":"ContainerStarted","Data":"f8f381209d1d6e9026138f816860e8ea83af6fea920943c795a24ae768dd32d7"}
Sep 11 04:47:22.650239 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:22.649861    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x57zt"
Sep 11 04:47:22.671900 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:22.671850    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x57zt" podStartSLOduration=1.257864142 podStartE2EDuration="2.671834254s" totalImagesPullingTime="1.413970112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:47:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:47:22.669866717 +0000 UTC m=+432.323126398" watchObservedRunningTime="2026-09-11 04:47:22.671834254 +0000 UTC m=+432.325093934"
Sep 11 04:47:22.717501 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:22.717454    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"
Sep 11 04:47:22.990578 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:22.990551    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"]
Sep 11 04:47:22.993417 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:47:22.993385    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ef322b3_c09f_4d6a_a05e_997d557356ca.slice/crio-f449c295f916b3a5354657f3612fb13c4591da398c3d2cfeaca22adc0c902879 WatchSource:0}: Error finding container f449c295f916b3a5354657f3612fb13c4591da398c3d2cfeaca22adc0c902879: Status 404 returned error can't find the container with id f449c295f916b3a5354657f3612fb13c4591da398c3d2cfeaca22adc0c902879
Sep 11 04:47:23.043186 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:23.043152    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-5p8n7"]
Sep 11 04:47:23.046855 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:23.046833    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5p8n7"
Sep 11 04:47:23.049299 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:23.049109    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 11 04:47:23.049299 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:23.049156    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zb4nt\""
Sep 11 04:47:23.049299 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:23.049181    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 11 04:47:23.055593 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:23.055411    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-5p8n7"]
Sep 11 04:47:23.197376 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:23.197314    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c80e2628-6b41-45bd-b0e8-4db1c92d1ee1-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-5p8n7\" (UID: \"c80e2628-6b41-45bd-b0e8-4db1c92d1ee1\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5p8n7"
Sep 11 04:47:23.197602 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:23.197469    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gchxb\" (UniqueName: \"kubernetes.io/projected/c80e2628-6b41-45bd-b0e8-4db1c92d1ee1-kube-api-access-gchxb\") pod \"kuadrant-console-plugin-fbdd4f445-5p8n7\" (UID: \"c80e2628-6b41-45bd-b0e8-4db1c92d1ee1\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5p8n7"
Sep 11 04:47:23.197665 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:23.197605    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c80e2628-6b41-45bd-b0e8-4db1c92d1ee1-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-5p8n7\" (UID: \"c80e2628-6b41-45bd-b0e8-4db1c92d1ee1\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5p8n7"
Sep 11 04:47:23.298426 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:23.298308    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gchxb\" (UniqueName: \"kubernetes.io/projected/c80e2628-6b41-45bd-b0e8-4db1c92d1ee1-kube-api-access-gchxb\") pod \"kuadrant-console-plugin-fbdd4f445-5p8n7\" (UID: \"c80e2628-6b41-45bd-b0e8-4db1c92d1ee1\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5p8n7"
Sep 11 04:47:23.298426 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:23.298410    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c80e2628-6b41-45bd-b0e8-4db1c92d1ee1-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-5p8n7\" (UID: \"c80e2628-6b41-45bd-b0e8-4db1c92d1ee1\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5p8n7"
Sep 11 04:47:23.298615 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:23.298447    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c80e2628-6b41-45bd-b0e8-4db1c92d1ee1-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-5p8n7\" (UID: \"c80e2628-6b41-45bd-b0e8-4db1c92d1ee1\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5p8n7"
Sep 11 04:47:23.299129 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:23.299105    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c80e2628-6b41-45bd-b0e8-4db1c92d1ee1-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-5p8n7\" (UID: \"c80e2628-6b41-45bd-b0e8-4db1c92d1ee1\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5p8n7"
Sep 11 04:47:23.301122 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:23.301101    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c80e2628-6b41-45bd-b0e8-4db1c92d1ee1-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-5p8n7\" (UID: \"c80e2628-6b41-45bd-b0e8-4db1c92d1ee1\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5p8n7"
Sep 11 04:47:23.311560 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:23.311536    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gchxb\" (UniqueName: \"kubernetes.io/projected/c80e2628-6b41-45bd-b0e8-4db1c92d1ee1-kube-api-access-gchxb\") pod \"kuadrant-console-plugin-fbdd4f445-5p8n7\" (UID: \"c80e2628-6b41-45bd-b0e8-4db1c92d1ee1\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5p8n7"
Sep 11 04:47:23.361934 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:23.361900    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5p8n7"
Sep 11 04:47:23.632531 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:23.631982    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-5p8n7"]
Sep 11 04:47:23.634763 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:47:23.634734    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc80e2628_6b41_45bd_b0e8_4db1c92d1ee1.slice/crio-7aec22514c36805f4805a737a1c9fa9b8f93a808f2dc93de4f9958e869f3107e WatchSource:0}: Error finding container 7aec22514c36805f4805a737a1c9fa9b8f93a808f2dc93de4f9958e869f3107e: Status 404 returned error can't find the container with id 7aec22514c36805f4805a737a1c9fa9b8f93a808f2dc93de4f9958e869f3107e
Sep 11 04:47:23.656557 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:23.656514    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7" event={"ID":"5ef322b3-c09f-4d6a-a05e-997d557356ca","Type":"ContainerStarted","Data":"f449c295f916b3a5354657f3612fb13c4591da398c3d2cfeaca22adc0c902879"}
Sep 11 04:47:23.658091 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:23.658060    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5p8n7" event={"ID":"c80e2628-6b41-45bd-b0e8-4db1c92d1ee1","Type":"ContainerStarted","Data":"7aec22514c36805f4805a737a1c9fa9b8f93a808f2dc93de4f9958e869f3107e"}
Sep 11 04:47:24.666779 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:24.666706    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7" event={"ID":"5ef322b3-c09f-4d6a-a05e-997d557356ca","Type":"ContainerStarted","Data":"ec1d2c0bdeecce1c8d62c6130e2fcefc6097e56ec7951f6c0b2e04351bcb6f71"}
Sep 11 04:47:24.667354 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:24.667310    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"
Sep 11 04:47:24.686994 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:24.686927    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7" podStartSLOduration=1.327014455 podStartE2EDuration="2.686903509s" totalImagesPullingTime="1.359889054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:47:24.685033569 +0000 UTC m=+434.338293251" watchObservedRunningTime="2026-09-11 04:47:24.686903509 +0000 UTC m=+434.340163190"
Sep 11 04:47:26.303062 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:26.303025    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:26.303520 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:26.303105    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:26.308830 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:26.308803    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:26.682314 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:26.682285    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f94454b9d-kmvmj"
Sep 11 04:47:28.691160 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:28.691123    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5p8n7" event={"ID":"c80e2628-6b41-45bd-b0e8-4db1c92d1ee1","Type":"ContainerStarted","Data":"0ee61a917a3d4a48a18b296c3277789405333dce2f409d88d23aac692a49f7f9"}
Sep 11 04:47:28.705732 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:28.705583    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-5p8n7" podStartSLOduration=1.106788283 podStartE2EDuration="5.705561929s" totalImagesPullingTime="4.598773646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:47:28.705283231 +0000 UTC m=+438.358542912" watchObservedRunningTime="2026-09-11 04:47:28.705561929 +0000 UTC m=+438.358821611"
Sep 11 04:47:31.646522 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:31.646488    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:32.652244 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:32.652215    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-bwgqb"
Sep 11 04:47:33.660904 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.660872    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-x57zt"
Sep 11 04:47:33.893787 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.893755    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"]
Sep 11 04:47:33.893966 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.893919    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8" podUID="da8619dc-d9d5-49ee-a00c-8d9df6fd4c58" containerName="manager" containerID="cri-o://7d5b2729ab997aad75d43dd6e11cce9804d934ab1338b169d2683f3d3278638a" gracePeriod=2
Sep 11 04:47:33.898468 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.898405    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"]
Sep 11 04:47:33.916017 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.915987    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"]
Sep 11 04:47:33.916263 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.916237    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7" podUID="5ef322b3-c09f-4d6a-a05e-997d557356ca" containerName="manager" containerID="cri-o://ec1d2c0bdeecce1c8d62c6130e2fcefc6097e56ec7951f6c0b2e04351bcb6f71" gracePeriod=2
Sep 11 04:47:33.918582 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:47:33.918553    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-fftc8\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" podUID="da8619dc-d9d5-49ee-a00c-8d9df6fd4c58" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:33.918806 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.918783    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"
Sep 11 04:47:33.922467 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.922440    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx"]
Sep 11 04:47:33.923029 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.923008    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da8619dc-d9d5-49ee-a00c-8d9df6fd4c58" containerName="manager"
Sep 11 04:47:33.923148 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.923082    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="da8619dc-d9d5-49ee-a00c-8d9df6fd4c58" containerName="manager"
Sep 11 04:47:33.923226 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.923213    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="da8619dc-d9d5-49ee-a00c-8d9df6fd4c58" containerName="manager"
Sep 11 04:47:33.926814 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.926792    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"]
Sep 11 04:47:33.926925 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.926904    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx"
Sep 11 04:47:33.935692 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:47:33.935648    2554 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"5ef322b3-c09f-4d6a-a05e-997d557356ca\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-ngkp7\": pods \"limitador-operator-controller-manager-74495c69f8-ngkp7\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"
Sep 11 04:47:33.937675 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:47:33.937646    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ngkp7\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" podUID="5ef322b3-c09f-4d6a-a05e-997d557356ca" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"
Sep 11 04:47:33.939651 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:47:33.939616    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-fftc8\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" podUID="da8619dc-d9d5-49ee-a00c-8d9df6fd4c58" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:33.942289 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.942263    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-j7pdj"]
Sep 11 04:47:33.942683 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.942667    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ef322b3-c09f-4d6a-a05e-997d557356ca" containerName="manager"
Sep 11 04:47:33.942754 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.942686    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ef322b3-c09f-4d6a-a05e-997d557356ca" containerName="manager"
Sep 11 04:47:33.942811 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.942790    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ef322b3-c09f-4d6a-a05e-997d557356ca" containerName="manager"
Sep 11 04:47:33.945548 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.945528    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx"]
Sep 11 04:47:33.945645 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.945632    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-j7pdj"
Sep 11 04:47:33.958324 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.958290    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-j7pdj"]
Sep 11 04:47:33.991087 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.991059    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5swdm\" (UniqueName: \"kubernetes.io/projected/1a4b05ce-6e86-448c-88db-e92ae7bed264-kube-api-access-5swdm\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rqctx\" (UID: \"1a4b05ce-6e86-448c-88db-e92ae7bed264\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx"
Sep 11 04:47:33.991262 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:33.991134    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a4b05ce-6e86-448c-88db-e92ae7bed264-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rqctx\" (UID: \"1a4b05ce-6e86-448c-88db-e92ae7bed264\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx"
Sep 11 04:47:33.991869 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:47:33.991844    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-fftc8\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" podUID="da8619dc-d9d5-49ee-a00c-8d9df6fd4c58" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:33.993717 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:47:33.993687    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ngkp7\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" podUID="5ef322b3-c09f-4d6a-a05e-997d557356ca" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"
Sep 11 04:47:34.092287 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.092252    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a4b05ce-6e86-448c-88db-e92ae7bed264-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rqctx\" (UID: \"1a4b05ce-6e86-448c-88db-e92ae7bed264\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx"
Sep 11 04:47:34.092449 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.092324    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24x56\" (UniqueName: \"kubernetes.io/projected/c1dd2489-53df-469c-80ea-6a6a295e80a3-kube-api-access-24x56\") pod \"limitador-operator-controller-manager-74495c69f8-j7pdj\" (UID: \"c1dd2489-53df-469c-80ea-6a6a295e80a3\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-j7pdj"
Sep 11 04:47:34.092449 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.092413    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5swdm\" (UniqueName: \"kubernetes.io/projected/1a4b05ce-6e86-448c-88db-e92ae7bed264-kube-api-access-5swdm\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rqctx\" (UID: \"1a4b05ce-6e86-448c-88db-e92ae7bed264\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx"
Sep 11 04:47:34.092971 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.092949    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a4b05ce-6e86-448c-88db-e92ae7bed264-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rqctx\" (UID: \"1a4b05ce-6e86-448c-88db-e92ae7bed264\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx"
Sep 11 04:47:34.115019 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.114982    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5swdm\" (UniqueName: \"kubernetes.io/projected/1a4b05ce-6e86-448c-88db-e92ae7bed264-kube-api-access-5swdm\") pod \"kuadrant-operator-controller-manager-76f8f686bf-rqctx\" (UID: \"1a4b05ce-6e86-448c-88db-e92ae7bed264\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx"
Sep 11 04:47:34.159926 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.159893    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:34.162308 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:47:34.162248    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-fftc8\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" podUID="da8619dc-d9d5-49ee-a00c-8d9df6fd4c58" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:34.162532 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.162517    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"
Sep 11 04:47:34.164320 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:47:34.164293    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ngkp7\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" podUID="5ef322b3-c09f-4d6a-a05e-997d557356ca" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"
Sep 11 04:47:34.166977 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:47:34.166955    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ngkp7\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" podUID="5ef322b3-c09f-4d6a-a05e-997d557356ca" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"
Sep 11 04:47:34.168993 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:47:34.168970    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-fftc8\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" podUID="da8619dc-d9d5-49ee-a00c-8d9df6fd4c58" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:34.193495 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.193461    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzp9p\" (UniqueName: \"kubernetes.io/projected/5ef322b3-c09f-4d6a-a05e-997d557356ca-kube-api-access-mzp9p\") pod \"5ef322b3-c09f-4d6a-a05e-997d557356ca\" (UID: \"5ef322b3-c09f-4d6a-a05e-997d557356ca\") "
Sep 11 04:47:34.193667 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.193510    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da8619dc-d9d5-49ee-a00c-8d9df6fd4c58-extensions-socket-volume\") pod \"da8619dc-d9d5-49ee-a00c-8d9df6fd4c58\" (UID: \"da8619dc-d9d5-49ee-a00c-8d9df6fd4c58\") "
Sep 11 04:47:34.193667 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.193535    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkllc\" (UniqueName: \"kubernetes.io/projected/da8619dc-d9d5-49ee-a00c-8d9df6fd4c58-kube-api-access-lkllc\") pod \"da8619dc-d9d5-49ee-a00c-8d9df6fd4c58\" (UID: \"da8619dc-d9d5-49ee-a00c-8d9df6fd4c58\") "
Sep 11 04:47:34.193667 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.193651    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24x56\" (UniqueName: \"kubernetes.io/projected/c1dd2489-53df-469c-80ea-6a6a295e80a3-kube-api-access-24x56\") pod \"limitador-operator-controller-manager-74495c69f8-j7pdj\" (UID: \"c1dd2489-53df-469c-80ea-6a6a295e80a3\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-j7pdj"
Sep 11 04:47:34.194088 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.194064    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da8619dc-d9d5-49ee-a00c-8d9df6fd4c58-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "da8619dc-d9d5-49ee-a00c-8d9df6fd4c58" (UID: "da8619dc-d9d5-49ee-a00c-8d9df6fd4c58"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:47:34.195821 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.195799    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ef322b3-c09f-4d6a-a05e-997d557356ca-kube-api-access-mzp9p" (OuterVolumeSpecName: "kube-api-access-mzp9p") pod "5ef322b3-c09f-4d6a-a05e-997d557356ca" (UID: "5ef322b3-c09f-4d6a-a05e-997d557356ca"). InnerVolumeSpecName "kube-api-access-mzp9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:47:34.195915 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.195880    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da8619dc-d9d5-49ee-a00c-8d9df6fd4c58-kube-api-access-lkllc" (OuterVolumeSpecName: "kube-api-access-lkllc") pod "da8619dc-d9d5-49ee-a00c-8d9df6fd4c58" (UID: "da8619dc-d9d5-49ee-a00c-8d9df6fd4c58"). InnerVolumeSpecName "kube-api-access-lkllc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:47:34.209767 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.209729    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24x56\" (UniqueName: \"kubernetes.io/projected/c1dd2489-53df-469c-80ea-6a6a295e80a3-kube-api-access-24x56\") pod \"limitador-operator-controller-manager-74495c69f8-j7pdj\" (UID: \"c1dd2489-53df-469c-80ea-6a6a295e80a3\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-j7pdj"
Sep 11 04:47:34.294435 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.294398    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzp9p\" (UniqueName: \"kubernetes.io/projected/5ef322b3-c09f-4d6a-a05e-997d557356ca-kube-api-access-mzp9p\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:47:34.294435 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.294425    2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/da8619dc-d9d5-49ee-a00c-8d9df6fd4c58-extensions-socket-volume\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:47:34.294435 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.294434    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkllc\" (UniqueName: \"kubernetes.io/projected/da8619dc-d9d5-49ee-a00c-8d9df6fd4c58-kube-api-access-lkllc\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:47:34.312296 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.312262    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx"
Sep 11 04:47:34.318470 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.318444    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-j7pdj"
Sep 11 04:47:34.600226 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.600142    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx"]
Sep 11 04:47:34.605923 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:47:34.605887    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a4b05ce_6e86_448c_88db_e92ae7bed264.slice/crio-0930044085b1126641bdfd1c72c6cf2a8b537f47a6e7dae8fe42b7125207fab2 WatchSource:0}: Error finding container 0930044085b1126641bdfd1c72c6cf2a8b537f47a6e7dae8fe42b7125207fab2: Status 404 returned error can't find the container with id 0930044085b1126641bdfd1c72c6cf2a8b537f47a6e7dae8fe42b7125207fab2
Sep 11 04:47:34.606033 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.605962    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-j7pdj"]
Sep 11 04:47:34.607830 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:47:34.607805    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1dd2489_53df_469c_80ea_6a6a295e80a3.slice/crio-2a1e89b299d03e0a388461601ad8007cf3f32282faa4595fa5c6b77ffb8a4339 WatchSource:0}: Error finding container 2a1e89b299d03e0a388461601ad8007cf3f32282faa4595fa5c6b77ffb8a4339: Status 404 returned error can't find the container with id 2a1e89b299d03e0a388461601ad8007cf3f32282faa4595fa5c6b77ffb8a4339
Sep 11 04:47:34.722636 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.722603    2554 generic.go:356] "Generic (PLEG): container finished" podID="da8619dc-d9d5-49ee-a00c-8d9df6fd4c58" containerID="7d5b2729ab997aad75d43dd6e11cce9804d934ab1338b169d2683f3d3278638a" exitCode=0
Sep 11 04:47:34.723067 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.722660    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:34.723067 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.722702    2554 scope.go:117] "RemoveContainer" containerID="7d5b2729ab997aad75d43dd6e11cce9804d934ab1338b169d2683f3d3278638a"
Sep 11 04:47:34.724286 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.724259    2554 generic.go:356] "Generic (PLEG): container finished" podID="5ef322b3-c09f-4d6a-a05e-997d557356ca" containerID="ec1d2c0bdeecce1c8d62c6130e2fcefc6097e56ec7951f6c0b2e04351bcb6f71" exitCode=0
Sep 11 04:47:34.724423 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.724319    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"
Sep 11 04:47:34.725161 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:47:34.725131    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-fftc8\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" podUID="da8619dc-d9d5-49ee-a00c-8d9df6fd4c58" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:34.726442 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.726417    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-j7pdj" event={"ID":"c1dd2489-53df-469c-80ea-6a6a295e80a3","Type":"ContainerStarted","Data":"2ff191529ad457d2c713d5dfecb0194576ef180586b325eb046cd0b1517590b6"}
Sep 11 04:47:34.726709 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.726471    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-j7pdj" event={"ID":"c1dd2489-53df-469c-80ea-6a6a295e80a3","Type":"ContainerStarted","Data":"2a1e89b299d03e0a388461601ad8007cf3f32282faa4595fa5c6b77ffb8a4339"}
Sep 11 04:47:34.726709 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.726553    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-j7pdj"
Sep 11 04:47:34.727869 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:47:34.727839    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ngkp7\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" podUID="5ef322b3-c09f-4d6a-a05e-997d557356ca" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"
Sep 11 04:47:34.728588 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.728561    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx" event={"ID":"1a4b05ce-6e86-448c-88db-e92ae7bed264","Type":"ContainerStarted","Data":"a99b3c066da81da6cb69fde29c85d4113f6648618acf4ba250574d4b13d5eac5"}
Sep 11 04:47:34.728670 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.728607    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx" event={"ID":"1a4b05ce-6e86-448c-88db-e92ae7bed264","Type":"ContainerStarted","Data":"0930044085b1126641bdfd1c72c6cf2a8b537f47a6e7dae8fe42b7125207fab2"}
Sep 11 04:47:34.728718 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.728684    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx"
Sep 11 04:47:34.729785 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:47:34.729762    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ngkp7\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" podUID="5ef322b3-c09f-4d6a-a05e-997d557356ca" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"
Sep 11 04:47:34.733010 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.732989    2554 scope.go:117] "RemoveContainer" containerID="7d5b2729ab997aad75d43dd6e11cce9804d934ab1338b169d2683f3d3278638a"
Sep 11 04:47:34.733402 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:47:34.733377    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d5b2729ab997aad75d43dd6e11cce9804d934ab1338b169d2683f3d3278638a\": container with ID starting with 7d5b2729ab997aad75d43dd6e11cce9804d934ab1338b169d2683f3d3278638a not found: ID does not exist" containerID="7d5b2729ab997aad75d43dd6e11cce9804d934ab1338b169d2683f3d3278638a"
Sep 11 04:47:34.733489 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.733416    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d5b2729ab997aad75d43dd6e11cce9804d934ab1338b169d2683f3d3278638a"} err="failed to get container status \"7d5b2729ab997aad75d43dd6e11cce9804d934ab1338b169d2683f3d3278638a\": rpc error: code = NotFound desc = could not find container \"7d5b2729ab997aad75d43dd6e11cce9804d934ab1338b169d2683f3d3278638a\": container with ID starting with 7d5b2729ab997aad75d43dd6e11cce9804d934ab1338b169d2683f3d3278638a not found: ID does not exist"
Sep 11 04:47:34.733489 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.733441    2554 scope.go:117] "RemoveContainer" containerID="ec1d2c0bdeecce1c8d62c6130e2fcefc6097e56ec7951f6c0b2e04351bcb6f71"
Sep 11 04:47:34.742059 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.742038    2554 scope.go:117] "RemoveContainer" containerID="ec1d2c0bdeecce1c8d62c6130e2fcefc6097e56ec7951f6c0b2e04351bcb6f71"
Sep 11 04:47:34.742399 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:47:34.742377    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec1d2c0bdeecce1c8d62c6130e2fcefc6097e56ec7951f6c0b2e04351bcb6f71\": container with ID starting with ec1d2c0bdeecce1c8d62c6130e2fcefc6097e56ec7951f6c0b2e04351bcb6f71 not found: ID does not exist" containerID="ec1d2c0bdeecce1c8d62c6130e2fcefc6097e56ec7951f6c0b2e04351bcb6f71"
Sep 11 04:47:34.742478 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.742407    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec1d2c0bdeecce1c8d62c6130e2fcefc6097e56ec7951f6c0b2e04351bcb6f71"} err="failed to get container status \"ec1d2c0bdeecce1c8d62c6130e2fcefc6097e56ec7951f6c0b2e04351bcb6f71\": rpc error: code = NotFound desc = could not find container \"ec1d2c0bdeecce1c8d62c6130e2fcefc6097e56ec7951f6c0b2e04351bcb6f71\": container with ID starting with ec1d2c0bdeecce1c8d62c6130e2fcefc6097e56ec7951f6c0b2e04351bcb6f71 not found: ID does not exist"
Sep 11 04:47:34.751605 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.751565    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-j7pdj" podStartSLOduration=1.751550194 podStartE2EDuration="1.751550194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:47:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:47:34.750473688 +0000 UTC m=+444.403733390" watchObservedRunningTime="2026-09-11 04:47:34.751550194 +0000 UTC m=+444.404809878"
Sep 11 04:47:34.752806 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:47:34.752783    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-fftc8\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" podUID="da8619dc-d9d5-49ee-a00c-8d9df6fd4c58" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:34.754556 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:47:34.754535    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ngkp7\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" podUID="5ef322b3-c09f-4d6a-a05e-997d557356ca" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ngkp7"
Sep 11 04:47:34.756176 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:47:34.756157    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-fftc8\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" podUID="da8619dc-d9d5-49ee-a00c-8d9df6fd4c58" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-fftc8"
Sep 11 04:47:34.778048 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.777995    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx" podStartSLOduration=1.7779764340000002 podStartE2EDuration="1.777976434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:47:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:47:34.776697126 +0000 UTC m=+444.429956809" watchObservedRunningTime="2026-09-11 04:47:34.777976434 +0000 UTC m=+444.431236113"
Sep 11 04:47:34.814731 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.814683    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ef322b3-c09f-4d6a-a05e-997d557356ca" path="/var/lib/kubelet/pods/5ef322b3-c09f-4d6a-a05e-997d557356ca/volumes"
Sep 11 04:47:34.815289 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:34.815270    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da8619dc-d9d5-49ee-a00c-8d9df6fd4c58" path="/var/lib/kubelet/pods/da8619dc-d9d5-49ee-a00c-8d9df6fd4c58/volumes"
Sep 11 04:47:45.737206 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:45.737172    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-j7pdj"
Sep 11 04:47:45.737680 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:45.737249    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx"
Sep 11 04:47:51.240700 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:51.240669    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx"]
Sep 11 04:47:51.241149 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:51.240870    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx" podUID="1a4b05ce-6e86-448c-88db-e92ae7bed264" containerName="manager" containerID="cri-o://a99b3c066da81da6cb69fde29c85d4113f6648618acf4ba250574d4b13d5eac5" gracePeriod=10
Sep 11 04:47:51.824655 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:51.824621    2554 generic.go:356] "Generic (PLEG): container finished" podID="1a4b05ce-6e86-448c-88db-e92ae7bed264" containerID="a99b3c066da81da6cb69fde29c85d4113f6648618acf4ba250574d4b13d5eac5" exitCode=0
Sep 11 04:47:51.824811 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:51.824718    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx" event={"ID":"1a4b05ce-6e86-448c-88db-e92ae7bed264","Type":"ContainerDied","Data":"a99b3c066da81da6cb69fde29c85d4113f6648618acf4ba250574d4b13d5eac5"}
Sep 11 04:47:51.900314 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:51.900282    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx"
Sep 11 04:47:51.944269 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:51.944235    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5swdm\" (UniqueName: \"kubernetes.io/projected/1a4b05ce-6e86-448c-88db-e92ae7bed264-kube-api-access-5swdm\") pod \"1a4b05ce-6e86-448c-88db-e92ae7bed264\" (UID: \"1a4b05ce-6e86-448c-88db-e92ae7bed264\") "
Sep 11 04:47:51.944461 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:51.944377    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a4b05ce-6e86-448c-88db-e92ae7bed264-extensions-socket-volume\") pod \"1a4b05ce-6e86-448c-88db-e92ae7bed264\" (UID: \"1a4b05ce-6e86-448c-88db-e92ae7bed264\") "
Sep 11 04:47:51.944767 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:51.944741    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a4b05ce-6e86-448c-88db-e92ae7bed264-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1a4b05ce-6e86-448c-88db-e92ae7bed264" (UID: "1a4b05ce-6e86-448c-88db-e92ae7bed264"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:47:51.946638 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:51.946584    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a4b05ce-6e86-448c-88db-e92ae7bed264-kube-api-access-5swdm" (OuterVolumeSpecName: "kube-api-access-5swdm") pod "1a4b05ce-6e86-448c-88db-e92ae7bed264" (UID: "1a4b05ce-6e86-448c-88db-e92ae7bed264"). InnerVolumeSpecName "kube-api-access-5swdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:47:52.045389 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:52.045352    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5swdm\" (UniqueName: \"kubernetes.io/projected/1a4b05ce-6e86-448c-88db-e92ae7bed264-kube-api-access-5swdm\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:47:52.045389 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:52.045383    2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1a4b05ce-6e86-448c-88db-e92ae7bed264-extensions-socket-volume\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:47:52.830494 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:52.830469    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx"
Sep 11 04:47:52.830494 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:52.830478    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx" event={"ID":"1a4b05ce-6e86-448c-88db-e92ae7bed264","Type":"ContainerDied","Data":"0930044085b1126641bdfd1c72c6cf2a8b537f47a6e7dae8fe42b7125207fab2"}
Sep 11 04:47:52.830968 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:52.830531    2554 scope.go:117] "RemoveContainer" containerID="a99b3c066da81da6cb69fde29c85d4113f6648618acf4ba250574d4b13d5eac5"
Sep 11 04:47:52.851256 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:52.851227    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx"]
Sep 11 04:47:52.855577 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:52.855550    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-rqctx"]
Sep 11 04:47:54.812783 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:47:54.812745    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a4b05ce-6e86-448c-88db-e92ae7bed264" path="/var/lib/kubelet/pods/1a4b05ce-6e86-448c-88db-e92ae7bed264/volumes"
Sep 11 04:48:07.507298 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.507262    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"]
Sep 11 04:48:07.507933 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.507797    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a4b05ce-6e86-448c-88db-e92ae7bed264" containerName="manager"
Sep 11 04:48:07.507933 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.507817    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a4b05ce-6e86-448c-88db-e92ae7bed264" containerName="manager"
Sep 11 04:48:07.507933 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.507923    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a4b05ce-6e86-448c-88db-e92ae7bed264" containerName="manager"
Sep 11 04:48:07.509818 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.509800    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.511843 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.511820    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 04:48:07.511959 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.511880    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-sj2xd\""
Sep 11 04:48:07.521530 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.521503    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"]
Sep 11 04:48:07.578315 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.578280    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21933563-dab2-4f0b-88f2-c34a1d828d43-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.578315 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.578315    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21933563-dab2-4f0b-88f2-c34a1d828d43-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.578554 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.578401    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21933563-dab2-4f0b-88f2-c34a1d828d43-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.578554 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.578428    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21933563-dab2-4f0b-88f2-c34a1d828d43-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.578554 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.578453    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21933563-dab2-4f0b-88f2-c34a1d828d43-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.578554 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.578485    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21933563-dab2-4f0b-88f2-c34a1d828d43-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.578554 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.578517    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21933563-dab2-4f0b-88f2-c34a1d828d43-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.578736 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.578570    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfbtv\" (UniqueName: \"kubernetes.io/projected/21933563-dab2-4f0b-88f2-c34a1d828d43-kube-api-access-cfbtv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.578736 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.578597    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21933563-dab2-4f0b-88f2-c34a1d828d43-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.679027 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.678984    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21933563-dab2-4f0b-88f2-c34a1d828d43-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.679226 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.679048    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21933563-dab2-4f0b-88f2-c34a1d828d43-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.679226 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.679073    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21933563-dab2-4f0b-88f2-c34a1d828d43-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.679226 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.679121    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21933563-dab2-4f0b-88f2-c34a1d828d43-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.679226 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.679148    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21933563-dab2-4f0b-88f2-c34a1d828d43-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.679226 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.679183    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21933563-dab2-4f0b-88f2-c34a1d828d43-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.679226 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.679218    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21933563-dab2-4f0b-88f2-c34a1d828d43-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.679571 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.679241    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21933563-dab2-4f0b-88f2-c34a1d828d43-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.679571 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.679275    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfbtv\" (UniqueName: \"kubernetes.io/projected/21933563-dab2-4f0b-88f2-c34a1d828d43-kube-api-access-cfbtv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.679571 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.679456    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21933563-dab2-4f0b-88f2-c34a1d828d43-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.679571 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.679511    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21933563-dab2-4f0b-88f2-c34a1d828d43-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.679571 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.679550    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21933563-dab2-4f0b-88f2-c34a1d828d43-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.679762 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.679687    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21933563-dab2-4f0b-88f2-c34a1d828d43-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.680293 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.680266    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21933563-dab2-4f0b-88f2-c34a1d828d43-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.681722 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.681699    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21933563-dab2-4f0b-88f2-c34a1d828d43-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.681813 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.681797    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21933563-dab2-4f0b-88f2-c34a1d828d43-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.688547 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.688517    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21933563-dab2-4f0b-88f2-c34a1d828d43-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.688678 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.688602    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfbtv\" (UniqueName: \"kubernetes.io/projected/21933563-dab2-4f0b-88f2-c34a1d828d43-kube-api-access-cfbtv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-hnzbr\" (UID: \"21933563-dab2-4f0b-88f2-c34a1d828d43\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:07.820198 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:07.820112    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:08.091509 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:08.091437    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"]
Sep 11 04:48:08.094381 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:48:08.094356    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21933563_dab2_4f0b_88f2_c34a1d828d43.slice/crio-f14754273848db085fe04780006aff2979372c4053f45cc3fedf8cbcd8c99068 WatchSource:0}: Error finding container f14754273848db085fe04780006aff2979372c4053f45cc3fedf8cbcd8c99068: Status 404 returned error can't find the container with id f14754273848db085fe04780006aff2979372c4053f45cc3fedf8cbcd8c99068
Sep 11 04:48:08.912561 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:08.912514    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr" event={"ID":"21933563-dab2-4f0b-88f2-c34a1d828d43","Type":"ContainerStarted","Data":"f14754273848db085fe04780006aff2979372c4053f45cc3fedf8cbcd8c99068"}
Sep 11 04:48:10.532801 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:10.532764    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:48:10.533056 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:10.532842    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:48:10.533056 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:10.532874    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:48:10.924549 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:10.924509    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr" event={"ID":"21933563-dab2-4f0b-88f2-c34a1d828d43","Type":"ContainerStarted","Data":"0adcafb3f5450c7a6b6a2857abe2c9a89e8ed15bfe70f67a0a967a6987e04238"}
Sep 11 04:48:10.962608 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:10.962559    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr" podStartSLOduration=1.526383589 podStartE2EDuration="3.962541323s" totalImagesPullingTime="2.436157734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:48:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:48:10.959982344 +0000 UTC m=+480.613242027" watchObservedRunningTime="2026-09-11 04:48:10.962541323 +0000 UTC m=+480.615801003"
Sep 11 04:48:11.820300 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:11.820255    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:11.825157 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:11.825130    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:11.929633 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:11.929602    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:11.930675 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:11.930656    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:48:12.010542 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.010502    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-722hv"]
Sep 11 04:48:12.014087 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.014065    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-722hv"
Sep 11 04:48:12.016208 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.016184    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 04:48:12.024435 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.024413    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-722hv"]
Sep 11 04:48:12.110036 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.109957    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-722hv"]
Sep 11 04:48:12.120436 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.120412    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cead217d-2dc6-4767-9ba7-5c69b557382a-config-file\") pod \"limitador-limitador-8588749977-722hv\" (UID: \"cead217d-2dc6-4767-9ba7-5c69b557382a\") " pod="kuadrant-system/limitador-limitador-8588749977-722hv"
Sep 11 04:48:12.120566 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.120470    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbx5v\" (UniqueName: \"kubernetes.io/projected/cead217d-2dc6-4767-9ba7-5c69b557382a-kube-api-access-nbx5v\") pod \"limitador-limitador-8588749977-722hv\" (UID: \"cead217d-2dc6-4767-9ba7-5c69b557382a\") " pod="kuadrant-system/limitador-limitador-8588749977-722hv"
Sep 11 04:48:12.222051 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.222014    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbx5v\" (UniqueName: \"kubernetes.io/projected/cead217d-2dc6-4767-9ba7-5c69b557382a-kube-api-access-nbx5v\") pod \"limitador-limitador-8588749977-722hv\" (UID: \"cead217d-2dc6-4767-9ba7-5c69b557382a\") " pod="kuadrant-system/limitador-limitador-8588749977-722hv"
Sep 11 04:48:12.222224 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.222104    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cead217d-2dc6-4767-9ba7-5c69b557382a-config-file\") pod \"limitador-limitador-8588749977-722hv\" (UID: \"cead217d-2dc6-4767-9ba7-5c69b557382a\") " pod="kuadrant-system/limitador-limitador-8588749977-722hv"
Sep 11 04:48:12.222715 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.222698    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cead217d-2dc6-4767-9ba7-5c69b557382a-config-file\") pod \"limitador-limitador-8588749977-722hv\" (UID: \"cead217d-2dc6-4767-9ba7-5c69b557382a\") " pod="kuadrant-system/limitador-limitador-8588749977-722hv"
Sep 11 04:48:12.232563 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.232537    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbx5v\" (UniqueName: \"kubernetes.io/projected/cead217d-2dc6-4767-9ba7-5c69b557382a-kube-api-access-nbx5v\") pod \"limitador-limitador-8588749977-722hv\" (UID: \"cead217d-2dc6-4767-9ba7-5c69b557382a\") " pod="kuadrant-system/limitador-limitador-8588749977-722hv"
Sep 11 04:48:12.324798 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.324761    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-722hv"
Sep 11 04:48:12.403652 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.403625    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:48:12.406624 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.406606    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"
Sep 11 04:48:12.414834 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.414812    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:48:12.452344 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.452306    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:48:12.523982 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.523946    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64xpb\" (UniqueName: \"kubernetes.io/projected/71951837-9654-487e-b4d2-b8b32a42b60b-kube-api-access-64xpb\") pod \"limitador-limitador-84994f7ffc-6mjjj\" (UID: \"71951837-9654-487e-b4d2-b8b32a42b60b\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"
Sep 11 04:48:12.524149 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.524015    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/71951837-9654-487e-b4d2-b8b32a42b60b-config-file\") pod \"limitador-limitador-84994f7ffc-6mjjj\" (UID: \"71951837-9654-487e-b4d2-b8b32a42b60b\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"
Sep 11 04:48:12.596737 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.596705    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-722hv"]
Sep 11 04:48:12.600188 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:48:12.600152    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcead217d_2dc6_4767_9ba7_5c69b557382a.slice/crio-cf38e3e9633269457f3a1e137d3b95c5f1d4da390dd233f8b7122fd6fbbe43e7 WatchSource:0}: Error finding container cf38e3e9633269457f3a1e137d3b95c5f1d4da390dd233f8b7122fd6fbbe43e7: Status 404 returned error can't find the container with id cf38e3e9633269457f3a1e137d3b95c5f1d4da390dd233f8b7122fd6fbbe43e7
Sep 11 04:48:12.624729 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.624651    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64xpb\" (UniqueName: \"kubernetes.io/projected/71951837-9654-487e-b4d2-b8b32a42b60b-kube-api-access-64xpb\") pod \"limitador-limitador-84994f7ffc-6mjjj\" (UID: \"71951837-9654-487e-b4d2-b8b32a42b60b\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"
Sep 11 04:48:12.624729 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.624715    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/71951837-9654-487e-b4d2-b8b32a42b60b-config-file\") pod \"limitador-limitador-84994f7ffc-6mjjj\" (UID: \"71951837-9654-487e-b4d2-b8b32a42b60b\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"
Sep 11 04:48:12.625272 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.625253    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/71951837-9654-487e-b4d2-b8b32a42b60b-config-file\") pod \"limitador-limitador-84994f7ffc-6mjjj\" (UID: \"71951837-9654-487e-b4d2-b8b32a42b60b\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"
Sep 11 04:48:12.632426 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.632401    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64xpb\" (UniqueName: \"kubernetes.io/projected/71951837-9654-487e-b4d2-b8b32a42b60b-kube-api-access-64xpb\") pod \"limitador-limitador-84994f7ffc-6mjjj\" (UID: \"71951837-9654-487e-b4d2-b8b32a42b60b\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"
Sep 11 04:48:12.718528 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.718493    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"
Sep 11 04:48:12.935591 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.935558    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-722hv" event={"ID":"cead217d-2dc6-4767-9ba7-5c69b557382a","Type":"ContainerStarted","Data":"cf38e3e9633269457f3a1e137d3b95c5f1d4da390dd233f8b7122fd6fbbe43e7"}
Sep 11 04:48:12.986607 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.986573    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-cg5vs"]
Sep 11 04:48:12.989290 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.989273    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-cg5vs"
Sep 11 04:48:12.992647 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:12.992628    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6zshq\""
Sep 11 04:48:13.004257 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:13.004236    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:48:13.006571 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:48:13.006540    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71951837_9654_487e_b4d2_b8b32a42b60b.slice/crio-5a7fd5ad64277fd697eb0e0a5099788d435b956fd10bfcb33fd8c27ab00ffdc8 WatchSource:0}: Error finding container 5a7fd5ad64277fd697eb0e0a5099788d435b956fd10bfcb33fd8c27ab00ffdc8: Status 404 returned error can't find the container with id 5a7fd5ad64277fd697eb0e0a5099788d435b956fd10bfcb33fd8c27ab00ffdc8
Sep 11 04:48:13.008428 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:13.008407    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-cg5vs"]
Sep 11 04:48:13.129168 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:13.129136    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbrxm\" (UniqueName: \"kubernetes.io/projected/416cd5f3-06c5-439d-9525-62565693f183-kube-api-access-fbrxm\") pod \"authorino-59c974bd48-cg5vs\" (UID: \"416cd5f3-06c5-439d-9525-62565693f183\") " pod="kuadrant-system/authorino-59c974bd48-cg5vs"
Sep 11 04:48:13.230437 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:13.230313    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbrxm\" (UniqueName: \"kubernetes.io/projected/416cd5f3-06c5-439d-9525-62565693f183-kube-api-access-fbrxm\") pod \"authorino-59c974bd48-cg5vs\" (UID: \"416cd5f3-06c5-439d-9525-62565693f183\") " pod="kuadrant-system/authorino-59c974bd48-cg5vs"
Sep 11 04:48:13.239733 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:13.239706    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbrxm\" (UniqueName: \"kubernetes.io/projected/416cd5f3-06c5-439d-9525-62565693f183-kube-api-access-fbrxm\") pod \"authorino-59c974bd48-cg5vs\" (UID: \"416cd5f3-06c5-439d-9525-62565693f183\") " pod="kuadrant-system/authorino-59c974bd48-cg5vs"
Sep 11 04:48:13.298168 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:13.298120    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-cg5vs"
Sep 11 04:48:13.583297 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:13.583272    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-cg5vs"]
Sep 11 04:48:13.585989 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:48:13.585959    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod416cd5f3_06c5_439d_9525_62565693f183.slice/crio-5c695517ffe10844a7b42777752b03603d819aebc47e6f1af7e3929cda4771a2 WatchSource:0}: Error finding container 5c695517ffe10844a7b42777752b03603d819aebc47e6f1af7e3929cda4771a2: Status 404 returned error can't find the container with id 5c695517ffe10844a7b42777752b03603d819aebc47e6f1af7e3929cda4771a2
Sep 11 04:48:13.941476 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:13.941441    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-cg5vs" event={"ID":"416cd5f3-06c5-439d-9525-62565693f183","Type":"ContainerStarted","Data":"5c695517ffe10844a7b42777752b03603d819aebc47e6f1af7e3929cda4771a2"}
Sep 11 04:48:13.943055 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:13.943016    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-6mjjj" event={"ID":"71951837-9654-487e-b4d2-b8b32a42b60b","Type":"ContainerStarted","Data":"a28a053d6c608d690a44aa2bfb33d4a7cb8e694c8ca31cd58363e1c320c60deb"}
Sep 11 04:48:13.943193 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:13.943103    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-6mjjj" event={"ID":"71951837-9654-487e-b4d2-b8b32a42b60b","Type":"ContainerStarted","Data":"5a7fd5ad64277fd697eb0e0a5099788d435b956fd10bfcb33fd8c27ab00ffdc8"}
Sep 11 04:48:13.943193 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:13.943134    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"
Sep 11 04:48:13.944465 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:13.944438    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-722hv" event={"ID":"cead217d-2dc6-4767-9ba7-5c69b557382a","Type":"ContainerStarted","Data":"69643c05476897eaf21297de1f7ebd15d03b0cfea66ea66562d22e881de929de"}
Sep 11 04:48:13.944577 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:13.944561    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-722hv"
Sep 11 04:48:13.962916 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:13.962871    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-6mjjj" podStartSLOduration=1.38591288 podStartE2EDuration="1.96285563s" totalImagesPullingTime="576.94275ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:48:13.961289287 +0000 UTC m=+483.614548994" watchObservedRunningTime="2026-09-11 04:48:13.96285563 +0000 UTC m=+483.616115310"
Sep 11 04:48:13.977969 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:13.977922    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-722hv" podStartSLOduration=1.9967554509999998 podStartE2EDuration="2.977906627s" totalImagesPullingTime="981.151176ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:48:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:48:13.977279807 +0000 UTC m=+483.630539524" watchObservedRunningTime="2026-09-11 04:48:13.977906627 +0000 UTC m=+483.631166307"
Sep 11 04:48:15.957868 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:15.957832    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-cg5vs" event={"ID":"416cd5f3-06c5-439d-9525-62565693f183","Type":"ContainerStarted","Data":"745bf40215ed163a4e3dab912ea65849443f7e234a14eda04a5dd63480912237"}
Sep 11 04:48:15.972509 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:15.972459    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-cg5vs" podStartSLOduration=2.5026311 podStartE2EDuration="3.972444173s" totalImagesPullingTime="1.469813073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:48:15.970524187 +0000 UTC m=+485.623783866" watchObservedRunningTime="2026-09-11 04:48:15.972444173 +0000 UTC m=+485.625703854"
Sep 11 04:48:24.952191 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:24.952159    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-722hv"
Sep 11 04:48:24.952688 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:24.952354    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"
Sep 11 04:48:25.022641 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:25.022605    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-722hv"]
Sep 11 04:48:25.022840 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:25.022816    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-722hv" podUID="cead217d-2dc6-4767-9ba7-5c69b557382a" containerName="limitador" containerID="cri-o://69643c05476897eaf21297de1f7ebd15d03b0cfea66ea66562d22e881de929de" gracePeriod=30
Sep 11 04:48:25.974226 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:25.974201    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-722hv"
Sep 11 04:48:26.010011 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:26.009975    2554 generic.go:356] "Generic (PLEG): container finished" podID="cead217d-2dc6-4767-9ba7-5c69b557382a" containerID="69643c05476897eaf21297de1f7ebd15d03b0cfea66ea66562d22e881de929de" exitCode=0
Sep 11 04:48:26.010193 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:26.010065    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-722hv"
Sep 11 04:48:26.010193 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:26.010083    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-722hv" event={"ID":"cead217d-2dc6-4767-9ba7-5c69b557382a","Type":"ContainerDied","Data":"69643c05476897eaf21297de1f7ebd15d03b0cfea66ea66562d22e881de929de"}
Sep 11 04:48:26.010193 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:26.010143    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-722hv" event={"ID":"cead217d-2dc6-4767-9ba7-5c69b557382a","Type":"ContainerDied","Data":"cf38e3e9633269457f3a1e137d3b95c5f1d4da390dd233f8b7122fd6fbbe43e7"}
Sep 11 04:48:26.010193 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:26.010176    2554 scope.go:117] "RemoveContainer" containerID="69643c05476897eaf21297de1f7ebd15d03b0cfea66ea66562d22e881de929de"
Sep 11 04:48:26.019106 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:26.019087    2554 scope.go:117] "RemoveContainer" containerID="69643c05476897eaf21297de1f7ebd15d03b0cfea66ea66562d22e881de929de"
Sep 11 04:48:26.019438 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:48:26.019419    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69643c05476897eaf21297de1f7ebd15d03b0cfea66ea66562d22e881de929de\": container with ID starting with 69643c05476897eaf21297de1f7ebd15d03b0cfea66ea66562d22e881de929de not found: ID does not exist" containerID="69643c05476897eaf21297de1f7ebd15d03b0cfea66ea66562d22e881de929de"
Sep 11 04:48:26.019486 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:26.019447    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69643c05476897eaf21297de1f7ebd15d03b0cfea66ea66562d22e881de929de"} err="failed to get container status \"69643c05476897eaf21297de1f7ebd15d03b0cfea66ea66562d22e881de929de\": rpc error: code = NotFound desc = could not find container \"69643c05476897eaf21297de1f7ebd15d03b0cfea66ea66562d22e881de929de\": container with ID starting with 69643c05476897eaf21297de1f7ebd15d03b0cfea66ea66562d22e881de929de not found: ID does not exist"
Sep 11 04:48:26.149047 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:26.148962    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cead217d-2dc6-4767-9ba7-5c69b557382a-config-file\") pod \"cead217d-2dc6-4767-9ba7-5c69b557382a\" (UID: \"cead217d-2dc6-4767-9ba7-5c69b557382a\") "
Sep 11 04:48:26.149189 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:26.149071    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbx5v\" (UniqueName: \"kubernetes.io/projected/cead217d-2dc6-4767-9ba7-5c69b557382a-kube-api-access-nbx5v\") pod \"cead217d-2dc6-4767-9ba7-5c69b557382a\" (UID: \"cead217d-2dc6-4767-9ba7-5c69b557382a\") "
Sep 11 04:48:26.149451 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:26.149409    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cead217d-2dc6-4767-9ba7-5c69b557382a-config-file" (OuterVolumeSpecName: "config-file") pod "cead217d-2dc6-4767-9ba7-5c69b557382a" (UID: "cead217d-2dc6-4767-9ba7-5c69b557382a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:48:26.151294 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:26.151268    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cead217d-2dc6-4767-9ba7-5c69b557382a-kube-api-access-nbx5v" (OuterVolumeSpecName: "kube-api-access-nbx5v") pod "cead217d-2dc6-4767-9ba7-5c69b557382a" (UID: "cead217d-2dc6-4767-9ba7-5c69b557382a"). InnerVolumeSpecName "kube-api-access-nbx5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:48:26.250639 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:26.250582    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbx5v\" (UniqueName: \"kubernetes.io/projected/cead217d-2dc6-4767-9ba7-5c69b557382a-kube-api-access-nbx5v\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:48:26.250639 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:26.250631    2554 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/cead217d-2dc6-4767-9ba7-5c69b557382a-config-file\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:48:26.332012 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:26.331982    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-722hv"]
Sep 11 04:48:26.333757 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:26.333739    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-722hv"]
Sep 11 04:48:26.813628 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:26.813594    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cead217d-2dc6-4767-9ba7-5c69b557382a" path="/var/lib/kubelet/pods/cead217d-2dc6-4767-9ba7-5c69b557382a/volumes"
Sep 11 04:48:40.987644 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:40.987610    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-7jqhw"]
Sep 11 04:48:40.988154 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:40.987957    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cead217d-2dc6-4767-9ba7-5c69b557382a" containerName="limitador"
Sep 11 04:48:40.988154 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:40.987968    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cead217d-2dc6-4767-9ba7-5c69b557382a" containerName="limitador"
Sep 11 04:48:40.988154 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:40.988038    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cead217d-2dc6-4767-9ba7-5c69b557382a" containerName="limitador"
Sep 11 04:48:40.991059 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:40.991041    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-7jqhw"
Sep 11 04:48:41.000114 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:41.000090    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-7jqhw"]
Sep 11 04:48:41.076300 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:41.076265    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84tfv\" (UniqueName: \"kubernetes.io/projected/6a90f185-61bd-4393-8174-8615ad1f3608-kube-api-access-84tfv\") pod \"authorino-557f876f69-7jqhw\" (UID: \"6a90f185-61bd-4393-8174-8615ad1f3608\") " pod="kuadrant-system/authorino-557f876f69-7jqhw"
Sep 11 04:48:41.177862 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:41.177821    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84tfv\" (UniqueName: \"kubernetes.io/projected/6a90f185-61bd-4393-8174-8615ad1f3608-kube-api-access-84tfv\") pod \"authorino-557f876f69-7jqhw\" (UID: \"6a90f185-61bd-4393-8174-8615ad1f3608\") " pod="kuadrant-system/authorino-557f876f69-7jqhw"
Sep 11 04:48:41.185770 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:41.185736    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84tfv\" (UniqueName: \"kubernetes.io/projected/6a90f185-61bd-4393-8174-8615ad1f3608-kube-api-access-84tfv\") pod \"authorino-557f876f69-7jqhw\" (UID: \"6a90f185-61bd-4393-8174-8615ad1f3608\") " pod="kuadrant-system/authorino-557f876f69-7jqhw"
Sep 11 04:48:41.208067 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:41.208039    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-7jqhw"]
Sep 11 04:48:41.208284 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:41.208273    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-7jqhw"
Sep 11 04:48:41.480423 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:41.480395    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-7jqhw"]
Sep 11 04:48:41.482703 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:48:41.482671    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a90f185_61bd_4393_8174_8615ad1f3608.slice/crio-f5be200adbca2875bffa72bacd07ff0cf5bc822e9b8bc566d0eb6a36e15ccab0 WatchSource:0}: Error finding container f5be200adbca2875bffa72bacd07ff0cf5bc822e9b8bc566d0eb6a36e15ccab0: Status 404 returned error can't find the container with id f5be200adbca2875bffa72bacd07ff0cf5bc822e9b8bc566d0eb6a36e15ccab0
Sep 11 04:48:42.084786 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:42.084705    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-7jqhw" event={"ID":"6a90f185-61bd-4393-8174-8615ad1f3608","Type":"ContainerStarted","Data":"465e9c92ddf133b52d3aec1c76f81712ee64505fa8147f861f23cbbff3d764d5"}
Sep 11 04:48:42.084786 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:42.084747    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-7jqhw" event={"ID":"6a90f185-61bd-4393-8174-8615ad1f3608","Type":"ContainerStarted","Data":"f5be200adbca2875bffa72bacd07ff0cf5bc822e9b8bc566d0eb6a36e15ccab0"}
Sep 11 04:48:42.085250 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:42.084817    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557f876f69-7jqhw" podUID="6a90f185-61bd-4393-8174-8615ad1f3608" containerName="authorino" containerID="cri-o://465e9c92ddf133b52d3aec1c76f81712ee64505fa8147f861f23cbbff3d764d5" gracePeriod=30
Sep 11 04:48:42.098491 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:42.098444    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557f876f69-7jqhw" podStartSLOduration=1.756644171 podStartE2EDuration="2.098427688s" totalImagesPullingTime="341.783517ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:48:42.097370716 +0000 UTC m=+511.750630387" watchObservedRunningTime="2026-09-11 04:48:42.098427688 +0000 UTC m=+511.751687368"
Sep 11 04:48:42.340807 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:42.340739    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-7jqhw"
Sep 11 04:48:42.389843 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:42.389813    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84tfv\" (UniqueName: \"kubernetes.io/projected/6a90f185-61bd-4393-8174-8615ad1f3608-kube-api-access-84tfv\") pod \"6a90f185-61bd-4393-8174-8615ad1f3608\" (UID: \"6a90f185-61bd-4393-8174-8615ad1f3608\") "
Sep 11 04:48:42.392084 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:42.392055    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a90f185-61bd-4393-8174-8615ad1f3608-kube-api-access-84tfv" (OuterVolumeSpecName: "kube-api-access-84tfv") pod "6a90f185-61bd-4393-8174-8615ad1f3608" (UID: "6a90f185-61bd-4393-8174-8615ad1f3608"). InnerVolumeSpecName "kube-api-access-84tfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:48:42.490800 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:42.490755    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84tfv\" (UniqueName: \"kubernetes.io/projected/6a90f185-61bd-4393-8174-8615ad1f3608-kube-api-access-84tfv\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:48:42.617214 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:42.617128    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-cg5vs"]
Sep 11 04:48:42.617378 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:42.617322    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-cg5vs" podUID="416cd5f3-06c5-439d-9525-62565693f183" containerName="authorino" containerID="cri-o://745bf40215ed163a4e3dab912ea65849443f7e234a14eda04a5dd63480912237" gracePeriod=30
Sep 11 04:48:42.859354 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:42.859303    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-cg5vs"
Sep 11 04:48:42.894533 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:42.894456    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbrxm\" (UniqueName: \"kubernetes.io/projected/416cd5f3-06c5-439d-9525-62565693f183-kube-api-access-fbrxm\") pod \"416cd5f3-06c5-439d-9525-62565693f183\" (UID: \"416cd5f3-06c5-439d-9525-62565693f183\") "
Sep 11 04:48:42.896676 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:42.896645    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/416cd5f3-06c5-439d-9525-62565693f183-kube-api-access-fbrxm" (OuterVolumeSpecName: "kube-api-access-fbrxm") pod "416cd5f3-06c5-439d-9525-62565693f183" (UID: "416cd5f3-06c5-439d-9525-62565693f183"). InnerVolumeSpecName "kube-api-access-fbrxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:48:42.995549 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:42.995515    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbrxm\" (UniqueName: \"kubernetes.io/projected/416cd5f3-06c5-439d-9525-62565693f183-kube-api-access-fbrxm\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:48:43.090243 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:43.090207    2554 generic.go:356] "Generic (PLEG): container finished" podID="6a90f185-61bd-4393-8174-8615ad1f3608" containerID="465e9c92ddf133b52d3aec1c76f81712ee64505fa8147f861f23cbbff3d764d5" exitCode=0
Sep 11 04:48:43.090243 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:43.090249    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-7jqhw"
Sep 11 04:48:43.090724 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:43.090291    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-7jqhw" event={"ID":"6a90f185-61bd-4393-8174-8615ad1f3608","Type":"ContainerDied","Data":"465e9c92ddf133b52d3aec1c76f81712ee64505fa8147f861f23cbbff3d764d5"}
Sep 11 04:48:43.090724 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:43.090356    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-7jqhw" event={"ID":"6a90f185-61bd-4393-8174-8615ad1f3608","Type":"ContainerDied","Data":"f5be200adbca2875bffa72bacd07ff0cf5bc822e9b8bc566d0eb6a36e15ccab0"}
Sep 11 04:48:43.090724 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:43.090378    2554 scope.go:117] "RemoveContainer" containerID="465e9c92ddf133b52d3aec1c76f81712ee64505fa8147f861f23cbbff3d764d5"
Sep 11 04:48:43.091713 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:43.091695    2554 generic.go:356] "Generic (PLEG): container finished" podID="416cd5f3-06c5-439d-9525-62565693f183" containerID="745bf40215ed163a4e3dab912ea65849443f7e234a14eda04a5dd63480912237" exitCode=0
Sep 11 04:48:43.091821 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:43.091731    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-cg5vs"
Sep 11 04:48:43.091821 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:43.091784    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-cg5vs" event={"ID":"416cd5f3-06c5-439d-9525-62565693f183","Type":"ContainerDied","Data":"745bf40215ed163a4e3dab912ea65849443f7e234a14eda04a5dd63480912237"}
Sep 11 04:48:43.091933 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:43.091825    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-cg5vs" event={"ID":"416cd5f3-06c5-439d-9525-62565693f183","Type":"ContainerDied","Data":"5c695517ffe10844a7b42777752b03603d819aebc47e6f1af7e3929cda4771a2"}
Sep 11 04:48:43.099902 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:43.099881    2554 scope.go:117] "RemoveContainer" containerID="465e9c92ddf133b52d3aec1c76f81712ee64505fa8147f861f23cbbff3d764d5"
Sep 11 04:48:43.100190 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:48:43.100173    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"465e9c92ddf133b52d3aec1c76f81712ee64505fa8147f861f23cbbff3d764d5\": container with ID starting with 465e9c92ddf133b52d3aec1c76f81712ee64505fa8147f861f23cbbff3d764d5 not found: ID does not exist" containerID="465e9c92ddf133b52d3aec1c76f81712ee64505fa8147f861f23cbbff3d764d5"
Sep 11 04:48:43.100244 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:43.100198    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"465e9c92ddf133b52d3aec1c76f81712ee64505fa8147f861f23cbbff3d764d5"} err="failed to get container status \"465e9c92ddf133b52d3aec1c76f81712ee64505fa8147f861f23cbbff3d764d5\": rpc error: code = NotFound desc = could not find container \"465e9c92ddf133b52d3aec1c76f81712ee64505fa8147f861f23cbbff3d764d5\": container with ID starting with 465e9c92ddf133b52d3aec1c76f81712ee64505fa8147f861f23cbbff3d764d5 not found: ID does not exist"
Sep 11 04:48:43.100244 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:43.100213    2554 scope.go:117] "RemoveContainer" containerID="745bf40215ed163a4e3dab912ea65849443f7e234a14eda04a5dd63480912237"
Sep 11 04:48:43.108118 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:43.108102    2554 scope.go:117] "RemoveContainer" containerID="745bf40215ed163a4e3dab912ea65849443f7e234a14eda04a5dd63480912237"
Sep 11 04:48:43.108403 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:48:43.108375    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"745bf40215ed163a4e3dab912ea65849443f7e234a14eda04a5dd63480912237\": container with ID starting with 745bf40215ed163a4e3dab912ea65849443f7e234a14eda04a5dd63480912237 not found: ID does not exist" containerID="745bf40215ed163a4e3dab912ea65849443f7e234a14eda04a5dd63480912237"
Sep 11 04:48:43.108503 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:43.108410    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"745bf40215ed163a4e3dab912ea65849443f7e234a14eda04a5dd63480912237"} err="failed to get container status \"745bf40215ed163a4e3dab912ea65849443f7e234a14eda04a5dd63480912237\": rpc error: code = NotFound desc = could not find container \"745bf40215ed163a4e3dab912ea65849443f7e234a14eda04a5dd63480912237\": container with ID starting with 745bf40215ed163a4e3dab912ea65849443f7e234a14eda04a5dd63480912237 not found: ID does not exist"
Sep 11 04:48:43.111165 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:43.111140    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-7jqhw"]
Sep 11 04:48:43.115183 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:43.115160    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-7jqhw"]
Sep 11 04:48:43.128690 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:43.128663    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-cg5vs"]
Sep 11 04:48:43.134146 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:43.134121    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-cg5vs"]
Sep 11 04:48:44.813563 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:44.813525    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="416cd5f3-06c5-439d-9525-62565693f183" path="/var/lib/kubelet/pods/416cd5f3-06c5-439d-9525-62565693f183/volumes"
Sep 11 04:48:44.813974 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:44.813825    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a90f185-61bd-4393-8174-8615ad1f3608" path="/var/lib/kubelet/pods/6a90f185-61bd-4393-8174-8615ad1f3608/volumes"
Sep 11 04:48:47.241297 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.241250    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f7f65b69f-z8nmb"]
Sep 11 04:48:47.241713 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.241630    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="416cd5f3-06c5-439d-9525-62565693f183" containerName="authorino"
Sep 11 04:48:47.241713 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.241643    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="416cd5f3-06c5-439d-9525-62565693f183" containerName="authorino"
Sep 11 04:48:47.241713 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.241658    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a90f185-61bd-4393-8174-8615ad1f3608" containerName="authorino"
Sep 11 04:48:47.241713 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.241663    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a90f185-61bd-4393-8174-8615ad1f3608" containerName="authorino"
Sep 11 04:48:47.241843 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.241717    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="416cd5f3-06c5-439d-9525-62565693f183" containerName="authorino"
Sep 11 04:48:47.241843 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.241727    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a90f185-61bd-4393-8174-8615ad1f3608" containerName="authorino"
Sep 11 04:48:47.250543 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.250520    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7f65b69f-z8nmb"
Sep 11 04:48:47.253301 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.253277    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jxbq2\""
Sep 11 04:48:47.253581 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.253549    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 04:48:47.253984 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.253806    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 04:48:47.254099 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.253854    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 04:48:47.255183 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.255160    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f7f65b69f-z8nmb"]
Sep 11 04:48:47.334787 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.334749    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07212688-fa65-4176-a2fd-005b6a0ac41b-webhook-cert\") pod \"maas-controller-f7f65b69f-z8nmb\" (UID: \"07212688-fa65-4176-a2fd-005b6a0ac41b\") " pod="opendatahub/maas-controller-f7f65b69f-z8nmb"
Sep 11 04:48:47.334787 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.334786    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07212688-fa65-4176-a2fd-005b6a0ac41b-metrics-certs\") pod \"maas-controller-f7f65b69f-z8nmb\" (UID: \"07212688-fa65-4176-a2fd-005b6a0ac41b\") " pod="opendatahub/maas-controller-f7f65b69f-z8nmb"
Sep 11 04:48:47.335004 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.334833    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr44k\" (UniqueName: \"kubernetes.io/projected/07212688-fa65-4176-a2fd-005b6a0ac41b-kube-api-access-gr44k\") pod \"maas-controller-f7f65b69f-z8nmb\" (UID: \"07212688-fa65-4176-a2fd-005b6a0ac41b\") " pod="opendatahub/maas-controller-f7f65b69f-z8nmb"
Sep 11 04:48:47.417660 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.417619    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58cbd59f4-gtc2q"]
Sep 11 04:48:47.421226 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.421208    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd59f4-gtc2q"
Sep 11 04:48:47.432485 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.432461    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58cbd59f4-gtc2q"]
Sep 11 04:48:47.435802 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.435776    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07212688-fa65-4176-a2fd-005b6a0ac41b-webhook-cert\") pod \"maas-controller-f7f65b69f-z8nmb\" (UID: \"07212688-fa65-4176-a2fd-005b6a0ac41b\") " pod="opendatahub/maas-controller-f7f65b69f-z8nmb"
Sep 11 04:48:47.435910 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.435815    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07212688-fa65-4176-a2fd-005b6a0ac41b-metrics-certs\") pod \"maas-controller-f7f65b69f-z8nmb\" (UID: \"07212688-fa65-4176-a2fd-005b6a0ac41b\") " pod="opendatahub/maas-controller-f7f65b69f-z8nmb"
Sep 11 04:48:47.435910 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.435887    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr44k\" (UniqueName: \"kubernetes.io/projected/07212688-fa65-4176-a2fd-005b6a0ac41b-kube-api-access-gr44k\") pod \"maas-controller-f7f65b69f-z8nmb\" (UID: \"07212688-fa65-4176-a2fd-005b6a0ac41b\") " pod="opendatahub/maas-controller-f7f65b69f-z8nmb"
Sep 11 04:48:47.436020 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:48:47.435993    2554 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 11 04:48:47.436071 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:48:47.436058    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07212688-fa65-4176-a2fd-005b6a0ac41b-metrics-certs podName:07212688-fa65-4176-a2fd-005b6a0ac41b nodeName:}" failed. No retries permitted until 2026-09-11 04:48:47.936037424 +0000 UTC m=+517.589297101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/07212688-fa65-4176-a2fd-005b6a0ac41b-metrics-certs") pod "maas-controller-f7f65b69f-z8nmb" (UID: "07212688-fa65-4176-a2fd-005b6a0ac41b") : secret "maas-controller-metrics-tls" not found
Sep 11 04:48:47.438339 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.438307    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07212688-fa65-4176-a2fd-005b6a0ac41b-webhook-cert\") pod \"maas-controller-f7f65b69f-z8nmb\" (UID: \"07212688-fa65-4176-a2fd-005b6a0ac41b\") " pod="opendatahub/maas-controller-f7f65b69f-z8nmb"
Sep 11 04:48:47.447197 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.447168    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr44k\" (UniqueName: \"kubernetes.io/projected/07212688-fa65-4176-a2fd-005b6a0ac41b-kube-api-access-gr44k\") pod \"maas-controller-f7f65b69f-z8nmb\" (UID: \"07212688-fa65-4176-a2fd-005b6a0ac41b\") " pod="opendatahub/maas-controller-f7f65b69f-z8nmb"
Sep 11 04:48:47.537264 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.537178    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3dff598-a783-4980-bafc-4ae841b4ccea-webhook-cert\") pod \"maas-controller-58cbd59f4-gtc2q\" (UID: \"f3dff598-a783-4980-bafc-4ae841b4ccea\") " pod="opendatahub/maas-controller-58cbd59f4-gtc2q"
Sep 11 04:48:47.537264 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.537223    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwr5v\" (UniqueName: \"kubernetes.io/projected/f3dff598-a783-4980-bafc-4ae841b4ccea-kube-api-access-bwr5v\") pod \"maas-controller-58cbd59f4-gtc2q\" (UID: \"f3dff598-a783-4980-bafc-4ae841b4ccea\") " pod="opendatahub/maas-controller-58cbd59f4-gtc2q"
Sep 11 04:48:47.537502 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.537383    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3dff598-a783-4980-bafc-4ae841b4ccea-metrics-certs\") pod \"maas-controller-58cbd59f4-gtc2q\" (UID: \"f3dff598-a783-4980-bafc-4ae841b4ccea\") " pod="opendatahub/maas-controller-58cbd59f4-gtc2q"
Sep 11 04:48:47.638887 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.638843    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3dff598-a783-4980-bafc-4ae841b4ccea-metrics-certs\") pod \"maas-controller-58cbd59f4-gtc2q\" (UID: \"f3dff598-a783-4980-bafc-4ae841b4ccea\") " pod="opendatahub/maas-controller-58cbd59f4-gtc2q"
Sep 11 04:48:47.639050 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.638906    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3dff598-a783-4980-bafc-4ae841b4ccea-webhook-cert\") pod \"maas-controller-58cbd59f4-gtc2q\" (UID: \"f3dff598-a783-4980-bafc-4ae841b4ccea\") " pod="opendatahub/maas-controller-58cbd59f4-gtc2q"
Sep 11 04:48:47.639050 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.638941    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwr5v\" (UniqueName: \"kubernetes.io/projected/f3dff598-a783-4980-bafc-4ae841b4ccea-kube-api-access-bwr5v\") pod \"maas-controller-58cbd59f4-gtc2q\" (UID: \"f3dff598-a783-4980-bafc-4ae841b4ccea\") " pod="opendatahub/maas-controller-58cbd59f4-gtc2q"
Sep 11 04:48:47.641766 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.641737    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3dff598-a783-4980-bafc-4ae841b4ccea-webhook-cert\") pod \"maas-controller-58cbd59f4-gtc2q\" (UID: \"f3dff598-a783-4980-bafc-4ae841b4ccea\") " pod="opendatahub/maas-controller-58cbd59f4-gtc2q"
Sep 11 04:48:47.641886 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.641737    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3dff598-a783-4980-bafc-4ae841b4ccea-metrics-certs\") pod \"maas-controller-58cbd59f4-gtc2q\" (UID: \"f3dff598-a783-4980-bafc-4ae841b4ccea\") " pod="opendatahub/maas-controller-58cbd59f4-gtc2q"
Sep 11 04:48:47.647212 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.647173    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwr5v\" (UniqueName: \"kubernetes.io/projected/f3dff598-a783-4980-bafc-4ae841b4ccea-kube-api-access-bwr5v\") pod \"maas-controller-58cbd59f4-gtc2q\" (UID: \"f3dff598-a783-4980-bafc-4ae841b4ccea\") " pod="opendatahub/maas-controller-58cbd59f4-gtc2q"
Sep 11 04:48:47.732658 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.732628    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd59f4-gtc2q"
Sep 11 04:48:47.942674 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.942642    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07212688-fa65-4176-a2fd-005b6a0ac41b-metrics-certs\") pod \"maas-controller-f7f65b69f-z8nmb\" (UID: \"07212688-fa65-4176-a2fd-005b6a0ac41b\") " pod="opendatahub/maas-controller-f7f65b69f-z8nmb"
Sep 11 04:48:47.945158 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:47.945139    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07212688-fa65-4176-a2fd-005b6a0ac41b-metrics-certs\") pod \"maas-controller-f7f65b69f-z8nmb\" (UID: \"07212688-fa65-4176-a2fd-005b6a0ac41b\") " pod="opendatahub/maas-controller-f7f65b69f-z8nmb"
Sep 11 04:48:48.005020 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:48.004989    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58cbd59f4-gtc2q"]
Sep 11 04:48:48.008055 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:48:48.008030    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3dff598_a783_4980_bafc_4ae841b4ccea.slice/crio-7c54aa80613a8cc311c5c2468fb2f0986d31a52f56b580557fb84f8d8655cbd0 WatchSource:0}: Error finding container 7c54aa80613a8cc311c5c2468fb2f0986d31a52f56b580557fb84f8d8655cbd0: Status 404 returned error can't find the container with id 7c54aa80613a8cc311c5c2468fb2f0986d31a52f56b580557fb84f8d8655cbd0
Sep 11 04:48:48.117648 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:48.117616    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd59f4-gtc2q" event={"ID":"f3dff598-a783-4980-bafc-4ae841b4ccea","Type":"ContainerStarted","Data":"7c54aa80613a8cc311c5c2468fb2f0986d31a52f56b580557fb84f8d8655cbd0"}
Sep 11 04:48:48.162479 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:48.162439    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7f65b69f-z8nmb"
Sep 11 04:48:48.434844 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:48.434819    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f7f65b69f-z8nmb"]
Sep 11 04:48:48.437003 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:48:48.436977    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07212688_fa65_4176_a2fd_005b6a0ac41b.slice/crio-2f8b6421792ba53c6cbdb914dfc4c05414bc507b6d89fa7afeb69c9282f2da64 WatchSource:0}: Error finding container 2f8b6421792ba53c6cbdb914dfc4c05414bc507b6d89fa7afeb69c9282f2da64: Status 404 returned error can't find the container with id 2f8b6421792ba53c6cbdb914dfc4c05414bc507b6d89fa7afeb69c9282f2da64
Sep 11 04:48:49.128811 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:49.128710    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7f65b69f-z8nmb" event={"ID":"07212688-fa65-4176-a2fd-005b6a0ac41b","Type":"ContainerStarted","Data":"2f8b6421792ba53c6cbdb914dfc4c05414bc507b6d89fa7afeb69c9282f2da64"}
Sep 11 04:48:51.140047 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:51.140007    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7f65b69f-z8nmb" event={"ID":"07212688-fa65-4176-a2fd-005b6a0ac41b","Type":"ContainerStarted","Data":"25786aa2a70e34e25c9afdb6e6d845e68e44e39c179a3acda99e7cde238811e1"}
Sep 11 04:48:51.140531 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:51.140074    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f7f65b69f-z8nmb"
Sep 11 04:48:51.141663 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:51.141624    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd59f4-gtc2q" event={"ID":"f3dff598-a783-4980-bafc-4ae841b4ccea","Type":"ContainerStarted","Data":"84416deb3e99107cc07b197223cd77a9e7c010a84de5dcfd4fba4762d23b6675"}
Sep 11 04:48:51.141790 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:51.141681    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58cbd59f4-gtc2q"
Sep 11 04:48:51.162951 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:51.162863    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f7f65b69f-z8nmb" podStartSLOduration=1.990111739 podStartE2EDuration="4.162842123s" totalImagesPullingTime="2.172730384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:48:51.158846759 +0000 UTC m=+520.812106439" watchObservedRunningTime="2026-09-11 04:48:51.162842123 +0000 UTC m=+520.816101804"
Sep 11 04:48:51.179118 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:48:51.179069    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58cbd59f4-gtc2q" podStartSLOduration=1.588214317 podStartE2EDuration="4.179053277s" totalImagesPullingTime="2.59083896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:48:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:48:51.178564661 +0000 UTC m=+520.831824342" watchObservedRunningTime="2026-09-11 04:48:51.179053277 +0000 UTC m=+520.832312981"
Sep 11 04:49:02.150067 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:02.149982    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58cbd59f4-gtc2q"
Sep 11 04:49:02.150576 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:02.150070    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f7f65b69f-z8nmb"
Sep 11 04:49:02.209183 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:02.209140    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f7f65b69f-z8nmb"]
Sep 11 04:49:02.209493 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:02.209455    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-f7f65b69f-z8nmb" podUID="07212688-fa65-4176-a2fd-005b6a0ac41b" containerName="manager" containerID="cri-o://25786aa2a70e34e25c9afdb6e6d845e68e44e39c179a3acda99e7cde238811e1" gracePeriod=30
Sep 11 04:49:02.459524 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:02.459492    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7f65b69f-z8nmb"
Sep 11 04:49:02.574763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:02.574723    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07212688-fa65-4176-a2fd-005b6a0ac41b-webhook-cert\") pod \"07212688-fa65-4176-a2fd-005b6a0ac41b\" (UID: \"07212688-fa65-4176-a2fd-005b6a0ac41b\") "
Sep 11 04:49:02.574972 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:02.574799    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gr44k\" (UniqueName: \"kubernetes.io/projected/07212688-fa65-4176-a2fd-005b6a0ac41b-kube-api-access-gr44k\") pod \"07212688-fa65-4176-a2fd-005b6a0ac41b\" (UID: \"07212688-fa65-4176-a2fd-005b6a0ac41b\") "
Sep 11 04:49:02.574972 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:02.574868    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07212688-fa65-4176-a2fd-005b6a0ac41b-metrics-certs\") pod \"07212688-fa65-4176-a2fd-005b6a0ac41b\" (UID: \"07212688-fa65-4176-a2fd-005b6a0ac41b\") "
Sep 11 04:49:02.577222 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:02.577183    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07212688-fa65-4176-a2fd-005b6a0ac41b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "07212688-fa65-4176-a2fd-005b6a0ac41b" (UID: "07212688-fa65-4176-a2fd-005b6a0ac41b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:49:02.577368 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:02.577243    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07212688-fa65-4176-a2fd-005b6a0ac41b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "07212688-fa65-4176-a2fd-005b6a0ac41b" (UID: "07212688-fa65-4176-a2fd-005b6a0ac41b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:49:02.577368 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:02.577291    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07212688-fa65-4176-a2fd-005b6a0ac41b-kube-api-access-gr44k" (OuterVolumeSpecName: "kube-api-access-gr44k") pod "07212688-fa65-4176-a2fd-005b6a0ac41b" (UID: "07212688-fa65-4176-a2fd-005b6a0ac41b"). InnerVolumeSpecName "kube-api-access-gr44k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:49:02.675744 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:02.675707    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gr44k\" (UniqueName: \"kubernetes.io/projected/07212688-fa65-4176-a2fd-005b6a0ac41b-kube-api-access-gr44k\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:49:02.675744 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:02.675739    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/07212688-fa65-4176-a2fd-005b6a0ac41b-metrics-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:49:02.675744 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:02.675749    2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/07212688-fa65-4176-a2fd-005b6a0ac41b-webhook-cert\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:49:03.203450 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:03.203409    2554 generic.go:356] "Generic (PLEG): container finished" podID="07212688-fa65-4176-a2fd-005b6a0ac41b" containerID="25786aa2a70e34e25c9afdb6e6d845e68e44e39c179a3acda99e7cde238811e1" exitCode=0
Sep 11 04:49:03.203882 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:03.203467    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f7f65b69f-z8nmb"
Sep 11 04:49:03.203882 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:03.203498    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7f65b69f-z8nmb" event={"ID":"07212688-fa65-4176-a2fd-005b6a0ac41b","Type":"ContainerDied","Data":"25786aa2a70e34e25c9afdb6e6d845e68e44e39c179a3acda99e7cde238811e1"}
Sep 11 04:49:03.203882 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:03.203554    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f7f65b69f-z8nmb" event={"ID":"07212688-fa65-4176-a2fd-005b6a0ac41b","Type":"ContainerDied","Data":"2f8b6421792ba53c6cbdb914dfc4c05414bc507b6d89fa7afeb69c9282f2da64"}
Sep 11 04:49:03.203882 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:03.203579    2554 scope.go:117] "RemoveContainer" containerID="25786aa2a70e34e25c9afdb6e6d845e68e44e39c179a3acda99e7cde238811e1"
Sep 11 04:49:03.212421 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:03.212193    2554 scope.go:117] "RemoveContainer" containerID="25786aa2a70e34e25c9afdb6e6d845e68e44e39c179a3acda99e7cde238811e1"
Sep 11 04:49:03.212544 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:49:03.212524    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25786aa2a70e34e25c9afdb6e6d845e68e44e39c179a3acda99e7cde238811e1\": container with ID starting with 25786aa2a70e34e25c9afdb6e6d845e68e44e39c179a3acda99e7cde238811e1 not found: ID does not exist" containerID="25786aa2a70e34e25c9afdb6e6d845e68e44e39c179a3acda99e7cde238811e1"
Sep 11 04:49:03.212608 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:03.212556    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25786aa2a70e34e25c9afdb6e6d845e68e44e39c179a3acda99e7cde238811e1"} err="failed to get container status \"25786aa2a70e34e25c9afdb6e6d845e68e44e39c179a3acda99e7cde238811e1\": rpc error: code = NotFound desc = could not find container \"25786aa2a70e34e25c9afdb6e6d845e68e44e39c179a3acda99e7cde238811e1\": container with ID starting with 25786aa2a70e34e25c9afdb6e6d845e68e44e39c179a3acda99e7cde238811e1 not found: ID does not exist"
Sep 11 04:49:03.218852 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:03.218827    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f7f65b69f-z8nmb"]
Sep 11 04:49:03.220955 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:03.220931    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f7f65b69f-z8nmb"]
Sep 11 04:49:04.813244 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:04.813210    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07212688-fa65-4176-a2fd-005b6a0ac41b" path="/var/lib/kubelet/pods/07212688-fa65-4176-a2fd-005b6a0ac41b/volumes"
Sep 11 04:49:25.643603 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.643569    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"]
Sep 11 04:49:25.643995 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.643932    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07212688-fa65-4176-a2fd-005b6a0ac41b" containerName="manager"
Sep 11 04:49:25.643995 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.643942    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="07212688-fa65-4176-a2fd-005b6a0ac41b" containerName="manager"
Sep 11 04:49:25.644091 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.644000    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="07212688-fa65-4176-a2fd-005b6a0ac41b" containerName="manager"
Sep 11 04:49:25.650577 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.650553    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"
Sep 11 04:49:25.652985 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.652955    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 04:49:25.653132 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.653079    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 04:49:25.653191 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.653140    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 04:49:25.653243 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.653220    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 04:49:25.658965 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.658791    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"]
Sep 11 04:49:25.680662 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.680626    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r4zg\" (UniqueName: \"kubernetes.io/projected/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-kube-api-access-6r4zg\") pod \"maas-api-646f6bcd4d-vcnph\" (UID: \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\") " pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"
Sep 11 04:49:25.680853 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.680752    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-metrics-certs\") pod \"maas-api-646f6bcd4d-vcnph\" (UID: \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\") " pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"
Sep 11 04:49:25.680853 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.680808    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-maas-api-tls\") pod \"maas-api-646f6bcd4d-vcnph\" (UID: \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\") " pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"
Sep 11 04:49:25.680853 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.680839    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-openshift-service-ca\") pod \"maas-api-646f6bcd4d-vcnph\" (UID: \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\") " pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"
Sep 11 04:49:25.781973 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.781933    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r4zg\" (UniqueName: \"kubernetes.io/projected/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-kube-api-access-6r4zg\") pod \"maas-api-646f6bcd4d-vcnph\" (UID: \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\") " pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"
Sep 11 04:49:25.782151 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.782033    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-metrics-certs\") pod \"maas-api-646f6bcd4d-vcnph\" (UID: \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\") " pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"
Sep 11 04:49:25.782151 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.782072    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-maas-api-tls\") pod \"maas-api-646f6bcd4d-vcnph\" (UID: \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\") " pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"
Sep 11 04:49:25.782151 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.782092    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-openshift-service-ca\") pod \"maas-api-646f6bcd4d-vcnph\" (UID: \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\") " pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"
Sep 11 04:49:25.782297 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:49:25.782194    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 11 04:49:25.788836 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:49:25.782658    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-metrics-certs podName:a36dc1ac-fd77-4a02-b76b-a219e3c0edc7 nodeName:}" failed. No retries permitted until 2026-09-11 04:49:26.282629866 +0000 UTC m=+555.935889534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-metrics-certs") pod "maas-api-646f6bcd4d-vcnph" (UID: "a36dc1ac-fd77-4a02-b76b-a219e3c0edc7") : secret "maas-api-metrics-tls" not found
Sep 11 04:49:25.788836 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.783157    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-openshift-service-ca\") pod \"maas-api-646f6bcd4d-vcnph\" (UID: \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\") " pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"
Sep 11 04:49:25.789679 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.789659    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-maas-api-tls\") pod \"maas-api-646f6bcd4d-vcnph\" (UID: \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\") " pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"
Sep 11 04:49:25.792176 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:25.792145    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r4zg\" (UniqueName: \"kubernetes.io/projected/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-kube-api-access-6r4zg\") pod \"maas-api-646f6bcd4d-vcnph\" (UID: \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\") " pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"
Sep 11 04:49:26.254396 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:26.254358    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-rqdkj"]
Sep 11 04:49:26.257922 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:26.257899    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rqdkj"
Sep 11 04:49:26.260125 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:26.260093    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2l6qs\""
Sep 11 04:49:26.260520 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:26.260503    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 04:49:26.267524 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:26.267503    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-rqdkj"]
Sep 11 04:49:26.274156 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:26.274133    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:49:26.286682 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:26.286637    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ghr5\" (UniqueName: \"kubernetes.io/projected/48a3ebbb-93b6-4063-918f-d26c32611df7-kube-api-access-4ghr5\") pod \"payload-pre-processing-59fbc47bf8-rqdkj\" (UID: \"48a3ebbb-93b6-4063-918f-d26c32611df7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rqdkj"
Sep 11 04:49:26.286857 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:26.286798    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-metrics-certs\") pod \"maas-api-646f6bcd4d-vcnph\" (UID: \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\") " pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"
Sep 11 04:49:26.286948 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:26.286932    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48a3ebbb-93b6-4063-918f-d26c32611df7-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-rqdkj\" (UID: \"48a3ebbb-93b6-4063-918f-d26c32611df7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rqdkj"
Sep 11 04:49:26.289511 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:26.289486    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-metrics-certs\") pod \"maas-api-646f6bcd4d-vcnph\" (UID: \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\") " pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"
Sep 11 04:49:26.387853 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:26.387813    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48a3ebbb-93b6-4063-918f-d26c32611df7-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-rqdkj\" (UID: \"48a3ebbb-93b6-4063-918f-d26c32611df7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rqdkj"
Sep 11 04:49:26.388036 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:26.387904    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ghr5\" (UniqueName: \"kubernetes.io/projected/48a3ebbb-93b6-4063-918f-d26c32611df7-kube-api-access-4ghr5\") pod \"payload-pre-processing-59fbc47bf8-rqdkj\" (UID: \"48a3ebbb-93b6-4063-918f-d26c32611df7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rqdkj"
Sep 11 04:49:26.388553 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:26.388524    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48a3ebbb-93b6-4063-918f-d26c32611df7-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-rqdkj\" (UID: \"48a3ebbb-93b6-4063-918f-d26c32611df7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rqdkj"
Sep 11 04:49:26.396435 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:26.396411    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ghr5\" (UniqueName: \"kubernetes.io/projected/48a3ebbb-93b6-4063-918f-d26c32611df7-kube-api-access-4ghr5\") pod \"payload-pre-processing-59fbc47bf8-rqdkj\" (UID: \"48a3ebbb-93b6-4063-918f-d26c32611df7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rqdkj"
Sep 11 04:49:26.563636 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:26.563548    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"
Sep 11 04:49:26.570955 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:26.570925    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rqdkj"
Sep 11 04:49:26.841270 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:26.841246    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"]
Sep 11 04:49:26.843558 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:49:26.843523    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda36dc1ac_fd77_4a02_b76b_a219e3c0edc7.slice/crio-06014bc4210738ec78b97415fa53530b4a7391e9541ec64c7364a4c2eb35fe6e WatchSource:0}: Error finding container 06014bc4210738ec78b97415fa53530b4a7391e9541ec64c7364a4c2eb35fe6e: Status 404 returned error can't find the container with id 06014bc4210738ec78b97415fa53530b4a7391e9541ec64c7364a4c2eb35fe6e
Sep 11 04:49:26.848066 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:26.848029    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-rqdkj"]
Sep 11 04:49:26.850588 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:49:26.850561    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a3ebbb_93b6_4063_918f_d26c32611df7.slice/crio-26b09407d388b3142adfcc137fe5fa9a23c6bc465ee3398899194b1051174282 WatchSource:0}: Error finding container 26b09407d388b3142adfcc137fe5fa9a23c6bc465ee3398899194b1051174282: Status 404 returned error can't find the container with id 26b09407d388b3142adfcc137fe5fa9a23c6bc465ee3398899194b1051174282
Sep 11 04:49:27.321649 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:27.321611    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph" event={"ID":"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7","Type":"ContainerStarted","Data":"06014bc4210738ec78b97415fa53530b4a7391e9541ec64c7364a4c2eb35fe6e"}
Sep 11 04:49:27.323056 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:27.323029    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rqdkj" event={"ID":"48a3ebbb-93b6-4063-918f-d26c32611df7","Type":"ContainerStarted","Data":"26b09407d388b3142adfcc137fe5fa9a23c6bc465ee3398899194b1051174282"}
Sep 11 04:49:30.341907 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:30.341870    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rqdkj" event={"ID":"48a3ebbb-93b6-4063-918f-d26c32611df7","Type":"ContainerStarted","Data":"10eaa3102ab141588040f1ecf41107bbfc888e636ea87a4f2019ecea87e96fcc"}
Sep 11 04:49:30.342407 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:30.341946    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rqdkj"
Sep 11 04:49:30.343653 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:30.343631    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph" event={"ID":"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7","Type":"ContainerStarted","Data":"e45337da7a508edf4821460f008f98ac8760ade0d0405d4eb70c55b48640888b"}
Sep 11 04:49:30.343768 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:30.343753    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"
Sep 11 04:49:30.359794 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:30.359743    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rqdkj" podStartSLOduration=1.874609812 podStartE2EDuration="4.359726722s" totalImagesPullingTime="2.48511691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:49:30.358049247 +0000 UTC m=+560.011308938" watchObservedRunningTime="2026-09-11 04:49:30.359726722 +0000 UTC m=+560.012986402"
Sep 11 04:49:30.374757 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:30.374708    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph" podStartSLOduration=2.88761385 podStartE2EDuration="5.374693582s" totalImagesPullingTime="2.487079732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:49:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:49:30.373126904 +0000 UTC m=+560.026386581" watchObservedRunningTime="2026-09-11 04:49:30.374693582 +0000 UTC m=+560.027953261"
Sep 11 04:49:35.371760 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:35.371726    2554 generic.go:356] "Generic (PLEG): container finished" podID="21933563-dab2-4f0b-88f2-c34a1d828d43" containerID="0adcafb3f5450c7a6b6a2857abe2c9a89e8ed15bfe70f67a0a967a6987e04238" exitCode=0
Sep 11 04:49:35.372179 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:35.371784    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr" event={"ID":"21933563-dab2-4f0b-88f2-c34a1d828d43","Type":"ContainerDied","Data":"0adcafb3f5450c7a6b6a2857abe2c9a89e8ed15bfe70f67a0a967a6987e04238"}
Sep 11 04:49:35.372179 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:35.372158    2554 scope.go:117] "RemoveContainer" containerID="0adcafb3f5450c7a6b6a2857abe2c9a89e8ed15bfe70f67a0a967a6987e04238"
Sep 11 04:49:35.373185 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:35.373140    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:49:35.373288 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:35.373229    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:49:35.373288 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:35.373280    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:49:36.353637 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:36.353607    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"
Sep 11 04:49:36.383501 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:36.383457    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr" event={"ID":"21933563-dab2-4f0b-88f2-c34a1d828d43","Type":"ContainerStarted","Data":"c83e84c03d0d9a5f891c8da638e537d82cd9290c786d6a8f94fddeaf62cf64b7"}
Sep 11 04:49:36.820596 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:36.820553    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:49:36.820827 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:36.820804    2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-hnzbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 04:49:36.820914 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:36.820857    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr" podUID="21933563-dab2-4f0b-88f2-c34a1d828d43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 04:49:37.820557 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:37.820520    2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-hnzbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 04:49:37.820937 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:37.820579    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr" podUID="21933563-dab2-4f0b-88f2-c34a1d828d43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 04:49:38.821497 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:38.821456    2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-hnzbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 04:49:38.821924 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:38.821522    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr" podUID="21933563-dab2-4f0b-88f2-c34a1d828d43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 04:49:39.820725 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:39.820685    2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-hnzbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 04:49:39.820918 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:39.820752    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr" podUID="21933563-dab2-4f0b-88f2-c34a1d828d43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 04:49:40.820915 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:40.820880    2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-hnzbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 04:49:40.821520 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:40.821482    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr" podUID="21933563-dab2-4f0b-88f2-c34a1d828d43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 04:49:41.351431 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:41.351397    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-rqdkj"
Sep 11 04:49:41.824878 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:41.824844    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:49:41.825309 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:41.825103    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:49:41.825873 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:41.825853    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-hnzbr"
Sep 11 04:49:44.460500 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.460462    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"]
Sep 11 04:49:44.464068 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.464046    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:44.467079 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.467051    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tzcgp\""
Sep 11 04:49:44.467215 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.467081    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 04:49:44.467215 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.467104    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 04:49:44.467215 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.467056    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 11 04:49:44.474761 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.474736    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"]
Sep 11 04:49:44.572269 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.572235    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c00915-1c4d-47c9-ab12-df2f0baa1c4b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng\" (UID: \"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:44.572464 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.572273    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c00915-1c4d-47c9-ab12-df2f0baa1c4b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng\" (UID: \"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:44.572464 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.572387    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c00915-1c4d-47c9-ab12-df2f0baa1c4b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng\" (UID: \"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:44.572464 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.572450    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c00915-1c4d-47c9-ab12-df2f0baa1c4b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng\" (UID: \"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:44.572630 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.572467    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c00915-1c4d-47c9-ab12-df2f0baa1c4b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng\" (UID: \"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:44.572630 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.572514    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8bgd\" (UniqueName: \"kubernetes.io/projected/b9c00915-1c4d-47c9-ab12-df2f0baa1c4b-kube-api-access-d8bgd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng\" (UID: \"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:44.673496 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.673455    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c00915-1c4d-47c9-ab12-df2f0baa1c4b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng\" (UID: \"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:44.673684 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.673516    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c00915-1c4d-47c9-ab12-df2f0baa1c4b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng\" (UID: \"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:44.673684 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.673537    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c00915-1c4d-47c9-ab12-df2f0baa1c4b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng\" (UID: \"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:44.673684 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.673574    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8bgd\" (UniqueName: \"kubernetes.io/projected/b9c00915-1c4d-47c9-ab12-df2f0baa1c4b-kube-api-access-d8bgd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng\" (UID: \"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:44.673684 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.673592    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c00915-1c4d-47c9-ab12-df2f0baa1c4b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng\" (UID: \"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:44.673684 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.673624    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c00915-1c4d-47c9-ab12-df2f0baa1c4b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng\" (UID: \"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:44.673955 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.673907    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c00915-1c4d-47c9-ab12-df2f0baa1c4b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng\" (UID: \"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:44.674016 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.673966    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c00915-1c4d-47c9-ab12-df2f0baa1c4b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng\" (UID: \"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:44.674054 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.674009    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c00915-1c4d-47c9-ab12-df2f0baa1c4b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng\" (UID: \"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:44.676067 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.676046    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c00915-1c4d-47c9-ab12-df2f0baa1c4b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng\" (UID: \"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:44.676204 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.676186    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c00915-1c4d-47c9-ab12-df2f0baa1c4b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng\" (UID: \"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:44.681778 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.681756    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8bgd\" (UniqueName: \"kubernetes.io/projected/b9c00915-1c4d-47c9-ab12-df2f0baa1c4b-kube-api-access-d8bgd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng\" (UID: \"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:44.776304 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:44.776208    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:45.003023 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:45.002989    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:49:45.050577 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:45.050552    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"]
Sep 11 04:49:45.053050 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:49:45.053022    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c00915_1c4d_47c9_ab12_df2f0baa1c4b.slice/crio-8924bfdef0d59e46e432427391695b9a006ab3430622769c35b715052f7b4620 WatchSource:0}: Error finding container 8924bfdef0d59e46e432427391695b9a006ab3430622769c35b715052f7b4620: Status 404 returned error can't find the container with id 8924bfdef0d59e46e432427391695b9a006ab3430622769c35b715052f7b4620
Sep 11 04:49:45.435142 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:45.435102    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng" event={"ID":"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b","Type":"ContainerStarted","Data":"8924bfdef0d59e46e432427391695b9a006ab3430622769c35b715052f7b4620"}
Sep 11 04:49:46.440746 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:46.440710    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng" event={"ID":"b9c00915-1c4d-47c9-ab12-df2f0baa1c4b","Type":"ContainerStarted","Data":"edb6114823e5666326bc3ed0942fff850ccba043cd630b4e6aa474b8d56a3392"}
Sep 11 04:49:46.459364 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:46.459299    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng" podStartSLOduration=1.433478725 podStartE2EDuration="2.459282542s" totalImagesPullingTime="1.025803817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:49:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:49:46.457062784 +0000 UTC m=+576.110322464" watchObservedRunningTime="2026-09-11 04:49:46.459282542 +0000 UTC m=+576.112542221"
Sep 11 04:49:53.609635 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:53.609599    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:49:54.776607 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:54.776569    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:54.777096 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:54.776645    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:54.789001 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:54.788972    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:55.496601 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:55.496564    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng"
Sep 11 04:49:57.591387 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:49:57.591358    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:50:02.554917 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.554876    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"]
Sep 11 04:50:02.558618 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.558594    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:02.560658 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.560637    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 11 04:50:02.568257 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.568230    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"]
Sep 11 04:50:02.630802 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.630765    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d2b2e55-39c6-4eef-9ca6-94067c3bc13e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2pt8\" (UID: \"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:02.630996 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.630816    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9p5v\" (UniqueName: \"kubernetes.io/projected/3d2b2e55-39c6-4eef-9ca6-94067c3bc13e-kube-api-access-n9p5v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2pt8\" (UID: \"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:02.630996 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.630848    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d2b2e55-39c6-4eef-9ca6-94067c3bc13e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2pt8\" (UID: \"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:02.630996 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.630956    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d2b2e55-39c6-4eef-9ca6-94067c3bc13e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2pt8\" (UID: \"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:02.631143 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.631013    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d2b2e55-39c6-4eef-9ca6-94067c3bc13e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2pt8\" (UID: \"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:02.631178 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.631143    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d2b2e55-39c6-4eef-9ca6-94067c3bc13e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2pt8\" (UID: \"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:02.732357 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.732289    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d2b2e55-39c6-4eef-9ca6-94067c3bc13e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2pt8\" (UID: \"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:02.732357 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.732352    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d2b2e55-39c6-4eef-9ca6-94067c3bc13e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2pt8\" (UID: \"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:02.732601 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.732477    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9p5v\" (UniqueName: \"kubernetes.io/projected/3d2b2e55-39c6-4eef-9ca6-94067c3bc13e-kube-api-access-n9p5v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2pt8\" (UID: \"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:02.732601 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.732517    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d2b2e55-39c6-4eef-9ca6-94067c3bc13e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2pt8\" (UID: \"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:02.732601 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.732577    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d2b2e55-39c6-4eef-9ca6-94067c3bc13e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2pt8\" (UID: \"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:02.732748 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.732625    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d2b2e55-39c6-4eef-9ca6-94067c3bc13e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2pt8\" (UID: \"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:02.732748 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.732698    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d2b2e55-39c6-4eef-9ca6-94067c3bc13e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2pt8\" (UID: \"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:02.732876 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.732845    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d2b2e55-39c6-4eef-9ca6-94067c3bc13e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2pt8\" (UID: \"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:02.733060 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.733035    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d2b2e55-39c6-4eef-9ca6-94067c3bc13e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2pt8\" (UID: \"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:02.735055 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.735028    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d2b2e55-39c6-4eef-9ca6-94067c3bc13e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2pt8\" (UID: \"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:02.735504 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.735484    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d2b2e55-39c6-4eef-9ca6-94067c3bc13e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2pt8\" (UID: \"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:02.740917 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.740889    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9p5v\" (UniqueName: \"kubernetes.io/projected/3d2b2e55-39c6-4eef-9ca6-94067c3bc13e-kube-api-access-n9p5v\") pod \"e2e-trlp-test-simulated-kserve-598466548d-b2pt8\" (UID: \"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:02.870186 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:02.870104    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:03.143749 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:03.143719    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"]
Sep 11 04:50:03.145356 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:50:03.145310    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d2b2e55_39c6_4eef_9ca6_94067c3bc13e.slice/crio-7b1266a2e1b87aabd1eb6fb091e357b091a54af0f6716c0296be2713c418591a WatchSource:0}: Error finding container 7b1266a2e1b87aabd1eb6fb091e357b091a54af0f6716c0296be2713c418591a: Status 404 returned error can't find the container with id 7b1266a2e1b87aabd1eb6fb091e357b091a54af0f6716c0296be2713c418591a
Sep 11 04:50:03.527843 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:03.527794    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8" event={"ID":"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e","Type":"ContainerStarted","Data":"fe8d5aa905b1856d36158a263a50a58e50d6d5c73e93e32b5da800e6a4478973"}
Sep 11 04:50:03.528035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:03.527859    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8" event={"ID":"3d2b2e55-39c6-4eef-9ca6-94067c3bc13e","Type":"ContainerStarted","Data":"7b1266a2e1b87aabd1eb6fb091e357b091a54af0f6716c0296be2713c418591a"}
Sep 11 04:50:03.546583 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:03.546532    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8" podStartSLOduration=1.342894094 podStartE2EDuration="1.546514262s" totalImagesPullingTime="203.620168ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:50:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:50:03.545195531 +0000 UTC m=+593.198455212" watchObservedRunningTime="2026-09-11 04:50:03.546514262 +0000 UTC m=+593.199773942"
Sep 11 04:50:03.803707 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:03.803672    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:50:12.871965 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:12.871913    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:12.872552 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:12.872039    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:12.885436 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:12.885410    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:13.591908 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:13.591870    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-b2pt8"
Sep 11 04:50:17.804009 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:17.803973    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:50:31.436265 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:31.436226    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:50:42.207621 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:50:42.207578    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:52:07.457241 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:07.457155    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-869cf59fcc-rm4pc"]
Sep 11 04:52:07.461121 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:07.461100    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-869cf59fcc-rm4pc"
Sep 11 04:52:07.464197 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:07.464171    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6zshq\""
Sep 11 04:52:07.464316 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:07.464209    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 11 04:52:07.467810 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:07.467788    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-869cf59fcc-rm4pc"]
Sep 11 04:52:07.584650 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:07.584610    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjzml\" (UniqueName: \"kubernetes.io/projected/b5a91749-199b-4e9b-b86d-43bbf6626c30-kube-api-access-zjzml\") pod \"authorino-869cf59fcc-rm4pc\" (UID: \"b5a91749-199b-4e9b-b86d-43bbf6626c30\") " pod="kuadrant-system/authorino-869cf59fcc-rm4pc"
Sep 11 04:52:07.584838 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:07.584763    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5a91749-199b-4e9b-b86d-43bbf6626c30-tls-cert\") pod \"authorino-869cf59fcc-rm4pc\" (UID: \"b5a91749-199b-4e9b-b86d-43bbf6626c30\") " pod="kuadrant-system/authorino-869cf59fcc-rm4pc"
Sep 11 04:52:07.686015 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:07.685979    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjzml\" (UniqueName: \"kubernetes.io/projected/b5a91749-199b-4e9b-b86d-43bbf6626c30-kube-api-access-zjzml\") pod \"authorino-869cf59fcc-rm4pc\" (UID: \"b5a91749-199b-4e9b-b86d-43bbf6626c30\") " pod="kuadrant-system/authorino-869cf59fcc-rm4pc"
Sep 11 04:52:07.686189 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:07.686070    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5a91749-199b-4e9b-b86d-43bbf6626c30-tls-cert\") pod \"authorino-869cf59fcc-rm4pc\" (UID: \"b5a91749-199b-4e9b-b86d-43bbf6626c30\") " pod="kuadrant-system/authorino-869cf59fcc-rm4pc"
Sep 11 04:52:07.688629 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:07.688604    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b5a91749-199b-4e9b-b86d-43bbf6626c30-tls-cert\") pod \"authorino-869cf59fcc-rm4pc\" (UID: \"b5a91749-199b-4e9b-b86d-43bbf6626c30\") " pod="kuadrant-system/authorino-869cf59fcc-rm4pc"
Sep 11 04:52:07.694129 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:07.694102    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjzml\" (UniqueName: \"kubernetes.io/projected/b5a91749-199b-4e9b-b86d-43bbf6626c30-kube-api-access-zjzml\") pod \"authorino-869cf59fcc-rm4pc\" (UID: \"b5a91749-199b-4e9b-b86d-43bbf6626c30\") " pod="kuadrant-system/authorino-869cf59fcc-rm4pc"
Sep 11 04:52:07.772672 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:07.772581    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-869cf59fcc-rm4pc"
Sep 11 04:52:08.045115 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:08.045084    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-869cf59fcc-rm4pc"]
Sep 11 04:52:08.047784 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:52:08.047757    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5a91749_199b_4e9b_b86d_43bbf6626c30.slice/crio-4f46d41d93e5dc96a1038c67046c797de4016fb1900f0636eabc958715ba1bac WatchSource:0}: Error finding container 4f46d41d93e5dc96a1038c67046c797de4016fb1900f0636eabc958715ba1bac: Status 404 returned error can't find the container with id 4f46d41d93e5dc96a1038c67046c797de4016fb1900f0636eabc958715ba1bac
Sep 11 04:52:08.049205 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:08.049185    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 04:52:08.167032 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:08.166997    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-869cf59fcc-rm4pc" event={"ID":"b5a91749-199b-4e9b-b86d-43bbf6626c30","Type":"ContainerStarted","Data":"4f46d41d93e5dc96a1038c67046c797de4016fb1900f0636eabc958715ba1bac"}
Sep 11 04:52:09.174669 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:09.174623    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-869cf59fcc-rm4pc" event={"ID":"b5a91749-199b-4e9b-b86d-43bbf6626c30","Type":"ContainerStarted","Data":"aa1aec901ac76de4b8483754042813a2fa25e15fc199d23582260f79b92b7540"}
Sep 11 04:52:26.005126 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.005042    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-869cf59fcc-rm4pc" podStartSLOduration=18.222370738 podStartE2EDuration="19.005016782s" totalImagesPullingTime="782.646044ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:52:09.189002916 +0000 UTC m=+718.842262598" watchObservedRunningTime="2026-09-11 04:52:26.005016782 +0000 UTC m=+735.658276465"
Sep 11 04:52:26.008043 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.007857    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"]
Sep 11 04:52:26.012834 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.012810    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.015349 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.015301    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-831a1c-openshift-default-dockercfg-vg8t7\""
Sep 11 04:52:26.025709 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.025676    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"]
Sep 11 04:52:26.159229 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.159181    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed631a0a-5452-4f22-a669-2960576df5d7-istiod-ca-cert\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.159459 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.159240    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed631a0a-5452-4f22-a669-2960576df5d7-istio-podinfo\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.159459 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.159264    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-istio-envoy\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.159459 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.159307    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hmmq\" (UniqueName: \"kubernetes.io/projected/ed631a0a-5452-4f22-a669-2960576df5d7-kube-api-access-4hmmq\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.159459 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.159383    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-workload-socket\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.159459 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.159447    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-istio-data\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.159730 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.159491    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-credential-socket\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.159730 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.159531    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-workload-certs\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.159730 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.159549    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed631a0a-5452-4f22-a669-2960576df5d7-istio-token\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.260971 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.260868    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-workload-socket\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.260971 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.260960    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-istio-data\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.261206 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.261017    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-credential-socket\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.261206 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.261076    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-workload-certs\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.261206 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.261099    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed631a0a-5452-4f22-a669-2960576df5d7-istio-token\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.261206 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.261143    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed631a0a-5452-4f22-a669-2960576df5d7-istiod-ca-cert\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.261206 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.261185    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed631a0a-5452-4f22-a669-2960576df5d7-istio-podinfo\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.261443 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.261215    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-istio-envoy\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.261443 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.261257    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hmmq\" (UniqueName: \"kubernetes.io/projected/ed631a0a-5452-4f22-a669-2960576df5d7-kube-api-access-4hmmq\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.261537 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.261451    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-istio-data\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.261537 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.261460    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-workload-certs\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.261723 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.261700    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-credential-socket\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.261994 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.261962    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-workload-socket\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.262706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.262676    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed631a0a-5452-4f22-a669-2960576df5d7-istiod-ca-cert\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.264254 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.264224    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed631a0a-5452-4f22-a669-2960576df5d7-istio-podinfo\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.264378 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.264293    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-istio-envoy\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.268991 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.268963    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hmmq\" (UniqueName: \"kubernetes.io/projected/ed631a0a-5452-4f22-a669-2960576df5d7-kube-api-access-4hmmq\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.269158 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.269138    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed631a0a-5452-4f22-a669-2960576df5d7-istio-token\") pod \"e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") " pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.327660 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.327609    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:26.610859 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.610811    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"]
Sep 11 04:52:26.613583 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:52:26.613552    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded631a0a_5452_4f22_a669_2960576df5d7.slice/crio-a1b966032876402a9dc1141e5935142f762f27df5ba8332a57a5998c28bfecf5 WatchSource:0}: Error finding container a1b966032876402a9dc1141e5935142f762f27df5ba8332a57a5998c28bfecf5: Status 404 returned error can't find the container with id a1b966032876402a9dc1141e5935142f762f27df5ba8332a57a5998c28bfecf5
Sep 11 04:52:26.616130 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.616088    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:52:26.616211 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.616155    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:52:26.616211 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:26.616184    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:52:27.277869 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:27.277824    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92" event={"ID":"ed631a0a-5452-4f22-a669-2960576df5d7","Type":"ContainerStarted","Data":"76ec04ecf6c4c71a74f68036f069e5fda265b1420559a11848b0bb9a06404e8c"}
Sep 11 04:52:27.278239 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:27.277895    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92" event={"ID":"ed631a0a-5452-4f22-a669-2960576df5d7","Type":"ContainerStarted","Data":"a1b966032876402a9dc1141e5935142f762f27df5ba8332a57a5998c28bfecf5"}
Sep 11 04:52:27.300308 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:27.300257    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92" podStartSLOduration=2.300239008 podStartE2EDuration="2.300239008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:52:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:52:27.298750172 +0000 UTC m=+736.952009853" watchObservedRunningTime="2026-09-11 04:52:27.300239008 +0000 UTC m=+736.953498688"
Sep 11 04:52:27.328484 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:27.328451    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:27.334200 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:27.334175    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:27.634746 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:27.634666    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7527-6b98fd"]
Sep 11 04:52:27.638223 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:27.638205    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-6b98fd"
Sep 11 04:52:27.641122 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:27.641104    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mgwvk\""
Sep 11 04:52:27.659098 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:27.659068    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7527-6b98fd"]
Sep 11 04:52:27.775167 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:27.775130    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcqc8\" (UniqueName: \"kubernetes.io/projected/2b70e6ff-f5fb-4884-b747-f87058b00d91-kube-api-access-rcqc8\") pod \"test-curl-7527-6b98fd\" (UID: \"2b70e6ff-f5fb-4884-b747-f87058b00d91\") " pod="opendatahub/test-curl-7527-6b98fd"
Sep 11 04:52:27.875802 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:27.875766    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcqc8\" (UniqueName: \"kubernetes.io/projected/2b70e6ff-f5fb-4884-b747-f87058b00d91-kube-api-access-rcqc8\") pod \"test-curl-7527-6b98fd\" (UID: \"2b70e6ff-f5fb-4884-b747-f87058b00d91\") " pod="opendatahub/test-curl-7527-6b98fd"
Sep 11 04:52:27.883462 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:27.883432    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcqc8\" (UniqueName: \"kubernetes.io/projected/2b70e6ff-f5fb-4884-b747-f87058b00d91-kube-api-access-rcqc8\") pod \"test-curl-7527-6b98fd\" (UID: \"2b70e6ff-f5fb-4884-b747-f87058b00d91\") " pod="opendatahub/test-curl-7527-6b98fd"
Sep 11 04:52:27.947863 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:27.947828    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-6b98fd"
Sep 11 04:52:28.220990 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:28.220966    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7527-6b98fd"]
Sep 11 04:52:28.223304 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:52:28.223280    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b70e6ff_f5fb_4884_b747_f87058b00d91.slice/crio-299b3b2dfda646c2f6b5c4fb5b1d755fc3c27d80b6783e481d0129558f324755 WatchSource:0}: Error finding container 299b3b2dfda646c2f6b5c4fb5b1d755fc3c27d80b6783e481d0129558f324755: Status 404 returned error can't find the container with id 299b3b2dfda646c2f6b5c4fb5b1d755fc3c27d80b6783e481d0129558f324755
Sep 11 04:52:28.284241 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:28.284201    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7527-6b98fd" event={"ID":"2b70e6ff-f5fb-4884-b747-f87058b00d91","Type":"ContainerStarted","Data":"299b3b2dfda646c2f6b5c4fb5b1d755fc3c27d80b6783e481d0129558f324755"}
Sep 11 04:52:28.284707 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:28.284565    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:28.285447 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:28.285420    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:29.308040 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:29.308005    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:52:30.455298 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:30.455260    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"]
Sep 11 04:52:30.467088 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:30.466920    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"
Sep 11 04:52:30.468696 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:30.468628    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"]
Sep 11 04:52:30.469136 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:30.469111    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-74gzc\""
Sep 11 04:52:30.469241 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:30.469120    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-831a1c-serving-cert\""
Sep 11 04:52:30.602661 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:30.602617    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7937f2e9-132e-40b5-9a80-c82d78b4e88b-metrics-certs\") pod \"maas-api-e2e-inf-a-831a1c-5677587875-pjsht\" (UID: \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"
Sep 11 04:52:30.602853 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:30.602695    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7937f2e9-132e-40b5-9a80-c82d78b4e88b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-831a1c-5677587875-pjsht\" (UID: \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"
Sep 11 04:52:30.602853 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:30.602724    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znsnz\" (UniqueName: \"kubernetes.io/projected/7937f2e9-132e-40b5-9a80-c82d78b4e88b-kube-api-access-znsnz\") pod \"maas-api-e2e-inf-a-831a1c-5677587875-pjsht\" (UID: \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"
Sep 11 04:52:30.602853 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:30.602802    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7937f2e9-132e-40b5-9a80-c82d78b4e88b-maas-api-tls\") pod \"maas-api-e2e-inf-a-831a1c-5677587875-pjsht\" (UID: \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"
Sep 11 04:52:30.704377 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:30.704251    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7937f2e9-132e-40b5-9a80-c82d78b4e88b-metrics-certs\") pod \"maas-api-e2e-inf-a-831a1c-5677587875-pjsht\" (UID: \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"
Sep 11 04:52:30.704377 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:30.704353    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7937f2e9-132e-40b5-9a80-c82d78b4e88b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-831a1c-5677587875-pjsht\" (UID: \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"
Sep 11 04:52:30.704377 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:30.704378    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znsnz\" (UniqueName: \"kubernetes.io/projected/7937f2e9-132e-40b5-9a80-c82d78b4e88b-kube-api-access-znsnz\") pod \"maas-api-e2e-inf-a-831a1c-5677587875-pjsht\" (UID: \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"
Sep 11 04:52:30.704706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:30.704475    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7937f2e9-132e-40b5-9a80-c82d78b4e88b-maas-api-tls\") pod \"maas-api-e2e-inf-a-831a1c-5677587875-pjsht\" (UID: \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"
Sep 11 04:52:30.704706 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:52:30.704613    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-serving-cert: secret "maas-api-e2e-inf-a-831a1c-serving-cert" not found
Sep 11 04:52:30.704706 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:52:30.704675    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7937f2e9-132e-40b5-9a80-c82d78b4e88b-maas-api-tls podName:7937f2e9-132e-40b5-9a80-c82d78b4e88b nodeName:}" failed. No retries permitted until 2026-09-11 04:52:31.204654957 +0000 UTC m=+740.857914624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7937f2e9-132e-40b5-9a80-c82d78b4e88b-maas-api-tls") pod "maas-api-e2e-inf-a-831a1c-5677587875-pjsht" (UID: "7937f2e9-132e-40b5-9a80-c82d78b4e88b") : secret "maas-api-e2e-inf-a-831a1c-serving-cert" not found
Sep 11 04:52:30.706560 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:30.705547    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7937f2e9-132e-40b5-9a80-c82d78b4e88b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-831a1c-5677587875-pjsht\" (UID: \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"
Sep 11 04:52:30.707644 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:30.707610    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7937f2e9-132e-40b5-9a80-c82d78b4e88b-metrics-certs\") pod \"maas-api-e2e-inf-a-831a1c-5677587875-pjsht\" (UID: \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"
Sep 11 04:52:30.713406 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:30.713372    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znsnz\" (UniqueName: \"kubernetes.io/projected/7937f2e9-132e-40b5-9a80-c82d78b4e88b-kube-api-access-znsnz\") pod \"maas-api-e2e-inf-a-831a1c-5677587875-pjsht\" (UID: \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"
Sep 11 04:52:31.209825 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:31.209791    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7937f2e9-132e-40b5-9a80-c82d78b4e88b-maas-api-tls\") pod \"maas-api-e2e-inf-a-831a1c-5677587875-pjsht\" (UID: \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"
Sep 11 04:52:31.212541 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:31.212514    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7937f2e9-132e-40b5-9a80-c82d78b4e88b-maas-api-tls\") pod \"maas-api-e2e-inf-a-831a1c-5677587875-pjsht\" (UID: \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"
Sep 11 04:52:31.305558 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:31.305521    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7527-6b98fd" event={"ID":"2b70e6ff-f5fb-4884-b747-f87058b00d91","Type":"ContainerStarted","Data":"22745f615a2f03354fc94e42ccb5b14d4e485c965c0e108748b30ba60529e564"}
Sep 11 04:52:31.330089 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:31.330025    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7527-6b98fd" podStartSLOduration=1.7911507960000002 podStartE2EDuration="4.330010057s" totalImagesPullingTime="2.538859261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:52:31.32849823 +0000 UTC m=+740.981757914" watchObservedRunningTime="2026-09-11 04:52:31.330010057 +0000 UTC m=+740.983269738"
Sep 11 04:52:31.384824 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:31.384794    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"
Sep 11 04:52:31.660215 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:31.660171    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"]
Sep 11 04:52:31.662931 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:52:31.662902    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7937f2e9_132e_40b5_9a80_c82d78b4e88b.slice/crio-95de020a1087b99f6d717097f797c158e74850e5e898a4046567938fa813266e WatchSource:0}: Error finding container 95de020a1087b99f6d717097f797c158e74850e5e898a4046567938fa813266e: Status 404 returned error can't find the container with id 95de020a1087b99f6d717097f797c158e74850e5e898a4046567938fa813266e
Sep 11 04:52:31.893102 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:31.893014    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7527-6b98fd"]
Sep 11 04:52:31.898733 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:31.898697    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7527-6b98fd"]
Sep 11 04:52:32.315590 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:32.315543    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht" event={"ID":"7937f2e9-132e-40b5-9a80-c82d78b4e88b","Type":"ContainerStarted","Data":"a8a46c15743098b8b9f7ea0f333afca5efc1915f623a854c6742623c08f63b4a"}
Sep 11 04:52:32.316061 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:32.316036    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"
Sep 11 04:52:32.316218 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:32.316087    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht" event={"ID":"7937f2e9-132e-40b5-9a80-c82d78b4e88b","Type":"ContainerStarted","Data":"95de020a1087b99f6d717097f797c158e74850e5e898a4046567938fa813266e"}
Sep 11 04:52:32.316285 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:52:32.316259    2554 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7527-6b98fd" container="test-curl-7527-6b98fd"
Sep 11 04:52:32.332854 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:32.332793    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht" podStartSLOduration=1.895952635 podStartE2EDuration="2.332777356s" totalImagesPullingTime="436.824721ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:52:32.330949261 +0000 UTC m=+741.984208941" watchObservedRunningTime="2026-09-11 04:52:32.332777356 +0000 UTC m=+741.986037037"
Sep 11 04:52:33.320467 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.320416    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7527-6b98fd" podUID="2b70e6ff-f5fb-4884-b747-f87058b00d91" containerName="test-curl-7527-6b98fd" containerID="cri-o://22745f615a2f03354fc94e42ccb5b14d4e485c965c0e108748b30ba60529e564" gracePeriod=2
Sep 11 04:52:33.759789 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.759754    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"]
Sep 11 04:52:33.760697 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.760665    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b70e6ff-f5fb-4884-b747-f87058b00d91" containerName="test-curl-7527-6b98fd"
Sep 11 04:52:33.760697 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.760698    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b70e6ff-f5fb-4884-b747-f87058b00d91" containerName="test-curl-7527-6b98fd"
Sep 11 04:52:33.760954 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.760844    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b70e6ff-f5fb-4884-b747-f87058b00d91" containerName="test-curl-7527-6b98fd"
Sep 11 04:52:33.764602 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.764579    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.767265 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.767236    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5fa7070e-openshift-default-dockercfg-lx7pn\""
Sep 11 04:52:33.777115 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.777030    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"]
Sep 11 04:52:33.842358 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.842297    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-token\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.842498 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.842380    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1e7a13e-7eed-4e0b-87e6-412d44257686-istiod-ca-cert\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.842498 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.842411    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-workload-certs\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.842498 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.842469    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq4pf\" (UniqueName: \"kubernetes.io/projected/d1e7a13e-7eed-4e0b-87e6-412d44257686-kube-api-access-dq4pf\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.842498 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.842493    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-workload-socket\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.842646 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.842516    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-credential-socket\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.842646 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.842532    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-podinfo\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.842646 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.842561    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-data\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.842737 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.842657    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-envoy\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.943493 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.943453    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1e7a13e-7eed-4e0b-87e6-412d44257686-istiod-ca-cert\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.943684 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.943510    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-workload-certs\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.943684 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.943583    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq4pf\" (UniqueName: \"kubernetes.io/projected/d1e7a13e-7eed-4e0b-87e6-412d44257686-kube-api-access-dq4pf\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.943684 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.943612    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-workload-socket\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.943684 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.943649    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-credential-socket\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.943684 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.943670    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-podinfo\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.943954 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.943703    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-data\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.943954 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.943738    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-envoy\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.943954 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.943765    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-token\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.944130 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.943986    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-workload-certs\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.944130 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.944052    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-credential-socket\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.944210 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.944194    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-workload-socket\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.944253 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.944202    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-data\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.944253 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.944247    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1e7a13e-7eed-4e0b-87e6-412d44257686-istiod-ca-cert\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.946288 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.946258    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-envoy\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.946524 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.946507    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-podinfo\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.951660 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.951638    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-token\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:33.952167 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:33.952144    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq4pf\" (UniqueName: \"kubernetes.io/projected/d1e7a13e-7eed-4e0b-87e6-412d44257686-kube-api-access-dq4pf\") pod \"e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") " pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:34.077803 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:34.077712    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:34.361584 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:34.361507    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"]
Sep 11 04:52:34.364927 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:52:34.364899    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e7a13e_7eed_4e0b_87e6_412d44257686.slice/crio-e2699d979803419cbc19f86539ac39a313106a7b640647baeb8742cef4202972 WatchSource:0}: Error finding container e2699d979803419cbc19f86539ac39a313106a7b640647baeb8742cef4202972: Status 404 returned error can't find the container with id e2699d979803419cbc19f86539ac39a313106a7b640647baeb8742cef4202972
Sep 11 04:52:34.367169 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:34.367137    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:52:34.367257 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:34.367204    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:52:34.367257 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:34.367232    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:52:35.334187 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:35.334157    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg" event={"ID":"d1e7a13e-7eed-4e0b-87e6-412d44257686","Type":"ContainerStarted","Data":"6f43e8fbae9a4ac5fa136ff83f90e383a503df0f20e39f3c21b0e11af8150173"}
Sep 11 04:52:35.334300 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:35.334212    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg" event={"ID":"d1e7a13e-7eed-4e0b-87e6-412d44257686","Type":"ContainerStarted","Data":"e2699d979803419cbc19f86539ac39a313106a7b640647baeb8742cef4202972"}
Sep 11 04:52:35.356846 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:35.356797    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg" podStartSLOduration=2.356778989 podStartE2EDuration="2.356778989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:52:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:52:35.354855969 +0000 UTC m=+745.008115649" watchObservedRunningTime="2026-09-11 04:52:35.356778989 +0000 UTC m=+745.010038669"
Sep 11 04:52:35.523977 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:35.523950    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-6b98fd"
Sep 11 04:52:35.559068 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:35.559035    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcqc8\" (UniqueName: \"kubernetes.io/projected/2b70e6ff-f5fb-4884-b747-f87058b00d91-kube-api-access-rcqc8\") pod \"2b70e6ff-f5fb-4884-b747-f87058b00d91\" (UID: \"2b70e6ff-f5fb-4884-b747-f87058b00d91\") "
Sep 11 04:52:35.561249 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:35.561217    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b70e6ff-f5fb-4884-b747-f87058b00d91-kube-api-access-rcqc8" (OuterVolumeSpecName: "kube-api-access-rcqc8") pod "2b70e6ff-f5fb-4884-b747-f87058b00d91" (UID: "2b70e6ff-f5fb-4884-b747-f87058b00d91"). InnerVolumeSpecName "kube-api-access-rcqc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:52:35.659909 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:35.659877    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcqc8\" (UniqueName: \"kubernetes.io/projected/2b70e6ff-f5fb-4884-b747-f87058b00d91-kube-api-access-rcqc8\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:52:36.078521 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:36.078423    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:36.084350 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:36.084307    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:36.340622 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:36.340533    2554 generic.go:356] "Generic (PLEG): container finished" podID="2b70e6ff-f5fb-4884-b747-f87058b00d91" containerID="22745f615a2f03354fc94e42ccb5b14d4e485c965c0e108748b30ba60529e564" exitCode=137
Sep 11 04:52:36.340622 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:36.340587    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7527-6b98fd"
Sep 11 04:52:36.340849 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:36.340642    2554 scope.go:117] "RemoveContainer" containerID="22745f615a2f03354fc94e42ccb5b14d4e485c965c0e108748b30ba60529e564"
Sep 11 04:52:36.341213 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:36.341063    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:36.342249 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:36.342228    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:36.351552 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:36.351531    2554 scope.go:117] "RemoveContainer" containerID="22745f615a2f03354fc94e42ccb5b14d4e485c965c0e108748b30ba60529e564"
Sep 11 04:52:36.351913 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:52:36.351890    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22745f615a2f03354fc94e42ccb5b14d4e485c965c0e108748b30ba60529e564\": container with ID starting with 22745f615a2f03354fc94e42ccb5b14d4e485c965c0e108748b30ba60529e564 not found: ID does not exist" containerID="22745f615a2f03354fc94e42ccb5b14d4e485c965c0e108748b30ba60529e564"
Sep 11 04:52:36.352005 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:36.351921    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22745f615a2f03354fc94e42ccb5b14d4e485c965c0e108748b30ba60529e564"} err="failed to get container status \"22745f615a2f03354fc94e42ccb5b14d4e485c965c0e108748b30ba60529e564\": rpc error: code = NotFound desc = could not find container \"22745f615a2f03354fc94e42ccb5b14d4e485c965c0e108748b30ba60529e564\": container with ID starting with 22745f615a2f03354fc94e42ccb5b14d4e485c965c0e108748b30ba60529e564 not found: ID does not exist"
Sep 11 04:52:36.364313 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:52:36.364263    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7527-6b98fd\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" podUID="2b70e6ff-f5fb-4884-b747-f87058b00d91" pod="opendatahub/test-curl-7527-6b98fd"
Sep 11 04:52:36.815089 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:36.815058    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b70e6ff-f5fb-4884-b747-f87058b00d91" path="/var/lib/kubelet/pods/2b70e6ff-f5fb-4884-b747-f87058b00d91/volumes"
Sep 11 04:52:37.884212 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:37.884174    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"]
Sep 11 04:52:37.890415 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:37.890388    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"
Sep 11 04:52:37.893022 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:37.892874    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-5fa7070e-serving-cert\""
Sep 11 04:52:37.914079 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:37.914042    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"]
Sep 11 04:52:37.980472 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:37.980440    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5qd2\" (UniqueName: \"kubernetes.io/projected/801cd01c-5db9-44b9-8894-5412e91378c6-kube-api-access-h5qd2\") pod \"maas-api-e2e-ait-5fa7070e-c86d9674-slgks\" (UID: \"801cd01c-5db9-44b9-8894-5412e91378c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"
Sep 11 04:52:37.980628 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:37.980505    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/801cd01c-5db9-44b9-8894-5412e91378c6-metrics-certs\") pod \"maas-api-e2e-ait-5fa7070e-c86d9674-slgks\" (UID: \"801cd01c-5db9-44b9-8894-5412e91378c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"
Sep 11 04:52:37.980696 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:37.980664    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/801cd01c-5db9-44b9-8894-5412e91378c6-maas-api-tls\") pod \"maas-api-e2e-ait-5fa7070e-c86d9674-slgks\" (UID: \"801cd01c-5db9-44b9-8894-5412e91378c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"
Sep 11 04:52:37.980744 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:37.980715    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/801cd01c-5db9-44b9-8894-5412e91378c6-openshift-service-ca\") pod \"maas-api-e2e-ait-5fa7070e-c86d9674-slgks\" (UID: \"801cd01c-5db9-44b9-8894-5412e91378c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"
Sep 11 04:52:38.081932 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:38.081890    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/801cd01c-5db9-44b9-8894-5412e91378c6-maas-api-tls\") pod \"maas-api-e2e-ait-5fa7070e-c86d9674-slgks\" (UID: \"801cd01c-5db9-44b9-8894-5412e91378c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"
Sep 11 04:52:38.081932 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:38.081939    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/801cd01c-5db9-44b9-8894-5412e91378c6-openshift-service-ca\") pod \"maas-api-e2e-ait-5fa7070e-c86d9674-slgks\" (UID: \"801cd01c-5db9-44b9-8894-5412e91378c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"
Sep 11 04:52:38.082201 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:38.081993    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5qd2\" (UniqueName: \"kubernetes.io/projected/801cd01c-5db9-44b9-8894-5412e91378c6-kube-api-access-h5qd2\") pod \"maas-api-e2e-ait-5fa7070e-c86d9674-slgks\" (UID: \"801cd01c-5db9-44b9-8894-5412e91378c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"
Sep 11 04:52:38.082201 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:38.082031    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/801cd01c-5db9-44b9-8894-5412e91378c6-metrics-certs\") pod \"maas-api-e2e-ait-5fa7070e-c86d9674-slgks\" (UID: \"801cd01c-5db9-44b9-8894-5412e91378c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"
Sep 11 04:52:38.082730 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:38.082702    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/801cd01c-5db9-44b9-8894-5412e91378c6-openshift-service-ca\") pod \"maas-api-e2e-ait-5fa7070e-c86d9674-slgks\" (UID: \"801cd01c-5db9-44b9-8894-5412e91378c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"
Sep 11 04:52:38.084619 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:38.084598    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/801cd01c-5db9-44b9-8894-5412e91378c6-maas-api-tls\") pod \"maas-api-e2e-ait-5fa7070e-c86d9674-slgks\" (UID: \"801cd01c-5db9-44b9-8894-5412e91378c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"
Sep 11 04:52:38.084709 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:38.084638    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/801cd01c-5db9-44b9-8894-5412e91378c6-metrics-certs\") pod \"maas-api-e2e-ait-5fa7070e-c86d9674-slgks\" (UID: \"801cd01c-5db9-44b9-8894-5412e91378c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"
Sep 11 04:52:38.089723 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:38.089697    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5qd2\" (UniqueName: \"kubernetes.io/projected/801cd01c-5db9-44b9-8894-5412e91378c6-kube-api-access-h5qd2\") pod \"maas-api-e2e-ait-5fa7070e-c86d9674-slgks\" (UID: \"801cd01c-5db9-44b9-8894-5412e91378c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"
Sep 11 04:52:38.230220 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:38.230185    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"
Sep 11 04:52:38.515425 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:38.513531    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"]
Sep 11 04:52:38.523250 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:52:38.523217    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod801cd01c_5db9_44b9_8894_5412e91378c6.slice/crio-d7cb4cb95cda2b949796e5dd490f63059b418b4817bb5841f97c6bb5fe9c7065 WatchSource:0}: Error finding container d7cb4cb95cda2b949796e5dd490f63059b418b4817bb5841f97c6bb5fe9c7065: Status 404 returned error can't find the container with id d7cb4cb95cda2b949796e5dd490f63059b418b4817bb5841f97c6bb5fe9c7065
Sep 11 04:52:39.332175 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:39.332149    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"
Sep 11 04:52:39.367076 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:39.367037    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks" event={"ID":"801cd01c-5db9-44b9-8894-5412e91378c6","Type":"ContainerStarted","Data":"a992d3a70d9bc67089ff4603a2bb6552003a0eba0a99e3729948d02f9e0be76f"}
Sep 11 04:52:39.367234 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:39.367103    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks" event={"ID":"801cd01c-5db9-44b9-8894-5412e91378c6","Type":"ContainerStarted","Data":"d7cb4cb95cda2b949796e5dd490f63059b418b4817bb5841f97c6bb5fe9c7065"}
Sep 11 04:52:39.367234 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:39.367213    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"
Sep 11 04:52:39.391751 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:39.391690    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks" podStartSLOduration=2.079944928 podStartE2EDuration="2.391672205s" totalImagesPullingTime="311.727277ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:52:39.391026798 +0000 UTC m=+749.044286480" watchObservedRunningTime="2026-09-11 04:52:39.391672205 +0000 UTC m=+749.044931885"
Sep 11 04:52:40.138503 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:40.138459    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"]
Sep 11 04:52:40.142399 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:40.142363    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"
Sep 11 04:52:40.147394 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:40.147367    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-0a8fef-serving-cert\""
Sep 11 04:52:40.174749 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:40.174717    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"]
Sep 11 04:52:40.208972 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:40.208904    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/158253c1-952d-4c5a-a078-2650480e9115-openshift-service-ca\") pod \"maas-api-e2e-autores-0a8fef-5475cf9d-944jb\" (UID: \"158253c1-952d-4c5a-a078-2650480e9115\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"
Sep 11 04:52:40.208972 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:40.208988    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/158253c1-952d-4c5a-a078-2650480e9115-metrics-certs\") pod \"maas-api-e2e-autores-0a8fef-5475cf9d-944jb\" (UID: \"158253c1-952d-4c5a-a078-2650480e9115\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"
Sep 11 04:52:40.209254 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:40.209023    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/158253c1-952d-4c5a-a078-2650480e9115-maas-api-tls\") pod \"maas-api-e2e-autores-0a8fef-5475cf9d-944jb\" (UID: \"158253c1-952d-4c5a-a078-2650480e9115\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"
Sep 11 04:52:40.209254 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:40.209068    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwvwb\" (UniqueName: \"kubernetes.io/projected/158253c1-952d-4c5a-a078-2650480e9115-kube-api-access-rwvwb\") pod \"maas-api-e2e-autores-0a8fef-5475cf9d-944jb\" (UID: \"158253c1-952d-4c5a-a078-2650480e9115\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"
Sep 11 04:52:40.312357 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:40.311888    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/158253c1-952d-4c5a-a078-2650480e9115-metrics-certs\") pod \"maas-api-e2e-autores-0a8fef-5475cf9d-944jb\" (UID: \"158253c1-952d-4c5a-a078-2650480e9115\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"
Sep 11 04:52:40.312357 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:40.311944    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/158253c1-952d-4c5a-a078-2650480e9115-maas-api-tls\") pod \"maas-api-e2e-autores-0a8fef-5475cf9d-944jb\" (UID: \"158253c1-952d-4c5a-a078-2650480e9115\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"
Sep 11 04:52:40.312357 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:40.311993    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwvwb\" (UniqueName: \"kubernetes.io/projected/158253c1-952d-4c5a-a078-2650480e9115-kube-api-access-rwvwb\") pod \"maas-api-e2e-autores-0a8fef-5475cf9d-944jb\" (UID: \"158253c1-952d-4c5a-a078-2650480e9115\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"
Sep 11 04:52:40.312357 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:40.312168    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/158253c1-952d-4c5a-a078-2650480e9115-openshift-service-ca\") pod \"maas-api-e2e-autores-0a8fef-5475cf9d-944jb\" (UID: \"158253c1-952d-4c5a-a078-2650480e9115\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"
Sep 11 04:52:40.319355 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:40.313033    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/158253c1-952d-4c5a-a078-2650480e9115-openshift-service-ca\") pod \"maas-api-e2e-autores-0a8fef-5475cf9d-944jb\" (UID: \"158253c1-952d-4c5a-a078-2650480e9115\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"
Sep 11 04:52:40.319355 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:52:40.313496    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-serving-cert: secret "maas-api-e2e-autores-0a8fef-serving-cert" not found
Sep 11 04:52:40.319355 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:52:40.313564    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/158253c1-952d-4c5a-a078-2650480e9115-maas-api-tls podName:158253c1-952d-4c5a-a078-2650480e9115 nodeName:}" failed. No retries permitted until 2026-09-11 04:52:40.813542825 +0000 UTC m=+750.466802497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/158253c1-952d-4c5a-a078-2650480e9115-maas-api-tls") pod "maas-api-e2e-autores-0a8fef-5475cf9d-944jb" (UID: "158253c1-952d-4c5a-a078-2650480e9115") : secret "maas-api-e2e-autores-0a8fef-serving-cert" not found
Sep 11 04:52:40.324029 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:40.323997    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/158253c1-952d-4c5a-a078-2650480e9115-metrics-certs\") pod \"maas-api-e2e-autores-0a8fef-5475cf9d-944jb\" (UID: \"158253c1-952d-4c5a-a078-2650480e9115\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"
Sep 11 04:52:40.337158 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:40.337133    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwvwb\" (UniqueName: \"kubernetes.io/projected/158253c1-952d-4c5a-a078-2650480e9115-kube-api-access-rwvwb\") pod \"maas-api-e2e-autores-0a8fef-5475cf9d-944jb\" (UID: \"158253c1-952d-4c5a-a078-2650480e9115\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"
Sep 11 04:52:40.821506 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:40.821442    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/158253c1-952d-4c5a-a078-2650480e9115-maas-api-tls\") pod \"maas-api-e2e-autores-0a8fef-5475cf9d-944jb\" (UID: \"158253c1-952d-4c5a-a078-2650480e9115\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"
Sep 11 04:52:40.825351 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:40.824906    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/158253c1-952d-4c5a-a078-2650480e9115-maas-api-tls\") pod \"maas-api-e2e-autores-0a8fef-5475cf9d-944jb\" (UID: \"158253c1-952d-4c5a-a078-2650480e9115\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"
Sep 11 04:52:41.054963 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:41.054930    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"
Sep 11 04:52:41.368036 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:41.367974    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"]
Sep 11 04:52:41.370690 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:52:41.370645    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod158253c1_952d_4c5a_a078_2650480e9115.slice/crio-32e3351303901c2ed4661d7c633ad568cc48c763a744ac4e478e29ff8827a5e2 WatchSource:0}: Error finding container 32e3351303901c2ed4661d7c633ad568cc48c763a744ac4e478e29ff8827a5e2: Status 404 returned error can't find the container with id 32e3351303901c2ed4661d7c633ad568cc48c763a744ac4e478e29ff8827a5e2
Sep 11 04:52:41.380869 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:41.380841    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb" event={"ID":"158253c1-952d-4c5a-a078-2650480e9115","Type":"ContainerStarted","Data":"32e3351303901c2ed4661d7c633ad568cc48c763a744ac4e478e29ff8827a5e2"}
Sep 11 04:52:42.387859 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:42.387825    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb" event={"ID":"158253c1-952d-4c5a-a078-2650480e9115","Type":"ContainerStarted","Data":"8b1c3afbb6b8002e7d673b138965e1da5654413d8c48648a2d604c54b65d0e95"}
Sep 11 04:52:42.388273 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:42.387955    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"
Sep 11 04:52:43.900300 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:43.900235    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb" podStartSLOduration=3.517096494 podStartE2EDuration="3.900211455s" totalImagesPullingTime="383.114961ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:52:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:52:42.407205853 +0000 UTC m=+752.060465534" watchObservedRunningTime="2026-09-11 04:52:43.900211455 +0000 UTC m=+753.553471134"
Sep 11 04:52:43.902084 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:43.902055    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:52:44.326543 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:44.326495    2554 patch_prober.go:28] interesting pod/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 04:52:44.326775 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:44.326577    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92" podUID="ed631a0a-5452-4f22-a669-2960576df5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 04:52:45.380693 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:45.380664    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"
Sep 11 04:52:47.427240 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:47.427199    2554 generic.go:356] "Generic (PLEG): container finished" podID="ed631a0a-5452-4f22-a669-2960576df5d7" containerID="76ec04ecf6c4c71a74f68036f069e5fda265b1420559a11848b0bb9a06404e8c" exitCode=0
Sep 11 04:52:47.427679 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:47.427277    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92" event={"ID":"ed631a0a-5452-4f22-a669-2960576df5d7","Type":"ContainerDied","Data":"76ec04ecf6c4c71a74f68036f069e5fda265b1420559a11848b0bb9a06404e8c"}
Sep 11 04:52:47.427761 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:47.427744    2554 scope.go:117] "RemoveContainer" containerID="76ec04ecf6c4c71a74f68036f069e5fda265b1420559a11848b0bb9a06404e8c"
Sep 11 04:52:47.428917 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:47.428887    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:52:47.428980 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:47.428967    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:52:47.429019 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:47.429001    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:52:48.408711 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:48.408673    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"
Sep 11 04:52:48.440234 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:48.440187    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92" event={"ID":"ed631a0a-5452-4f22-a669-2960576df5d7","Type":"ContainerStarted","Data":"c7131e581118d4e93424ce022affc04738858adc4efb34d3b5d8e84483fdc6d0"}
Sep 11 04:52:49.328436 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:49.328316    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:49.328699 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:49.328499    2554 patch_prober.go:28] interesting pod/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 11 04:52:49.328856 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:49.328832    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92" podUID="ed631a0a-5452-4f22-a669-2960576df5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 11 04:52:50.328496 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:50.328458    2554 patch_prober.go:28] interesting pod/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 11 04:52:50.329664 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:50.329204    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92" podUID="ed631a0a-5452-4f22-a669-2960576df5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 11 04:52:51.328482 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:51.328443    2554 patch_prober.go:28] interesting pod/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 11 04:52:51.328682 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:51.328504    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92" podUID="ed631a0a-5452-4f22-a669-2960576df5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 11 04:52:52.328310 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:52.328263    2554 patch_prober.go:28] interesting pod/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 11 04:52:52.328507 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:52.328397    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92" podUID="ed631a0a-5452-4f22-a669-2960576df5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 11 04:52:52.381527 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:52.381487    2554 patch_prober.go:28] interesting pod/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 04:52:52.381900 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:52.381555    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg" podUID="d1e7a13e-7eed-4e0b-87e6-412d44257686" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 04:52:53.328418 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:53.328367    2554 patch_prober.go:28] interesting pod/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 11 04:52:53.328641 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:53.328450    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92" podUID="ed631a0a-5452-4f22-a669-2960576df5d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 11 04:52:54.332371 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:54.332318    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:54.332847 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:54.332825    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:54.333712 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:54.333686    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:52:55.483619 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:55.483586    2554 generic.go:356] "Generic (PLEG): container finished" podID="d1e7a13e-7eed-4e0b-87e6-412d44257686" containerID="6f43e8fbae9a4ac5fa136ff83f90e383a503df0f20e39f3c21b0e11af8150173" exitCode=0
Sep 11 04:52:55.484095 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:55.483659    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg" event={"ID":"d1e7a13e-7eed-4e0b-87e6-412d44257686","Type":"ContainerDied","Data":"6f43e8fbae9a4ac5fa136ff83f90e383a503df0f20e39f3c21b0e11af8150173"}
Sep 11 04:52:55.484200 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:55.484183    2554 scope.go:117] "RemoveContainer" containerID="6f43e8fbae9a4ac5fa136ff83f90e383a503df0f20e39f3c21b0e11af8150173"
Sep 11 04:52:55.485200 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:55.485174    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:52:55.485270 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:55.485241    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:52:55.485307 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:55.485272    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:52:56.491320 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:56.491289    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg" event={"ID":"d1e7a13e-7eed-4e0b-87e6-412d44257686","Type":"ContainerStarted","Data":"04b206289630a8e0438763499a3de10b02a93aec19429b850cf45b3684a74a66"}
Sep 11 04:52:57.078298 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:57.078262    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:52:57.078608 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:57.078479    2554 patch_prober.go:28] interesting pod/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 04:52:57.078608 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:57.078538    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg" podUID="d1e7a13e-7eed-4e0b-87e6-412d44257686" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 04:52:58.079039 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:58.079005    2554 patch_prober.go:28] interesting pod/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 04:52:58.079472 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:58.079062    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg" podUID="d1e7a13e-7eed-4e0b-87e6-412d44257686" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 04:52:59.078957 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:59.078919    2554 patch_prober.go:28] interesting pod/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 04:52:59.079136 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:59.078975    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg" podUID="d1e7a13e-7eed-4e0b-87e6-412d44257686" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 04:52:59.862155 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:59.862074    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"]
Sep 11 04:52:59.865206 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:59.865185    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"
Sep 11 04:52:59.868119 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:59.867996    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-7bdb3c-serving-cert\""
Sep 11 04:52:59.877055 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:59.877024    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"]
Sep 11 04:52:59.910500 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:59.910459    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:52:59.943823 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:59.943737    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db9f59e7-071d-4ccb-88b9-120182e01026-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q\" (UID: \"db9f59e7-071d-4ccb-88b9-120182e01026\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"
Sep 11 04:52:59.944024 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:59.943900    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db9f59e7-071d-4ccb-88b9-120182e01026-metrics-certs\") pod \"maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q\" (UID: \"db9f59e7-071d-4ccb-88b9-120182e01026\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"
Sep 11 04:52:59.944098 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:59.944085    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8ntq\" (UniqueName: \"kubernetes.io/projected/db9f59e7-071d-4ccb-88b9-120182e01026-kube-api-access-f8ntq\") pod \"maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q\" (UID: \"db9f59e7-071d-4ccb-88b9-120182e01026\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"
Sep 11 04:52:59.944269 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:52:59.944254    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db9f59e7-071d-4ccb-88b9-120182e01026-maas-api-tls\") pod \"maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q\" (UID: \"db9f59e7-071d-4ccb-88b9-120182e01026\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"
Sep 11 04:53:00.044969 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:00.044937    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db9f59e7-071d-4ccb-88b9-120182e01026-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q\" (UID: \"db9f59e7-071d-4ccb-88b9-120182e01026\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"
Sep 11 04:53:00.045206 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:00.045192    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db9f59e7-071d-4ccb-88b9-120182e01026-metrics-certs\") pod \"maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q\" (UID: \"db9f59e7-071d-4ccb-88b9-120182e01026\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"
Sep 11 04:53:00.045320 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:00.045309    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8ntq\" (UniqueName: \"kubernetes.io/projected/db9f59e7-071d-4ccb-88b9-120182e01026-kube-api-access-f8ntq\") pod \"maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q\" (UID: \"db9f59e7-071d-4ccb-88b9-120182e01026\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"
Sep 11 04:53:00.045518 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:00.045506    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db9f59e7-071d-4ccb-88b9-120182e01026-maas-api-tls\") pod \"maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q\" (UID: \"db9f59e7-071d-4ccb-88b9-120182e01026\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"
Sep 11 04:53:00.045695 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:53:00.045683    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-serving-cert: secret "maas-api-e2e-inf-b-7bdb3c-serving-cert" not found
Sep 11 04:53:00.045867 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:53:00.045853    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db9f59e7-071d-4ccb-88b9-120182e01026-maas-api-tls podName:db9f59e7-071d-4ccb-88b9-120182e01026 nodeName:}" failed. No retries permitted until 2026-09-11 04:53:00.545832614 +0000 UTC m=+770.199092272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/db9f59e7-071d-4ccb-88b9-120182e01026-maas-api-tls") pod "maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q" (UID: "db9f59e7-071d-4ccb-88b9-120182e01026") : secret "maas-api-e2e-inf-b-7bdb3c-serving-cert" not found
Sep 11 04:53:00.046601 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:00.046576    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db9f59e7-071d-4ccb-88b9-120182e01026-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q\" (UID: \"db9f59e7-071d-4ccb-88b9-120182e01026\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"
Sep 11 04:53:00.048179 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:00.048160    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db9f59e7-071d-4ccb-88b9-120182e01026-metrics-certs\") pod \"maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q\" (UID: \"db9f59e7-071d-4ccb-88b9-120182e01026\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"
Sep 11 04:53:00.054831 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:00.054804    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8ntq\" (UniqueName: \"kubernetes.io/projected/db9f59e7-071d-4ccb-88b9-120182e01026-kube-api-access-f8ntq\") pod \"maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q\" (UID: \"db9f59e7-071d-4ccb-88b9-120182e01026\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"
Sep 11 04:53:00.078834 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:00.078799    2554 patch_prober.go:28] interesting pod/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 04:53:00.078988 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:00.078858    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg" podUID="d1e7a13e-7eed-4e0b-87e6-412d44257686" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 04:53:00.551939 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:00.551897    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db9f59e7-071d-4ccb-88b9-120182e01026-maas-api-tls\") pod \"maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q\" (UID: \"db9f59e7-071d-4ccb-88b9-120182e01026\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"
Sep 11 04:53:00.554769 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:00.554743    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db9f59e7-071d-4ccb-88b9-120182e01026-maas-api-tls\") pod \"maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q\" (UID: \"db9f59e7-071d-4ccb-88b9-120182e01026\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"
Sep 11 04:53:00.778647 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:00.778602    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"
Sep 11 04:53:01.079398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:01.079304    2554 patch_prober.go:28] interesting pod/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 11 04:53:01.079488 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:01.079408    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg" podUID="d1e7a13e-7eed-4e0b-87e6-412d44257686" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 11 04:53:01.080963 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:01.080934    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"]
Sep 11 04:53:01.082677 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:53:01.082652    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9f59e7_071d_4ccb_88b9_120182e01026.slice/crio-d9fb813f62ad9a93042010043b2443a7224f39ad70d72f46c9a6c085c4d38dea WatchSource:0}: Error finding container d9fb813f62ad9a93042010043b2443a7224f39ad70d72f46c9a6c085c4d38dea: Status 404 returned error can't find the container with id d9fb813f62ad9a93042010043b2443a7224f39ad70d72f46c9a6c085c4d38dea
Sep 11 04:53:01.532087 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:01.532047    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q" event={"ID":"db9f59e7-071d-4ccb-88b9-120182e01026","Type":"ContainerStarted","Data":"64c4aa91f47dc2a2a7b203ddd423d7924d352524a65a7d75143ab3436e3e7be9"}
Sep 11 04:53:01.532253 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:01.532113    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q" event={"ID":"db9f59e7-071d-4ccb-88b9-120182e01026","Type":"ContainerStarted","Data":"d9fb813f62ad9a93042010043b2443a7224f39ad70d72f46c9a6c085c4d38dea"}
Sep 11 04:53:01.532253 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:01.532141    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"
Sep 11 04:53:01.548574 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:01.548508    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q" podStartSLOduration=2.248324126 podStartE2EDuration="2.548488562s" totalImagesPullingTime="300.164436ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:52:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:53:01.546746482 +0000 UTC m=+771.200006164" watchObservedRunningTime="2026-09-11 04:53:01.548488562 +0000 UTC m=+771.201748261"
Sep 11 04:53:02.082797 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:02.082758    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:53:02.083228 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:02.083056    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:53:02.083860 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:02.083832    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:53:07.543912 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:07.543885    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"
Sep 11 04:53:16.492881 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:16.492848    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:53:18.589440 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:18.589402    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"]
Sep 11 04:53:18.589848 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:18.589616    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks" podUID="801cd01c-5db9-44b9-8894-5412e91378c6" containerName="maas-api" containerID="cri-o://a992d3a70d9bc67089ff4603a2bb6552003a0eba0a99e3729948d02f9e0be76f" gracePeriod=30
Sep 11 04:53:18.856526 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:18.856500    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"
Sep 11 04:53:18.927747 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:18.927711    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"]
Sep 11 04:53:18.928011 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:18.927983    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg" podUID="d1e7a13e-7eed-4e0b-87e6-412d44257686" containerName="istio-proxy" containerID="cri-o://04b206289630a8e0438763499a3de10b02a93aec19429b850cf45b3684a74a66" gracePeriod=30
Sep 11 04:53:18.935317 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:18.935291    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/801cd01c-5db9-44b9-8894-5412e91378c6-metrics-certs\") pod \"801cd01c-5db9-44b9-8894-5412e91378c6\" (UID: \"801cd01c-5db9-44b9-8894-5412e91378c6\") "
Sep 11 04:53:18.935513 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:18.935443    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/801cd01c-5db9-44b9-8894-5412e91378c6-openshift-service-ca\") pod \"801cd01c-5db9-44b9-8894-5412e91378c6\" (UID: \"801cd01c-5db9-44b9-8894-5412e91378c6\") "
Sep 11 04:53:18.935513 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:18.935504    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/801cd01c-5db9-44b9-8894-5412e91378c6-maas-api-tls\") pod \"801cd01c-5db9-44b9-8894-5412e91378c6\" (UID: \"801cd01c-5db9-44b9-8894-5412e91378c6\") "
Sep 11 04:53:18.935638 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:18.935582    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5qd2\" (UniqueName: \"kubernetes.io/projected/801cd01c-5db9-44b9-8894-5412e91378c6-kube-api-access-h5qd2\") pod \"801cd01c-5db9-44b9-8894-5412e91378c6\" (UID: \"801cd01c-5db9-44b9-8894-5412e91378c6\") "
Sep 11 04:53:18.935842 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:18.935802    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/801cd01c-5db9-44b9-8894-5412e91378c6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "801cd01c-5db9-44b9-8894-5412e91378c6" (UID: "801cd01c-5db9-44b9-8894-5412e91378c6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:53:18.936052 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:18.935905    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/801cd01c-5db9-44b9-8894-5412e91378c6-openshift-service-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:53:18.938033 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:18.938002    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/801cd01c-5db9-44b9-8894-5412e91378c6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "801cd01c-5db9-44b9-8894-5412e91378c6" (UID: "801cd01c-5db9-44b9-8894-5412e91378c6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:53:18.938130 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:18.938084    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/801cd01c-5db9-44b9-8894-5412e91378c6-kube-api-access-h5qd2" (OuterVolumeSpecName: "kube-api-access-h5qd2") pod "801cd01c-5db9-44b9-8894-5412e91378c6" (UID: "801cd01c-5db9-44b9-8894-5412e91378c6"). InnerVolumeSpecName "kube-api-access-h5qd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:53:18.938545 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:18.938517    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/801cd01c-5db9-44b9-8894-5412e91378c6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "801cd01c-5db9-44b9-8894-5412e91378c6" (UID: "801cd01c-5db9-44b9-8894-5412e91378c6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:53:19.036993 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:19.036954    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/801cd01c-5db9-44b9-8894-5412e91378c6-maas-api-tls\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:53:19.037190 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:19.037065    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5qd2\" (UniqueName: \"kubernetes.io/projected/801cd01c-5db9-44b9-8894-5412e91378c6-kube-api-access-h5qd2\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:53:19.037190 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:19.037098    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/801cd01c-5db9-44b9-8894-5412e91378c6-metrics-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:53:19.633321 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:19.633286    2554 generic.go:356] "Generic (PLEG): container finished" podID="801cd01c-5db9-44b9-8894-5412e91378c6" containerID="a992d3a70d9bc67089ff4603a2bb6552003a0eba0a99e3729948d02f9e0be76f" exitCode=0
Sep 11 04:53:19.633817 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:19.633361    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"
Sep 11 04:53:19.633817 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:19.633379    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks" event={"ID":"801cd01c-5db9-44b9-8894-5412e91378c6","Type":"ContainerDied","Data":"a992d3a70d9bc67089ff4603a2bb6552003a0eba0a99e3729948d02f9e0be76f"}
Sep 11 04:53:19.633817 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:19.633442    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks" event={"ID":"801cd01c-5db9-44b9-8894-5412e91378c6","Type":"ContainerDied","Data":"d7cb4cb95cda2b949796e5dd490f63059b418b4817bb5841f97c6bb5fe9c7065"}
Sep 11 04:53:19.633817 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:19.633466    2554 scope.go:117] "RemoveContainer" containerID="a992d3a70d9bc67089ff4603a2bb6552003a0eba0a99e3729948d02f9e0be76f"
Sep 11 04:53:19.643201 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:19.643180    2554 scope.go:117] "RemoveContainer" containerID="a992d3a70d9bc67089ff4603a2bb6552003a0eba0a99e3729948d02f9e0be76f"
Sep 11 04:53:19.643533 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:53:19.643515    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a992d3a70d9bc67089ff4603a2bb6552003a0eba0a99e3729948d02f9e0be76f\": container with ID starting with a992d3a70d9bc67089ff4603a2bb6552003a0eba0a99e3729948d02f9e0be76f not found: ID does not exist" containerID="a992d3a70d9bc67089ff4603a2bb6552003a0eba0a99e3729948d02f9e0be76f"
Sep 11 04:53:19.643591 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:19.643543    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a992d3a70d9bc67089ff4603a2bb6552003a0eba0a99e3729948d02f9e0be76f"} err="failed to get container status \"a992d3a70d9bc67089ff4603a2bb6552003a0eba0a99e3729948d02f9e0be76f\": rpc error: code = NotFound desc = could not find container \"a992d3a70d9bc67089ff4603a2bb6552003a0eba0a99e3729948d02f9e0be76f\": container with ID starting with a992d3a70d9bc67089ff4603a2bb6552003a0eba0a99e3729948d02f9e0be76f not found: ID does not exist"
Sep 11 04:53:19.653823 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:19.653792    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"]
Sep 11 04:53:19.657475 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:19.657450    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-5fa7070e-c86d9674-slgks"]
Sep 11 04:53:20.815820 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:20.815788    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="801cd01c-5db9-44b9-8894-5412e91378c6" path="/var/lib/kubelet/pods/801cd01c-5db9-44b9-8894-5412e91378c6/volumes"
Sep 11 04:53:22.767467 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:22.766147    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"]
Sep 11 04:53:22.767467 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:22.766890    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="801cd01c-5db9-44b9-8894-5412e91378c6" containerName="maas-api"
Sep 11 04:53:22.767467 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:22.766912    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="801cd01c-5db9-44b9-8894-5412e91378c6" containerName="maas-api"
Sep 11 04:53:22.767467 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:22.767001    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="801cd01c-5db9-44b9-8894-5412e91378c6" containerName="maas-api"
Sep 11 04:53:22.774358 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:22.774271    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"
Sep 11 04:53:22.776807 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:22.776778    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-1ecf5332-serving-cert\""
Sep 11 04:53:22.782214 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:22.782187    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"]
Sep 11 04:53:22.877044 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:22.877002    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c703ab7-8be2-4714-ba15-8b40714bb664-metrics-certs\") pod \"maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv\" (UID: \"8c703ab7-8be2-4714-ba15-8b40714bb664\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"
Sep 11 04:53:22.877251 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:22.877157    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c703ab7-8be2-4714-ba15-8b40714bb664-openshift-service-ca\") pod \"maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv\" (UID: \"8c703ab7-8be2-4714-ba15-8b40714bb664\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"
Sep 11 04:53:22.877251 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:22.877229    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c703ab7-8be2-4714-ba15-8b40714bb664-maas-api-tls\") pod \"maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv\" (UID: \"8c703ab7-8be2-4714-ba15-8b40714bb664\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"
Sep 11 04:53:22.877536 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:22.877255    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtp7x\" (UniqueName: \"kubernetes.io/projected/8c703ab7-8be2-4714-ba15-8b40714bb664-kube-api-access-mtp7x\") pod \"maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv\" (UID: \"8c703ab7-8be2-4714-ba15-8b40714bb664\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"
Sep 11 04:53:22.978343 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:22.978307    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c703ab7-8be2-4714-ba15-8b40714bb664-metrics-certs\") pod \"maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv\" (UID: \"8c703ab7-8be2-4714-ba15-8b40714bb664\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"
Sep 11 04:53:22.978577 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:22.978428    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c703ab7-8be2-4714-ba15-8b40714bb664-openshift-service-ca\") pod \"maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv\" (UID: \"8c703ab7-8be2-4714-ba15-8b40714bb664\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"
Sep 11 04:53:22.978577 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:22.978469    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c703ab7-8be2-4714-ba15-8b40714bb664-maas-api-tls\") pod \"maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv\" (UID: \"8c703ab7-8be2-4714-ba15-8b40714bb664\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"
Sep 11 04:53:22.978577 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:22.978486    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtp7x\" (UniqueName: \"kubernetes.io/projected/8c703ab7-8be2-4714-ba15-8b40714bb664-kube-api-access-mtp7x\") pod \"maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv\" (UID: \"8c703ab7-8be2-4714-ba15-8b40714bb664\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"
Sep 11 04:53:22.978746 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:53:22.978616    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-serving-cert: secret "maas-api-e2e-migrate-1ecf5332-serving-cert" not found
Sep 11 04:53:22.978746 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:53:22.978708    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c703ab7-8be2-4714-ba15-8b40714bb664-maas-api-tls podName:8c703ab7-8be2-4714-ba15-8b40714bb664 nodeName:}" failed. No retries permitted until 2026-09-11 04:53:23.478688259 +0000 UTC m=+793.131947938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8c703ab7-8be2-4714-ba15-8b40714bb664-maas-api-tls") pod "maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv" (UID: "8c703ab7-8be2-4714-ba15-8b40714bb664") : secret "maas-api-e2e-migrate-1ecf5332-serving-cert" not found
Sep 11 04:53:22.979295 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:22.979270    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c703ab7-8be2-4714-ba15-8b40714bb664-openshift-service-ca\") pod \"maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv\" (UID: \"8c703ab7-8be2-4714-ba15-8b40714bb664\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"
Sep 11 04:53:22.981201 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:22.981173    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c703ab7-8be2-4714-ba15-8b40714bb664-metrics-certs\") pod \"maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv\" (UID: \"8c703ab7-8be2-4714-ba15-8b40714bb664\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"
Sep 11 04:53:22.986874 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:22.986853    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtp7x\" (UniqueName: \"kubernetes.io/projected/8c703ab7-8be2-4714-ba15-8b40714bb664-kube-api-access-mtp7x\") pod \"maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv\" (UID: \"8c703ab7-8be2-4714-ba15-8b40714bb664\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"
Sep 11 04:53:23.483773 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:23.483731    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c703ab7-8be2-4714-ba15-8b40714bb664-maas-api-tls\") pod \"maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv\" (UID: \"8c703ab7-8be2-4714-ba15-8b40714bb664\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"
Sep 11 04:53:23.486401 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:23.486372    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c703ab7-8be2-4714-ba15-8b40714bb664-maas-api-tls\") pod \"maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv\" (UID: \"8c703ab7-8be2-4714-ba15-8b40714bb664\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"
Sep 11 04:53:23.692712 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:23.692675    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"
Sep 11 04:53:23.976706 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:23.976677    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"]
Sep 11 04:53:23.986463 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:53:23.986427    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c703ab7_8be2_4714_ba15_8b40714bb664.slice/crio-f7f120ebbe127648c026c64415dc109b1164333da4796915e4aea9ecfa365137 WatchSource:0}: Error finding container f7f120ebbe127648c026c64415dc109b1164333da4796915e4aea9ecfa365137: Status 404 returned error can't find the container with id f7f120ebbe127648c026c64415dc109b1164333da4796915e4aea9ecfa365137
Sep 11 04:53:24.199083 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.199058    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:53:24.292886 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.292786    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-token\") pod \"d1e7a13e-7eed-4e0b-87e6-412d44257686\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") "
Sep 11 04:53:24.292886 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.292845    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-workload-socket\") pod \"d1e7a13e-7eed-4e0b-87e6-412d44257686\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") "
Sep 11 04:53:24.293125 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.292936    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dq4pf\" (UniqueName: \"kubernetes.io/projected/d1e7a13e-7eed-4e0b-87e6-412d44257686-kube-api-access-dq4pf\") pod \"d1e7a13e-7eed-4e0b-87e6-412d44257686\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") "
Sep 11 04:53:24.293125 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.292983    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-workload-certs\") pod \"d1e7a13e-7eed-4e0b-87e6-412d44257686\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") "
Sep 11 04:53:24.293125 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.293026    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-data\") pod \"d1e7a13e-7eed-4e0b-87e6-412d44257686\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") "
Sep 11 04:53:24.293125 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.293060    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1e7a13e-7eed-4e0b-87e6-412d44257686-istiod-ca-cert\") pod \"d1e7a13e-7eed-4e0b-87e6-412d44257686\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") "
Sep 11 04:53:24.293125 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.293083    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-podinfo\") pod \"d1e7a13e-7eed-4e0b-87e6-412d44257686\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") "
Sep 11 04:53:24.293502 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.293134    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-envoy\") pod \"d1e7a13e-7eed-4e0b-87e6-412d44257686\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") "
Sep 11 04:53:24.293502 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.293172    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-credential-socket\") pod \"d1e7a13e-7eed-4e0b-87e6-412d44257686\" (UID: \"d1e7a13e-7eed-4e0b-87e6-412d44257686\") "
Sep 11 04:53:24.293502 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.293190    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d1e7a13e-7eed-4e0b-87e6-412d44257686" (UID: "d1e7a13e-7eed-4e0b-87e6-412d44257686"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:53:24.293502 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.293271    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d1e7a13e-7eed-4e0b-87e6-412d44257686" (UID: "d1e7a13e-7eed-4e0b-87e6-412d44257686"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:53:24.293698 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.293548    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-workload-socket\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:53:24.293698 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.293570    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-workload-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:53:24.293698 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.293656    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-data" (OuterVolumeSpecName: "istio-data") pod "d1e7a13e-7eed-4e0b-87e6-412d44257686" (UID: "d1e7a13e-7eed-4e0b-87e6-412d44257686"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:53:24.293841 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.293509    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1e7a13e-7eed-4e0b-87e6-412d44257686-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d1e7a13e-7eed-4e0b-87e6-412d44257686" (UID: "d1e7a13e-7eed-4e0b-87e6-412d44257686"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:53:24.293995 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.293960    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d1e7a13e-7eed-4e0b-87e6-412d44257686" (UID: "d1e7a13e-7eed-4e0b-87e6-412d44257686"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:53:24.295865 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.295800    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1e7a13e-7eed-4e0b-87e6-412d44257686-kube-api-access-dq4pf" (OuterVolumeSpecName: "kube-api-access-dq4pf") pod "d1e7a13e-7eed-4e0b-87e6-412d44257686" (UID: "d1e7a13e-7eed-4e0b-87e6-412d44257686"). InnerVolumeSpecName "kube-api-access-dq4pf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:53:24.296001 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.295913    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d1e7a13e-7eed-4e0b-87e6-412d44257686" (UID: "d1e7a13e-7eed-4e0b-87e6-412d44257686"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:53:24.296451 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.296423    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-token" (OuterVolumeSpecName: "istio-token") pod "d1e7a13e-7eed-4e0b-87e6-412d44257686" (UID: "d1e7a13e-7eed-4e0b-87e6-412d44257686"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:53:24.296556 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.296455    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d1e7a13e-7eed-4e0b-87e6-412d44257686" (UID: "d1e7a13e-7eed-4e0b-87e6-412d44257686"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:53:24.395089 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.395057    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-envoy\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:53:24.395089 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.395087    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-credential-socket\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:53:24.395089 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.395096    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-token\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:53:24.395556 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.395105    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq4pf\" (UniqueName: \"kubernetes.io/projected/d1e7a13e-7eed-4e0b-87e6-412d44257686-kube-api-access-dq4pf\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:53:24.395556 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.395114    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-data\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:53:24.395556 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.395123    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1e7a13e-7eed-4e0b-87e6-412d44257686-istiod-ca-cert\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:53:24.395556 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.395131    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1e7a13e-7eed-4e0b-87e6-412d44257686-istio-podinfo\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:53:24.663990 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.663951    2554 generic.go:356] "Generic (PLEG): container finished" podID="d1e7a13e-7eed-4e0b-87e6-412d44257686" containerID="04b206289630a8e0438763499a3de10b02a93aec19429b850cf45b3684a74a66" exitCode=0
Sep 11 04:53:24.664145 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.663999    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg" event={"ID":"d1e7a13e-7eed-4e0b-87e6-412d44257686","Type":"ContainerDied","Data":"04b206289630a8e0438763499a3de10b02a93aec19429b850cf45b3684a74a66"}
Sep 11 04:53:24.664145 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.664057    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg" event={"ID":"d1e7a13e-7eed-4e0b-87e6-412d44257686","Type":"ContainerDied","Data":"e2699d979803419cbc19f86539ac39a313106a7b640647baeb8742cef4202972"}
Sep 11 04:53:24.664145 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.664080    2554 scope.go:117] "RemoveContainer" containerID="04b206289630a8e0438763499a3de10b02a93aec19429b850cf45b3684a74a66"
Sep 11 04:53:24.664145 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.664009    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"
Sep 11 04:53:24.665983 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.665960    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv" event={"ID":"8c703ab7-8be2-4714-ba15-8b40714bb664","Type":"ContainerStarted","Data":"caf4fd22766a09eaaca5bdd365e7ede144071589269e84d114e810f1ad939931"}
Sep 11 04:53:24.666093 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.666007    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv" event={"ID":"8c703ab7-8be2-4714-ba15-8b40714bb664","Type":"ContainerStarted","Data":"f7f120ebbe127648c026c64415dc109b1164333da4796915e4aea9ecfa365137"}
Sep 11 04:53:24.666093 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.666043    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"
Sep 11 04:53:24.673585 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.673570    2554 scope.go:117] "RemoveContainer" containerID="6f43e8fbae9a4ac5fa136ff83f90e383a503df0f20e39f3c21b0e11af8150173"
Sep 11 04:53:24.682015 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.681996    2554 scope.go:117] "RemoveContainer" containerID="04b206289630a8e0438763499a3de10b02a93aec19429b850cf45b3684a74a66"
Sep 11 04:53:24.682307 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:53:24.682288    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04b206289630a8e0438763499a3de10b02a93aec19429b850cf45b3684a74a66\": container with ID starting with 04b206289630a8e0438763499a3de10b02a93aec19429b850cf45b3684a74a66 not found: ID does not exist" containerID="04b206289630a8e0438763499a3de10b02a93aec19429b850cf45b3684a74a66"
Sep 11 04:53:24.682384 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.682317    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b206289630a8e0438763499a3de10b02a93aec19429b850cf45b3684a74a66"} err="failed to get container status \"04b206289630a8e0438763499a3de10b02a93aec19429b850cf45b3684a74a66\": rpc error: code = NotFound desc = could not find container \"04b206289630a8e0438763499a3de10b02a93aec19429b850cf45b3684a74a66\": container with ID starting with 04b206289630a8e0438763499a3de10b02a93aec19429b850cf45b3684a74a66 not found: ID does not exist"
Sep 11 04:53:24.682384 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.682357    2554 scope.go:117] "RemoveContainer" containerID="6f43e8fbae9a4ac5fa136ff83f90e383a503df0f20e39f3c21b0e11af8150173"
Sep 11 04:53:24.682624 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:53:24.682606    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f43e8fbae9a4ac5fa136ff83f90e383a503df0f20e39f3c21b0e11af8150173\": container with ID starting with 6f43e8fbae9a4ac5fa136ff83f90e383a503df0f20e39f3c21b0e11af8150173 not found: ID does not exist" containerID="6f43e8fbae9a4ac5fa136ff83f90e383a503df0f20e39f3c21b0e11af8150173"
Sep 11 04:53:24.682666 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.682631    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f43e8fbae9a4ac5fa136ff83f90e383a503df0f20e39f3c21b0e11af8150173"} err="failed to get container status \"6f43e8fbae9a4ac5fa136ff83f90e383a503df0f20e39f3c21b0e11af8150173\": rpc error: code = NotFound desc = could not find container \"6f43e8fbae9a4ac5fa136ff83f90e383a503df0f20e39f3c21b0e11af8150173\": container with ID starting with 6f43e8fbae9a4ac5fa136ff83f90e383a503df0f20e39f3c21b0e11af8150173 not found: ID does not exist"
Sep 11 04:53:24.684749 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.684706    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv" podStartSLOduration=2.25390554 podStartE2EDuration="2.684692275s" totalImagesPullingTime="430.786735ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:53:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:53:24.683143411 +0000 UTC m=+794.336403092" watchObservedRunningTime="2026-09-11 04:53:24.684692275 +0000 UTC m=+794.337951955"
Sep 11 04:53:24.699625 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.699578    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"]
Sep 11 04:53:24.702244 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.702221    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5fa7070e-openshift-default-6d7b96c5d-stxbg"]
Sep 11 04:53:24.815008 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:24.814971    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1e7a13e-7eed-4e0b-87e6-412d44257686" path="/var/lib/kubelet/pods/d1e7a13e-7eed-4e0b-87e6-412d44257686/volumes"
Sep 11 04:53:30.677605 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:30.677571    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"
Sep 11 04:53:34.411651 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:34.411570    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:53:53.977900 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:53.977868    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"]
Sep 11 04:53:53.978432 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:53.978115    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv" podUID="8c703ab7-8be2-4714-ba15-8b40714bb664" containerName="maas-api" containerID="cri-o://caf4fd22766a09eaaca5bdd365e7ede144071589269e84d114e810f1ad939931" gracePeriod=30
Sep 11 04:53:54.239178 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.239112    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"
Sep 11 04:53:54.388177 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.388142    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c703ab7-8be2-4714-ba15-8b40714bb664-maas-api-tls\") pod \"8c703ab7-8be2-4714-ba15-8b40714bb664\" (UID: \"8c703ab7-8be2-4714-ba15-8b40714bb664\") "
Sep 11 04:53:54.388395 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.388224    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c703ab7-8be2-4714-ba15-8b40714bb664-openshift-service-ca\") pod \"8c703ab7-8be2-4714-ba15-8b40714bb664\" (UID: \"8c703ab7-8be2-4714-ba15-8b40714bb664\") "
Sep 11 04:53:54.388395 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.388245    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtp7x\" (UniqueName: \"kubernetes.io/projected/8c703ab7-8be2-4714-ba15-8b40714bb664-kube-api-access-mtp7x\") pod \"8c703ab7-8be2-4714-ba15-8b40714bb664\" (UID: \"8c703ab7-8be2-4714-ba15-8b40714bb664\") "
Sep 11 04:53:54.388395 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.388296    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c703ab7-8be2-4714-ba15-8b40714bb664-metrics-certs\") pod \"8c703ab7-8be2-4714-ba15-8b40714bb664\" (UID: \"8c703ab7-8be2-4714-ba15-8b40714bb664\") "
Sep 11 04:53:54.388585 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.388552    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c703ab7-8be2-4714-ba15-8b40714bb664-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8c703ab7-8be2-4714-ba15-8b40714bb664" (UID: "8c703ab7-8be2-4714-ba15-8b40714bb664"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:53:54.390678 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.390646    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c703ab7-8be2-4714-ba15-8b40714bb664-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8c703ab7-8be2-4714-ba15-8b40714bb664" (UID: "8c703ab7-8be2-4714-ba15-8b40714bb664"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:53:54.390678 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.390659    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c703ab7-8be2-4714-ba15-8b40714bb664-kube-api-access-mtp7x" (OuterVolumeSpecName: "kube-api-access-mtp7x") pod "8c703ab7-8be2-4714-ba15-8b40714bb664" (UID: "8c703ab7-8be2-4714-ba15-8b40714bb664"). InnerVolumeSpecName "kube-api-access-mtp7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:53:54.390678 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.390673    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c703ab7-8be2-4714-ba15-8b40714bb664-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8c703ab7-8be2-4714-ba15-8b40714bb664" (UID: "8c703ab7-8be2-4714-ba15-8b40714bb664"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:53:54.489167 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.489131    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c703ab7-8be2-4714-ba15-8b40714bb664-metrics-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:53:54.489167 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.489156    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c703ab7-8be2-4714-ba15-8b40714bb664-maas-api-tls\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:53:54.489167 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.489165    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c703ab7-8be2-4714-ba15-8b40714bb664-openshift-service-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:53:54.489167 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.489175    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtp7x\" (UniqueName: \"kubernetes.io/projected/8c703ab7-8be2-4714-ba15-8b40714bb664-kube-api-access-mtp7x\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:53:54.836825 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.836789    2554 generic.go:356] "Generic (PLEG): container finished" podID="8c703ab7-8be2-4714-ba15-8b40714bb664" containerID="caf4fd22766a09eaaca5bdd365e7ede144071589269e84d114e810f1ad939931" exitCode=0
Sep 11 04:53:54.836986 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.836833    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"
Sep 11 04:53:54.836986 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.836862    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv" event={"ID":"8c703ab7-8be2-4714-ba15-8b40714bb664","Type":"ContainerDied","Data":"caf4fd22766a09eaaca5bdd365e7ede144071589269e84d114e810f1ad939931"}
Sep 11 04:53:54.836986 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.836913    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv" event={"ID":"8c703ab7-8be2-4714-ba15-8b40714bb664","Type":"ContainerDied","Data":"f7f120ebbe127648c026c64415dc109b1164333da4796915e4aea9ecfa365137"}
Sep 11 04:53:54.836986 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.836935    2554 scope.go:117] "RemoveContainer" containerID="caf4fd22766a09eaaca5bdd365e7ede144071589269e84d114e810f1ad939931"
Sep 11 04:53:54.845684 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.845669    2554 scope.go:117] "RemoveContainer" containerID="caf4fd22766a09eaaca5bdd365e7ede144071589269e84d114e810f1ad939931"
Sep 11 04:53:54.845944 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:53:54.845927    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caf4fd22766a09eaaca5bdd365e7ede144071589269e84d114e810f1ad939931\": container with ID starting with caf4fd22766a09eaaca5bdd365e7ede144071589269e84d114e810f1ad939931 not found: ID does not exist" containerID="caf4fd22766a09eaaca5bdd365e7ede144071589269e84d114e810f1ad939931"
Sep 11 04:53:54.846020 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.845949    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caf4fd22766a09eaaca5bdd365e7ede144071589269e84d114e810f1ad939931"} err="failed to get container status \"caf4fd22766a09eaaca5bdd365e7ede144071589269e84d114e810f1ad939931\": rpc error: code = NotFound desc = could not find container \"caf4fd22766a09eaaca5bdd365e7ede144071589269e84d114e810f1ad939931\": container with ID starting with caf4fd22766a09eaaca5bdd365e7ede144071589269e84d114e810f1ad939931 not found: ID does not exist"
Sep 11 04:53:54.852076 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.852054    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"]
Sep 11 04:53:54.857590 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:54.857569    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1ecf5332-748b75bf8d-5hsgv"]
Sep 11 04:53:55.020523 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.020496    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"]
Sep 11 04:53:55.020966 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.020888    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c703ab7-8be2-4714-ba15-8b40714bb664" containerName="maas-api"
Sep 11 04:53:55.020966 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.020898    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c703ab7-8be2-4714-ba15-8b40714bb664" containerName="maas-api"
Sep 11 04:53:55.020966 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.020909    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1e7a13e-7eed-4e0b-87e6-412d44257686" containerName="istio-proxy"
Sep 11 04:53:55.020966 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.020916    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1e7a13e-7eed-4e0b-87e6-412d44257686" containerName="istio-proxy"
Sep 11 04:53:55.021159 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.020991    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1e7a13e-7eed-4e0b-87e6-412d44257686" containerName="istio-proxy"
Sep 11 04:53:55.021159 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.021002    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1e7a13e-7eed-4e0b-87e6-412d44257686" containerName="istio-proxy"
Sep 11 04:53:55.021159 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.021008    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c703ab7-8be2-4714-ba15-8b40714bb664" containerName="maas-api"
Sep 11 04:53:55.025465 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.025443    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.028082 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.028056    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1d2554f2-openshift-default-dockercfg-ssgp5\""
Sep 11 04:53:55.039594 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.039567    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"]
Sep 11 04:53:55.195486 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.195455    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-data\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.195658 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.195555    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-credential-socket\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.195658 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.195595    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-workload-socket\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.195658 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.195620    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-envoy\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.195658 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.195646    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istiod-ca-cert\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.195855 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.195745    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qlhv\" (UniqueName: \"kubernetes.io/projected/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-kube-api-access-5qlhv\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.195855 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.195782    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-podinfo\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.195855 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.195799    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-workload-certs\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.195855 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.195815    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-token\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.296985 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.296949    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-credential-socket\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.296985 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.296991    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-workload-socket\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.297227 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.297009    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-envoy\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.297227 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.297151    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istiod-ca-cert\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.297353 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.297268    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qlhv\" (UniqueName: \"kubernetes.io/projected/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-kube-api-access-5qlhv\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.297427 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.297363    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-podinfo\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.297427 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.297405    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-workload-certs\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.297427 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.297406    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-credential-socket\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.297576 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.297431    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-token\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.297576 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.297447    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-workload-socket\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.297576 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.297486    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-data\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.297743 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.297671    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-workload-certs\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.297863 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.297844    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-data\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.297949 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.297849    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istiod-ca-cert\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.299438 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.299417    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-envoy\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.299991 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.299970    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-podinfo\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.305223 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.305197    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-token\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.305704 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.305684    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qlhv\" (UniqueName: \"kubernetes.io/projected/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-kube-api-access-5qlhv\") pod \"e2e-ait-1d2554f2-openshift-default-767948699d-njrf5\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") " pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.335700 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.335661    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:55.613960 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.613936    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"]
Sep 11 04:53:55.616292 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:53:55.616268    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb8d1919_fce8_45fc_ab96_1f6f215f8b10.slice/crio-a3604da40d63ef0c82f672e27dfae4a671ce2b06357544569d949bab57966d0c WatchSource:0}: Error finding container a3604da40d63ef0c82f672e27dfae4a671ce2b06357544569d949bab57966d0c: Status 404 returned error can't find the container with id a3604da40d63ef0c82f672e27dfae4a671ce2b06357544569d949bab57966d0c
Sep 11 04:53:55.618973 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.618944    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:53:55.619056 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.619007    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:53:55.619056 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.619031    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:53:55.846644 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.846600    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5" event={"ID":"eb8d1919-fce8-45fc-ab96-1f6f215f8b10","Type":"ContainerStarted","Data":"b111ed6bc6ddc28e59e68d8454b1e5b1aa91eefbbd733461978d64a325c95681"}
Sep 11 04:53:55.846821 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.846674    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5" event={"ID":"eb8d1919-fce8-45fc-ab96-1f6f215f8b10","Type":"ContainerStarted","Data":"a3604da40d63ef0c82f672e27dfae4a671ce2b06357544569d949bab57966d0c"}
Sep 11 04:53:55.868945 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:55.868832    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5" podStartSLOduration=1.8688148359999999 podStartE2EDuration="1.868814836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:53:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:53:55.866207628 +0000 UTC m=+825.519467336" watchObservedRunningTime="2026-09-11 04:53:55.868814836 +0000 UTC m=+825.522074515"
Sep 11 04:53:56.336215 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:56.336184    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:56.341491 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:56.341468    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:56.814397 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:56.814359    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c703ab7-8be2-4714-ba15-8b40714bb664" path="/var/lib/kubelet/pods/8c703ab7-8be2-4714-ba15-8b40714bb664/volumes"
Sep 11 04:53:56.851136 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:56.851106    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:56.852120 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:56.852100    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:53:58.300250 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:58.300218    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"]
Sep 11 04:53:58.300753 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:58.300703    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1e7a13e-7eed-4e0b-87e6-412d44257686" containerName="istio-proxy"
Sep 11 04:53:58.300753 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:58.300715    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1e7a13e-7eed-4e0b-87e6-412d44257686" containerName="istio-proxy"
Sep 11 04:53:58.304186 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:58.304162    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"
Sep 11 04:53:58.306709 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:58.306682    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-1d2554f2-serving-cert\""
Sep 11 04:53:58.312865 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:58.312844    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"]
Sep 11 04:53:58.325983 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:58.325950    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/636929dd-6a18-46d4-a715-4ca598d20791-openshift-service-ca\") pod \"maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl\" (UID: \"636929dd-6a18-46d4-a715-4ca598d20791\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"
Sep 11 04:53:58.326103 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:58.326014    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/636929dd-6a18-46d4-a715-4ca598d20791-maas-api-tls\") pod \"maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl\" (UID: \"636929dd-6a18-46d4-a715-4ca598d20791\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"
Sep 11 04:53:58.326103 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:58.326060    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wt6j\" (UniqueName: \"kubernetes.io/projected/636929dd-6a18-46d4-a715-4ca598d20791-kube-api-access-2wt6j\") pod \"maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl\" (UID: \"636929dd-6a18-46d4-a715-4ca598d20791\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"
Sep 11 04:53:58.326250 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:58.326158    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/636929dd-6a18-46d4-a715-4ca598d20791-metrics-certs\") pod \"maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl\" (UID: \"636929dd-6a18-46d4-a715-4ca598d20791\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"
Sep 11 04:53:58.426683 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:58.426653    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/636929dd-6a18-46d4-a715-4ca598d20791-metrics-certs\") pod \"maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl\" (UID: \"636929dd-6a18-46d4-a715-4ca598d20791\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"
Sep 11 04:53:58.426883 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:58.426712    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/636929dd-6a18-46d4-a715-4ca598d20791-openshift-service-ca\") pod \"maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl\" (UID: \"636929dd-6a18-46d4-a715-4ca598d20791\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"
Sep 11 04:53:58.426883 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:58.426760    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/636929dd-6a18-46d4-a715-4ca598d20791-maas-api-tls\") pod \"maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl\" (UID: \"636929dd-6a18-46d4-a715-4ca598d20791\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"
Sep 11 04:53:58.426883 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:58.426811    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wt6j\" (UniqueName: \"kubernetes.io/projected/636929dd-6a18-46d4-a715-4ca598d20791-kube-api-access-2wt6j\") pod \"maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl\" (UID: \"636929dd-6a18-46d4-a715-4ca598d20791\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"
Sep 11 04:53:58.427050 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:53:58.426931    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-serving-cert: secret "maas-api-e2e-ait-1d2554f2-serving-cert" not found
Sep 11 04:53:58.427050 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:53:58.427010    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/636929dd-6a18-46d4-a715-4ca598d20791-maas-api-tls podName:636929dd-6a18-46d4-a715-4ca598d20791 nodeName:}" failed. No retries permitted until 2026-09-11 04:53:58.926989859 +0000 UTC m=+828.580249531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/636929dd-6a18-46d4-a715-4ca598d20791-maas-api-tls") pod "maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl" (UID: "636929dd-6a18-46d4-a715-4ca598d20791") : secret "maas-api-e2e-ait-1d2554f2-serving-cert" not found
Sep 11 04:53:58.427423 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:58.427404    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/636929dd-6a18-46d4-a715-4ca598d20791-openshift-service-ca\") pod \"maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl\" (UID: \"636929dd-6a18-46d4-a715-4ca598d20791\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"
Sep 11 04:53:58.429423 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:58.429397    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/636929dd-6a18-46d4-a715-4ca598d20791-metrics-certs\") pod \"maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl\" (UID: \"636929dd-6a18-46d4-a715-4ca598d20791\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"
Sep 11 04:53:58.441370 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:58.441347    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wt6j\" (UniqueName: \"kubernetes.io/projected/636929dd-6a18-46d4-a715-4ca598d20791-kube-api-access-2wt6j\") pod \"maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl\" (UID: \"636929dd-6a18-46d4-a715-4ca598d20791\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"
Sep 11 04:53:58.933293 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:58.933260    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/636929dd-6a18-46d4-a715-4ca598d20791-maas-api-tls\") pod \"maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl\" (UID: \"636929dd-6a18-46d4-a715-4ca598d20791\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"
Sep 11 04:53:58.935915 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:58.935893    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/636929dd-6a18-46d4-a715-4ca598d20791-maas-api-tls\") pod \"maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl\" (UID: \"636929dd-6a18-46d4-a715-4ca598d20791\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"
Sep 11 04:53:59.217888 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:59.217808    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"
Sep 11 04:53:59.492952 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:59.492926    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"]
Sep 11 04:53:59.495024 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:53:59.494997    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod636929dd_6a18_46d4_a715_4ca598d20791.slice/crio-c881d0039b42d81d9bf2237088f4a48fce798253bfaa19a4bfc517e851bab07e WatchSource:0}: Error finding container c881d0039b42d81d9bf2237088f4a48fce798253bfaa19a4bfc517e851bab07e: Status 404 returned error can't find the container with id c881d0039b42d81d9bf2237088f4a48fce798253bfaa19a4bfc517e851bab07e
Sep 11 04:53:59.867669 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:53:59.867576    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl" event={"ID":"636929dd-6a18-46d4-a715-4ca598d20791","Type":"ContainerStarted","Data":"c881d0039b42d81d9bf2237088f4a48fce798253bfaa19a4bfc517e851bab07e"}
Sep 11 04:54:00.874250 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:00.874217    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl" event={"ID":"636929dd-6a18-46d4-a715-4ca598d20791","Type":"ContainerStarted","Data":"aea21d0d180130f30f8879058398c53a1e525236ba2c7650767b1393994bb8a0"}
Sep 11 04:54:00.874719 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:00.874279    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"
Sep 11 04:54:00.894785 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:00.894722    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl" podStartSLOduration=2.47887658 podStartE2EDuration="2.894703218s" totalImagesPullingTime="415.826638ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:54:00.890729664 +0000 UTC m=+830.543989347" watchObservedRunningTime="2026-09-11 04:54:00.894703218 +0000 UTC m=+830.547962899"
Sep 11 04:54:01.610624 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:01.610585    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:54:06.886321 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:06.886292    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"
Sep 11 04:54:12.935825 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:12.935732    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"]
Sep 11 04:54:12.936323 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:12.935968    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb" podUID="158253c1-952d-4c5a-a078-2650480e9115" containerName="maas-api" containerID="cri-o://8b1c3afbb6b8002e7d673b138965e1da5654413d8c48648a2d604c54b65d0e95" gracePeriod=30
Sep 11 04:54:13.220622 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.220595    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"
Sep 11 04:54:13.274058 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.273813    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/158253c1-952d-4c5a-a078-2650480e9115-maas-api-tls\") pod \"158253c1-952d-4c5a-a078-2650480e9115\" (UID: \"158253c1-952d-4c5a-a078-2650480e9115\") "
Sep 11 04:54:13.274058 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.273912    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/158253c1-952d-4c5a-a078-2650480e9115-openshift-service-ca\") pod \"158253c1-952d-4c5a-a078-2650480e9115\" (UID: \"158253c1-952d-4c5a-a078-2650480e9115\") "
Sep 11 04:54:13.274058 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.273949    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/158253c1-952d-4c5a-a078-2650480e9115-metrics-certs\") pod \"158253c1-952d-4c5a-a078-2650480e9115\" (UID: \"158253c1-952d-4c5a-a078-2650480e9115\") "
Sep 11 04:54:13.274058 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.274045    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwvwb\" (UniqueName: \"kubernetes.io/projected/158253c1-952d-4c5a-a078-2650480e9115-kube-api-access-rwvwb\") pod \"158253c1-952d-4c5a-a078-2650480e9115\" (UID: \"158253c1-952d-4c5a-a078-2650480e9115\") "
Sep 11 04:54:13.274763 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.274735    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/158253c1-952d-4c5a-a078-2650480e9115-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "158253c1-952d-4c5a-a078-2650480e9115" (UID: "158253c1-952d-4c5a-a078-2650480e9115"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:54:13.277239 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.277199    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/158253c1-952d-4c5a-a078-2650480e9115-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "158253c1-952d-4c5a-a078-2650480e9115" (UID: "158253c1-952d-4c5a-a078-2650480e9115"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:54:13.277891 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.277859    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/158253c1-952d-4c5a-a078-2650480e9115-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "158253c1-952d-4c5a-a078-2650480e9115" (UID: "158253c1-952d-4c5a-a078-2650480e9115"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:54:13.278637 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.278600    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/158253c1-952d-4c5a-a078-2650480e9115-kube-api-access-rwvwb" (OuterVolumeSpecName: "kube-api-access-rwvwb") pod "158253c1-952d-4c5a-a078-2650480e9115" (UID: "158253c1-952d-4c5a-a078-2650480e9115"). InnerVolumeSpecName "kube-api-access-rwvwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:54:13.374925 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.374891    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwvwb\" (UniqueName: \"kubernetes.io/projected/158253c1-952d-4c5a-a078-2650480e9115-kube-api-access-rwvwb\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:54:13.374925 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.374922    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/158253c1-952d-4c5a-a078-2650480e9115-maas-api-tls\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:54:13.374925 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.374931    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/158253c1-952d-4c5a-a078-2650480e9115-openshift-service-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:54:13.375159 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.374939    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/158253c1-952d-4c5a-a078-2650480e9115-metrics-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:54:13.948281 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.948241    2554 generic.go:356] "Generic (PLEG): container finished" podID="158253c1-952d-4c5a-a078-2650480e9115" containerID="8b1c3afbb6b8002e7d673b138965e1da5654413d8c48648a2d604c54b65d0e95" exitCode=0
Sep 11 04:54:13.948822 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.948322    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb" event={"ID":"158253c1-952d-4c5a-a078-2650480e9115","Type":"ContainerDied","Data":"8b1c3afbb6b8002e7d673b138965e1da5654413d8c48648a2d604c54b65d0e95"}
Sep 11 04:54:13.948822 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.948417    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb" event={"ID":"158253c1-952d-4c5a-a078-2650480e9115","Type":"ContainerDied","Data":"32e3351303901c2ed4661d7c633ad568cc48c763a744ac4e478e29ff8827a5e2"}
Sep 11 04:54:13.948822 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.948450    2554 scope.go:117] "RemoveContainer" containerID="8b1c3afbb6b8002e7d673b138965e1da5654413d8c48648a2d604c54b65d0e95"
Sep 11 04:54:13.949014 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.948877    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"
Sep 11 04:54:13.960770 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.960517    2554 scope.go:117] "RemoveContainer" containerID="8b1c3afbb6b8002e7d673b138965e1da5654413d8c48648a2d604c54b65d0e95"
Sep 11 04:54:13.960934 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:54:13.960907    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b1c3afbb6b8002e7d673b138965e1da5654413d8c48648a2d604c54b65d0e95\": container with ID starting with 8b1c3afbb6b8002e7d673b138965e1da5654413d8c48648a2d604c54b65d0e95 not found: ID does not exist" containerID="8b1c3afbb6b8002e7d673b138965e1da5654413d8c48648a2d604c54b65d0e95"
Sep 11 04:54:13.960982 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.960951    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b1c3afbb6b8002e7d673b138965e1da5654413d8c48648a2d604c54b65d0e95"} err="failed to get container status \"8b1c3afbb6b8002e7d673b138965e1da5654413d8c48648a2d604c54b65d0e95\": rpc error: code = NotFound desc = could not find container \"8b1c3afbb6b8002e7d673b138965e1da5654413d8c48648a2d604c54b65d0e95\": container with ID starting with 8b1c3afbb6b8002e7d673b138965e1da5654413d8c48648a2d604c54b65d0e95 not found: ID does not exist"
Sep 11 04:54:13.973628 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.973600    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"]
Sep 11 04:54:13.981981 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:13.981950    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-0a8fef-5475cf9d-944jb"]
Sep 11 04:54:14.819068 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:14.819021    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="158253c1-952d-4c5a-a078-2650480e9115" path="/var/lib/kubelet/pods/158253c1-952d-4c5a-a078-2650480e9115/volumes"
Sep 11 04:54:19.409058 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:19.409021    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:54:20.330513 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.330145    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"]
Sep 11 04:54:20.331597 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.331565    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="158253c1-952d-4c5a-a078-2650480e9115" containerName="maas-api"
Sep 11 04:54:20.331776 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.331763    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="158253c1-952d-4c5a-a078-2650480e9115" containerName="maas-api"
Sep 11 04:54:20.332064 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.332048    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="158253c1-952d-4c5a-a078-2650480e9115" containerName="maas-api"
Sep 11 04:54:20.337154 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.337133    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.339809 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.339619    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-eefe49-openshift-default-dockercfg-fjcrq\""
Sep 11 04:54:20.346598 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.346571    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"]
Sep 11 04:54:20.461223 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.461179    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-workload-certs\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.461747 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.461365    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-credential-socket\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.461747 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.461424    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-podinfo\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.461747 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.461504    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-token\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.461747 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.461536    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r28zn\" (UniqueName: \"kubernetes.io/projected/5670c7ea-29ff-4db1-9b49-f430d5281218-kube-api-access-r28zn\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.461747 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.461606    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-workload-socket\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.461747 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.461691    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-envoy\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.461747 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.461716    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-data\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.461747 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.461732    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5670c7ea-29ff-4db1-9b49-f430d5281218-istiod-ca-cert\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.562387 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.562313    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-credential-socket\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.562387 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.562392    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-podinfo\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.562644 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.562451    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-token\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.562644 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.562484    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r28zn\" (UniqueName: \"kubernetes.io/projected/5670c7ea-29ff-4db1-9b49-f430d5281218-kube-api-access-r28zn\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.562644 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.562527    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-workload-socket\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.562644 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.562621    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-envoy\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.562867 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.562657    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-data\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.562867 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.562682    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5670c7ea-29ff-4db1-9b49-f430d5281218-istiod-ca-cert\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.562867 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.562727    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-workload-certs\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.563026 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.562908    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-credential-socket\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.563112 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.563087    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-workload-certs\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.563236 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.563182    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-data\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.563552 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.563527    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-workload-socket\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.563654 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.563632    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5670c7ea-29ff-4db1-9b49-f430d5281218-istiod-ca-cert\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.565738 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.565690    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-envoy\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.566118 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.566094    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-podinfo\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.572127 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.572099    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-token\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.572376 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.572354    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r28zn\" (UniqueName: \"kubernetes.io/projected/5670c7ea-29ff-4db1-9b49-f430d5281218-kube-api-access-r28zn\") pod \"e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") " pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.664094 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.663828    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:20.963310 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.963275    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"]
Sep 11 04:54:20.964880 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:54:20.964850    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5670c7ea_29ff_4db1_9b49_f430d5281218.slice/crio-6e4df68ed09e27b12c42e6892eff8888084d7b76b80491dee486cfa8e8da504b WatchSource:0}: Error finding container 6e4df68ed09e27b12c42e6892eff8888084d7b76b80491dee486cfa8e8da504b: Status 404 returned error can't find the container with id 6e4df68ed09e27b12c42e6892eff8888084d7b76b80491dee486cfa8e8da504b
Sep 11 04:54:20.967410 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.967371    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:54:20.967527 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.967479    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:54:20.967527 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.967514    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:54:20.993670 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:20.993630    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8" event={"ID":"5670c7ea-29ff-4db1-9b49-f430d5281218","Type":"ContainerStarted","Data":"6e4df68ed09e27b12c42e6892eff8888084d7b76b80491dee486cfa8e8da504b"}
Sep 11 04:54:22.003082 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:22.003049    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8" event={"ID":"5670c7ea-29ff-4db1-9b49-f430d5281218","Type":"ContainerStarted","Data":"a3a8c836b14bb76131354ee553376c621a83cd5e6e1bdd21a36065796e305149"}
Sep 11 04:54:22.024753 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:22.024706    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8" podStartSLOduration=2.02468957 podStartE2EDuration="2.02468957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:54:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:54:22.022426019 +0000 UTC m=+851.675685701" watchObservedRunningTime="2026-09-11 04:54:22.02468957 +0000 UTC m=+851.677949250"
Sep 11 04:54:22.664349 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:22.664294    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:22.669613 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:22.669587    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:23.008682 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:23.008596    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:23.009715 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:23.009693    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:24.015906 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:24.015872    2554 generic.go:356] "Generic (PLEG): container finished" podID="eb8d1919-fce8-45fc-ab96-1f6f215f8b10" containerID="b111ed6bc6ddc28e59e68d8454b1e5b1aa91eefbbd733461978d64a325c95681" exitCode=0
Sep 11 04:54:24.016325 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:24.015942    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5" event={"ID":"eb8d1919-fce8-45fc-ab96-1f6f215f8b10","Type":"ContainerDied","Data":"b111ed6bc6ddc28e59e68d8454b1e5b1aa91eefbbd733461978d64a325c95681"}
Sep 11 04:54:24.016481 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:24.016466    2554 scope.go:117] "RemoveContainer" containerID="b111ed6bc6ddc28e59e68d8454b1e5b1aa91eefbbd733461978d64a325c95681"
Sep 11 04:54:24.017517 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:24.017493    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:54:24.017587 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:24.017555    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:54:24.017587 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:24.017582    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:54:25.026982 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:25.026946    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5" event={"ID":"eb8d1919-fce8-45fc-ab96-1f6f215f8b10","Type":"ContainerStarted","Data":"78bda18eb77e58c2bb2a3a28992439e630f1228fcc31f5a808b5be7f7d826624"}
Sep 11 04:54:25.335934 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:25.335858    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:54:25.337178 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:25.337145    2554 patch_prober.go:28] interesting pod/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 11 04:54:25.337310 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:25.337205    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5" podUID="eb8d1919-fce8-45fc-ab96-1f6f215f8b10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 11 04:54:26.336325 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:26.336286    2554 patch_prober.go:28] interesting pod/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 11 04:54:26.336850 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:26.336389    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5" podUID="eb8d1919-fce8-45fc-ab96-1f6f215f8b10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 11 04:54:26.851441 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:26.851414    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:54:27.336993 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:27.336953    2554 patch_prober.go:28] interesting pod/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 11 04:54:27.337449 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:27.337017    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5" podUID="eb8d1919-fce8-45fc-ab96-1f6f215f8b10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 11 04:54:28.336842 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:28.336799    2554 patch_prober.go:28] interesting pod/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 11 04:54:28.337032 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:28.336860    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5" podUID="eb8d1919-fce8-45fc-ab96-1f6f215f8b10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 11 04:54:29.231491 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:29.231457    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"]
Sep 11 04:54:29.231729 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:29.231705    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl" podUID="636929dd-6a18-46d4-a715-4ca598d20791" containerName="maas-api" containerID="cri-o://aea21d0d180130f30f8879058398c53a1e525236ba2c7650767b1393994bb8a0" gracePeriod=30
Sep 11 04:54:29.336625 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:29.336580    2554 patch_prober.go:28] interesting pod/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 11 04:54:29.336801 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:29.336650    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5" podUID="eb8d1919-fce8-45fc-ab96-1f6f215f8b10" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 11 04:54:29.526722 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:29.526697    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"
Sep 11 04:54:29.571833 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:29.571799    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/636929dd-6a18-46d4-a715-4ca598d20791-metrics-certs\") pod \"636929dd-6a18-46d4-a715-4ca598d20791\" (UID: \"636929dd-6a18-46d4-a715-4ca598d20791\") "
Sep 11 04:54:29.572030 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:29.571944    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/636929dd-6a18-46d4-a715-4ca598d20791-openshift-service-ca\") pod \"636929dd-6a18-46d4-a715-4ca598d20791\" (UID: \"636929dd-6a18-46d4-a715-4ca598d20791\") "
Sep 11 04:54:29.572030 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:29.572005    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/636929dd-6a18-46d4-a715-4ca598d20791-maas-api-tls\") pod \"636929dd-6a18-46d4-a715-4ca598d20791\" (UID: \"636929dd-6a18-46d4-a715-4ca598d20791\") "
Sep 11 04:54:29.572147 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:29.572043    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wt6j\" (UniqueName: \"kubernetes.io/projected/636929dd-6a18-46d4-a715-4ca598d20791-kube-api-access-2wt6j\") pod \"636929dd-6a18-46d4-a715-4ca598d20791\" (UID: \"636929dd-6a18-46d4-a715-4ca598d20791\") "
Sep 11 04:54:29.572538 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:29.572499    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/636929dd-6a18-46d4-a715-4ca598d20791-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "636929dd-6a18-46d4-a715-4ca598d20791" (UID: "636929dd-6a18-46d4-a715-4ca598d20791"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:54:29.574426 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:29.574396    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/636929dd-6a18-46d4-a715-4ca598d20791-kube-api-access-2wt6j" (OuterVolumeSpecName: "kube-api-access-2wt6j") pod "636929dd-6a18-46d4-a715-4ca598d20791" (UID: "636929dd-6a18-46d4-a715-4ca598d20791"). InnerVolumeSpecName "kube-api-access-2wt6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:54:29.574990 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:29.574962    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636929dd-6a18-46d4-a715-4ca598d20791-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "636929dd-6a18-46d4-a715-4ca598d20791" (UID: "636929dd-6a18-46d4-a715-4ca598d20791"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:54:29.575066 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:29.574990    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/636929dd-6a18-46d4-a715-4ca598d20791-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "636929dd-6a18-46d4-a715-4ca598d20791" (UID: "636929dd-6a18-46d4-a715-4ca598d20791"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:54:29.673582 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:29.673551    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/636929dd-6a18-46d4-a715-4ca598d20791-maas-api-tls\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:54:29.673582 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:29.673577    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wt6j\" (UniqueName: \"kubernetes.io/projected/636929dd-6a18-46d4-a715-4ca598d20791-kube-api-access-2wt6j\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:54:29.673582 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:29.673586    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/636929dd-6a18-46d4-a715-4ca598d20791-metrics-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:54:29.673809 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:29.673594    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/636929dd-6a18-46d4-a715-4ca598d20791-openshift-service-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:54:30.072085 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:30.072053    2554 generic.go:356] "Generic (PLEG): container finished" podID="636929dd-6a18-46d4-a715-4ca598d20791" containerID="aea21d0d180130f30f8879058398c53a1e525236ba2c7650767b1393994bb8a0" exitCode=0
Sep 11 04:54:30.072307 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:30.072110    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"
Sep 11 04:54:30.072307 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:30.072157    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl" event={"ID":"636929dd-6a18-46d4-a715-4ca598d20791","Type":"ContainerDied","Data":"aea21d0d180130f30f8879058398c53a1e525236ba2c7650767b1393994bb8a0"}
Sep 11 04:54:30.072307 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:30.072211    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl" event={"ID":"636929dd-6a18-46d4-a715-4ca598d20791","Type":"ContainerDied","Data":"c881d0039b42d81d9bf2237088f4a48fce798253bfaa19a4bfc517e851bab07e"}
Sep 11 04:54:30.072307 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:30.072232    2554 scope.go:117] "RemoveContainer" containerID="aea21d0d180130f30f8879058398c53a1e525236ba2c7650767b1393994bb8a0"
Sep 11 04:54:30.086288 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:30.086262    2554 scope.go:117] "RemoveContainer" containerID="aea21d0d180130f30f8879058398c53a1e525236ba2c7650767b1393994bb8a0"
Sep 11 04:54:30.086714 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:54:30.086691    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aea21d0d180130f30f8879058398c53a1e525236ba2c7650767b1393994bb8a0\": container with ID starting with aea21d0d180130f30f8879058398c53a1e525236ba2c7650767b1393994bb8a0 not found: ID does not exist" containerID="aea21d0d180130f30f8879058398c53a1e525236ba2c7650767b1393994bb8a0"
Sep 11 04:54:30.086821 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:30.086723    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aea21d0d180130f30f8879058398c53a1e525236ba2c7650767b1393994bb8a0"} err="failed to get container status \"aea21d0d180130f30f8879058398c53a1e525236ba2c7650767b1393994bb8a0\": rpc error: code = NotFound desc = could not find container \"aea21d0d180130f30f8879058398c53a1e525236ba2c7650767b1393994bb8a0\": container with ID starting with aea21d0d180130f30f8879058398c53a1e525236ba2c7650767b1393994bb8a0 not found: ID does not exist"
Sep 11 04:54:30.097271 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:30.097216    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"]
Sep 11 04:54:30.099484 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:30.099459    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1d2554f2-6bc8bfd886-jvsrl"]
Sep 11 04:54:30.341454 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:30.341384    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:54:30.342415 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:30.342394    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:54:30.537248 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:30.537220    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"]
Sep 11 04:54:30.813663 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:30.813633    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="636929dd-6a18-46d4-a715-4ca598d20791" path="/var/lib/kubelet/pods/636929dd-6a18-46d4-a715-4ca598d20791/volumes"
Sep 11 04:54:31.078291 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:31.078212    2554 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5" secret="" err="secret \"e2e-ait-1d2554f2-openshift-default-dockercfg-ssgp5\" not found"
Sep 11 04:54:32.083235 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:32.083191    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5" podUID="eb8d1919-fce8-45fc-ab96-1f6f215f8b10" containerName="istio-proxy" containerID="cri-o://78bda18eb77e58c2bb2a3a28992439e630f1228fcc31f5a808b5be7f7d826624" gracePeriod=30
Sep 11 04:54:34.980657 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:34.980618    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"]
Sep 11 04:54:34.981097 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:34.981039    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="636929dd-6a18-46d4-a715-4ca598d20791" containerName="maas-api"
Sep 11 04:54:34.981097 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:34.981049    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="636929dd-6a18-46d4-a715-4ca598d20791" containerName="maas-api"
Sep 11 04:54:34.981174 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:34.981132    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="636929dd-6a18-46d4-a715-4ca598d20791" containerName="maas-api"
Sep 11 04:54:34.985687 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:34.985668    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"
Sep 11 04:54:34.987750 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:34.987730    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-fbfc153d-serving-cert\""
Sep 11 04:54:34.995685 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:34.995655    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"]
Sep 11 04:54:35.040748 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:35.040705    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12d682ca-e887-4c11-bd5d-ab27f8b7b861-maas-api-tls\") pod \"maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l\" (UID: \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"
Sep 11 04:54:35.040904 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:35.040823    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12d682ca-e887-4c11-bd5d-ab27f8b7b861-metrics-certs\") pod \"maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l\" (UID: \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"
Sep 11 04:54:35.040904 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:35.040861    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12d682ca-e887-4c11-bd5d-ab27f8b7b861-openshift-service-ca\") pod \"maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l\" (UID: \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"
Sep 11 04:54:35.040904 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:35.040901    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwrpf\" (UniqueName: \"kubernetes.io/projected/12d682ca-e887-4c11-bd5d-ab27f8b7b861-kube-api-access-bwrpf\") pod \"maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l\" (UID: \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"
Sep 11 04:54:35.142257 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:35.142225    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12d682ca-e887-4c11-bd5d-ab27f8b7b861-maas-api-tls\") pod \"maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l\" (UID: \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"
Sep 11 04:54:35.142457 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:35.142281    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12d682ca-e887-4c11-bd5d-ab27f8b7b861-metrics-certs\") pod \"maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l\" (UID: \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"
Sep 11 04:54:35.142457 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:35.142315    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12d682ca-e887-4c11-bd5d-ab27f8b7b861-openshift-service-ca\") pod \"maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l\" (UID: \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"
Sep 11 04:54:35.142457 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:35.142376    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwrpf\" (UniqueName: \"kubernetes.io/projected/12d682ca-e887-4c11-bd5d-ab27f8b7b861-kube-api-access-bwrpf\") pod \"maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l\" (UID: \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"
Sep 11 04:54:35.143087 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:35.143014    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12d682ca-e887-4c11-bd5d-ab27f8b7b861-openshift-service-ca\") pod \"maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l\" (UID: \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"
Sep 11 04:54:35.145075 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:35.145054    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12d682ca-e887-4c11-bd5d-ab27f8b7b861-maas-api-tls\") pod \"maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l\" (UID: \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"
Sep 11 04:54:35.145156 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:35.145070    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12d682ca-e887-4c11-bd5d-ab27f8b7b861-metrics-certs\") pod \"maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l\" (UID: \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"
Sep 11 04:54:35.155690 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:35.155652    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwrpf\" (UniqueName: \"kubernetes.io/projected/12d682ca-e887-4c11-bd5d-ab27f8b7b861-kube-api-access-bwrpf\") pod \"maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l\" (UID: \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"
Sep 11 04:54:35.297936 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:35.297839    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"
Sep 11 04:54:35.628189 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:35.628131    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"]
Sep 11 04:54:35.628640 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:54:35.628612    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12d682ca_e887_4c11_bd5d_ab27f8b7b861.slice/crio-f334834b576b9889c1b1cc4005e964612819325bdf4cbc562ac4980fea4b66c3 WatchSource:0}: Error finding container f334834b576b9889c1b1cc4005e964612819325bdf4cbc562ac4980fea4b66c3: Status 404 returned error can't find the container with id f334834b576b9889c1b1cc4005e964612819325bdf4cbc562ac4980fea4b66c3
Sep 11 04:54:36.133474 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:36.133429    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l" event={"ID":"12d682ca-e887-4c11-bd5d-ab27f8b7b861","Type":"ContainerStarted","Data":"33ed296efac4e97cbc31904f89abf4871f684771e6c425803705d5d7f9ed6cc0"}
Sep 11 04:54:36.133945 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:36.133482    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l" event={"ID":"12d682ca-e887-4c11-bd5d-ab27f8b7b861","Type":"ContainerStarted","Data":"f334834b576b9889c1b1cc4005e964612819325bdf4cbc562ac4980fea4b66c3"}
Sep 11 04:54:36.133945 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:36.133635    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"
Sep 11 04:54:36.152460 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:36.152410    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l" podStartSLOduration=1.746856618 podStartE2EDuration="2.152394878s" totalImagesPullingTime="405.53826ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:54:36.149658873 +0000 UTC m=+865.802918553" watchObservedRunningTime="2026-09-11 04:54:36.152394878 +0000 UTC m=+865.805654558"
Sep 11 04:54:37.368319 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.368289    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:54:37.486682 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.486647    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-credential-socket\") pod \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") "
Sep 11 04:54:37.486844 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.486689    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qlhv\" (UniqueName: \"kubernetes.io/projected/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-kube-api-access-5qlhv\") pod \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") "
Sep 11 04:54:37.486844 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.486752    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-token\") pod \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") "
Sep 11 04:54:37.486844 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.486776    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istiod-ca-cert\") pod \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") "
Sep 11 04:54:37.486844 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.486806    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-workload-socket\") pod \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") "
Sep 11 04:54:37.487054 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.486866    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-data\") pod \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") "
Sep 11 04:54:37.487054 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.486920    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-envoy\") pod \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") "
Sep 11 04:54:37.487054 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.486930    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eb8d1919-fce8-45fc-ab96-1f6f215f8b10" (UID: "eb8d1919-fce8-45fc-ab96-1f6f215f8b10"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:54:37.487054 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.486970    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-workload-certs\") pod \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") "
Sep 11 04:54:37.487054 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.486998    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-podinfo\") pod \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\" (UID: \"eb8d1919-fce8-45fc-ab96-1f6f215f8b10\") "
Sep 11 04:54:37.487302 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.487144    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eb8d1919-fce8-45fc-ab96-1f6f215f8b10" (UID: "eb8d1919-fce8-45fc-ab96-1f6f215f8b10"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:54:37.487302 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.487156    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-data" (OuterVolumeSpecName: "istio-data") pod "eb8d1919-fce8-45fc-ab96-1f6f215f8b10" (UID: "eb8d1919-fce8-45fc-ab96-1f6f215f8b10"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:54:37.487302 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.487220    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eb8d1919-fce8-45fc-ab96-1f6f215f8b10" (UID: "eb8d1919-fce8-45fc-ab96-1f6f215f8b10"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:54:37.487502 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.487382    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eb8d1919-fce8-45fc-ab96-1f6f215f8b10" (UID: "eb8d1919-fce8-45fc-ab96-1f6f215f8b10"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:54:37.487563 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.487515    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-workload-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:54:37.487563 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.487538    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-credential-socket\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:54:37.487563 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.487551    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istiod-ca-cert\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:54:37.487679 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.487565    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-workload-socket\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:54:37.487679 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.487580    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-data\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:54:37.489212 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.489191    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-token" (OuterVolumeSpecName: "istio-token") pod "eb8d1919-fce8-45fc-ab96-1f6f215f8b10" (UID: "eb8d1919-fce8-45fc-ab96-1f6f215f8b10"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:54:37.489543 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.489516    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-kube-api-access-5qlhv" (OuterVolumeSpecName: "kube-api-access-5qlhv") pod "eb8d1919-fce8-45fc-ab96-1f6f215f8b10" (UID: "eb8d1919-fce8-45fc-ab96-1f6f215f8b10"). InnerVolumeSpecName "kube-api-access-5qlhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:54:37.489790 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.489768    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eb8d1919-fce8-45fc-ab96-1f6f215f8b10" (UID: "eb8d1919-fce8-45fc-ab96-1f6f215f8b10"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:54:37.489790 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.489768    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eb8d1919-fce8-45fc-ab96-1f6f215f8b10" (UID: "eb8d1919-fce8-45fc-ab96-1f6f215f8b10"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:54:37.588601 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.588574    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-envoy\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:54:37.588601 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.588596    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-podinfo\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:54:37.588601 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.588605    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qlhv\" (UniqueName: \"kubernetes.io/projected/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-kube-api-access-5qlhv\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:54:37.588601 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:37.588615    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb8d1919-fce8-45fc-ab96-1f6f215f8b10-istio-token\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:54:38.147028 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:38.146989    2554 generic.go:356] "Generic (PLEG): container finished" podID="eb8d1919-fce8-45fc-ab96-1f6f215f8b10" containerID="78bda18eb77e58c2bb2a3a28992439e630f1228fcc31f5a808b5be7f7d826624" exitCode=0
Sep 11 04:54:38.147028 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:38.147035    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"
Sep 11 04:54:38.147271 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:38.147073    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5" event={"ID":"eb8d1919-fce8-45fc-ab96-1f6f215f8b10","Type":"ContainerDied","Data":"78bda18eb77e58c2bb2a3a28992439e630f1228fcc31f5a808b5be7f7d826624"}
Sep 11 04:54:38.147271 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:38.147125    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5" event={"ID":"eb8d1919-fce8-45fc-ab96-1f6f215f8b10","Type":"ContainerDied","Data":"a3604da40d63ef0c82f672e27dfae4a671ce2b06357544569d949bab57966d0c"}
Sep 11 04:54:38.147271 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:38.147146    2554 scope.go:117] "RemoveContainer" containerID="78bda18eb77e58c2bb2a3a28992439e630f1228fcc31f5a808b5be7f7d826624"
Sep 11 04:54:38.159035 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:38.159013    2554 scope.go:117] "RemoveContainer" containerID="b111ed6bc6ddc28e59e68d8454b1e5b1aa91eefbbd733461978d64a325c95681"
Sep 11 04:54:38.169444 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:38.169365    2554 scope.go:117] "RemoveContainer" containerID="78bda18eb77e58c2bb2a3a28992439e630f1228fcc31f5a808b5be7f7d826624"
Sep 11 04:54:38.170182 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:38.169692    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"]
Sep 11 04:54:38.170568 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:54:38.170539    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78bda18eb77e58c2bb2a3a28992439e630f1228fcc31f5a808b5be7f7d826624\": container with ID starting with 78bda18eb77e58c2bb2a3a28992439e630f1228fcc31f5a808b5be7f7d826624 not found: ID does not exist" containerID="78bda18eb77e58c2bb2a3a28992439e630f1228fcc31f5a808b5be7f7d826624"
Sep 11 04:54:38.170658 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:38.170578    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78bda18eb77e58c2bb2a3a28992439e630f1228fcc31f5a808b5be7f7d826624"} err="failed to get container status \"78bda18eb77e58c2bb2a3a28992439e630f1228fcc31f5a808b5be7f7d826624\": rpc error: code = NotFound desc = could not find container \"78bda18eb77e58c2bb2a3a28992439e630f1228fcc31f5a808b5be7f7d826624\": container with ID starting with 78bda18eb77e58c2bb2a3a28992439e630f1228fcc31f5a808b5be7f7d826624 not found: ID does not exist"
Sep 11 04:54:38.170658 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:38.170599    2554 scope.go:117] "RemoveContainer" containerID="b111ed6bc6ddc28e59e68d8454b1e5b1aa91eefbbd733461978d64a325c95681"
Sep 11 04:54:38.170967 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:54:38.170945    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b111ed6bc6ddc28e59e68d8454b1e5b1aa91eefbbd733461978d64a325c95681\": container with ID starting with b111ed6bc6ddc28e59e68d8454b1e5b1aa91eefbbd733461978d64a325c95681 not found: ID does not exist" containerID="b111ed6bc6ddc28e59e68d8454b1e5b1aa91eefbbd733461978d64a325c95681"
Sep 11 04:54:38.171040 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:38.170976    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b111ed6bc6ddc28e59e68d8454b1e5b1aa91eefbbd733461978d64a325c95681"} err="failed to get container status \"b111ed6bc6ddc28e59e68d8454b1e5b1aa91eefbbd733461978d64a325c95681\": rpc error: code = NotFound desc = could not find container \"b111ed6bc6ddc28e59e68d8454b1e5b1aa91eefbbd733461978d64a325c95681\": container with ID starting with b111ed6bc6ddc28e59e68d8454b1e5b1aa91eefbbd733461978d64a325c95681 not found: ID does not exist"
Sep 11 04:54:38.172368 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:38.172348    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1d2554f2-openshift-default-767948699d-njrf5"]
Sep 11 04:54:38.821697 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:38.821663    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb8d1919-fce8-45fc-ab96-1f6f215f8b10" path="/var/lib/kubelet/pods/eb8d1919-fce8-45fc-ab96-1f6f215f8b10/volumes"
Sep 11 04:54:39.050484 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:39.050449    2554 patch_prober.go:28] interesting pod/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 04:54:39.050652 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:39.050508    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8" podUID="5670c7ea-29ff-4db1-9b49-f430d5281218" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 04:54:40.220129 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:40.220095    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:54:41.164816 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:41.164786    2554 generic.go:356] "Generic (PLEG): container finished" podID="5670c7ea-29ff-4db1-9b49-f430d5281218" containerID="a3a8c836b14bb76131354ee553376c621a83cd5e6e1bdd21a36065796e305149" exitCode=0
Sep 11 04:54:41.164996 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:41.164853    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8" event={"ID":"5670c7ea-29ff-4db1-9b49-f430d5281218","Type":"ContainerDied","Data":"a3a8c836b14bb76131354ee553376c621a83cd5e6e1bdd21a36065796e305149"}
Sep 11 04:54:41.165279 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:41.165265    2554 scope.go:117] "RemoveContainer" containerID="a3a8c836b14bb76131354ee553376c621a83cd5e6e1bdd21a36065796e305149"
Sep 11 04:54:41.166376 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:41.166352    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:54:41.166440 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:41.166416    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:54:41.166481 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:41.166447    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:54:42.146557 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:42.146527    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"
Sep 11 04:54:42.175179 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:42.175139    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8" event={"ID":"5670c7ea-29ff-4db1-9b49-f430d5281218","Type":"ContainerStarted","Data":"b23ec96e8f7368bf5a2f4c250f951de30b8d17014b24b9e8a381a520569b8a71"}
Sep 11 04:54:42.664486 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:42.664449    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:42.664797 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:42.664774    2554 patch_prober.go:28] interesting pod/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 11 04:54:42.664852 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:42.664825    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8" podUID="5670c7ea-29ff-4db1-9b49-f430d5281218" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 11 04:54:43.665279 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:43.665241    2554 patch_prober.go:28] interesting pod/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 11 04:54:43.665687 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:43.665313    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8" podUID="5670c7ea-29ff-4db1-9b49-f430d5281218" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 11 04:54:44.664715 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:44.664679    2554 patch_prober.go:28] interesting pod/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 11 04:54:44.664926 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:44.664756    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8" podUID="5670c7ea-29ff-4db1-9b49-f430d5281218" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 11 04:54:45.664932 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:45.664895    2554 patch_prober.go:28] interesting pod/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 11 04:54:45.665365 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:45.664950    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8" podUID="5670c7ea-29ff-4db1-9b49-f430d5281218" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 11 04:54:46.664883 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:46.664844    2554 patch_prober.go:28] interesting pod/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 11 04:54:46.665070 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:46.664933    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8" podUID="5670c7ea-29ff-4db1-9b49-f430d5281218" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 11 04:54:47.668629 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:47.668592    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:47.669142 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:47.669062    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:47.669885 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:47.669864    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:54:58.606121 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:54:58.606083    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:55:05.449033 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:05.448927    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"]
Sep 11 04:55:05.449562 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:05.449214    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l" podUID="12d682ca-e887-4c11-bd5d-ab27f8b7b861" containerName="maas-api" containerID="cri-o://33ed296efac4e97cbc31904f89abf4871f684771e6c425803705d5d7f9ed6cc0" gracePeriod=30
Sep 11 04:55:05.705044 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:05.704979    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"
Sep 11 04:55:05.787266 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:05.787224    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12d682ca-e887-4c11-bd5d-ab27f8b7b861-maas-api-tls\") pod \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\" (UID: \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\") "
Sep 11 04:55:05.787491 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:05.787291    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwrpf\" (UniqueName: \"kubernetes.io/projected/12d682ca-e887-4c11-bd5d-ab27f8b7b861-kube-api-access-bwrpf\") pod \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\" (UID: \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\") "
Sep 11 04:55:05.787491 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:05.787394    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12d682ca-e887-4c11-bd5d-ab27f8b7b861-openshift-service-ca\") pod \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\" (UID: \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\") "
Sep 11 04:55:05.787623 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:05.787518    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12d682ca-e887-4c11-bd5d-ab27f8b7b861-metrics-certs\") pod \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\" (UID: \"12d682ca-e887-4c11-bd5d-ab27f8b7b861\") "
Sep 11 04:55:05.788836 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:05.787873    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12d682ca-e887-4c11-bd5d-ab27f8b7b861-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "12d682ca-e887-4c11-bd5d-ab27f8b7b861" (UID: "12d682ca-e887-4c11-bd5d-ab27f8b7b861"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:55:05.791086 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:05.791035    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12d682ca-e887-4c11-bd5d-ab27f8b7b861-kube-api-access-bwrpf" (OuterVolumeSpecName: "kube-api-access-bwrpf") pod "12d682ca-e887-4c11-bd5d-ab27f8b7b861" (UID: "12d682ca-e887-4c11-bd5d-ab27f8b7b861"). InnerVolumeSpecName "kube-api-access-bwrpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:55:05.791456 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:05.791416    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12d682ca-e887-4c11-bd5d-ab27f8b7b861-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "12d682ca-e887-4c11-bd5d-ab27f8b7b861" (UID: "12d682ca-e887-4c11-bd5d-ab27f8b7b861"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:55:05.791456 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:05.791435    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12d682ca-e887-4c11-bd5d-ab27f8b7b861-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "12d682ca-e887-4c11-bd5d-ab27f8b7b861" (UID: "12d682ca-e887-4c11-bd5d-ab27f8b7b861"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:55:05.889066 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:05.889027    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/12d682ca-e887-4c11-bd5d-ab27f8b7b861-maas-api-tls\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:55:05.889066 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:05.889063    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwrpf\" (UniqueName: \"kubernetes.io/projected/12d682ca-e887-4c11-bd5d-ab27f8b7b861-kube-api-access-bwrpf\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:55:05.889066 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:05.889074    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/12d682ca-e887-4c11-bd5d-ab27f8b7b861-openshift-service-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:55:05.889356 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:05.889083    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12d682ca-e887-4c11-bd5d-ab27f8b7b861-metrics-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:55:06.316423 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:06.316392    2554 generic.go:356] "Generic (PLEG): container finished" podID="12d682ca-e887-4c11-bd5d-ab27f8b7b861" containerID="33ed296efac4e97cbc31904f89abf4871f684771e6c425803705d5d7f9ed6cc0" exitCode=0
Sep 11 04:55:06.316613 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:06.316436    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"
Sep 11 04:55:06.316613 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:06.316467    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l" event={"ID":"12d682ca-e887-4c11-bd5d-ab27f8b7b861","Type":"ContainerDied","Data":"33ed296efac4e97cbc31904f89abf4871f684771e6c425803705d5d7f9ed6cc0"}
Sep 11 04:55:06.316613 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:06.316527    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l" event={"ID":"12d682ca-e887-4c11-bd5d-ab27f8b7b861","Type":"ContainerDied","Data":"f334834b576b9889c1b1cc4005e964612819325bdf4cbc562ac4980fea4b66c3"}
Sep 11 04:55:06.316613 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:06.316551    2554 scope.go:117] "RemoveContainer" containerID="33ed296efac4e97cbc31904f89abf4871f684771e6c425803705d5d7f9ed6cc0"
Sep 11 04:55:06.327068 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:06.327046    2554 scope.go:117] "RemoveContainer" containerID="33ed296efac4e97cbc31904f89abf4871f684771e6c425803705d5d7f9ed6cc0"
Sep 11 04:55:06.327431 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:55:06.327412    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33ed296efac4e97cbc31904f89abf4871f684771e6c425803705d5d7f9ed6cc0\": container with ID starting with 33ed296efac4e97cbc31904f89abf4871f684771e6c425803705d5d7f9ed6cc0 not found: ID does not exist" containerID="33ed296efac4e97cbc31904f89abf4871f684771e6c425803705d5d7f9ed6cc0"
Sep 11 04:55:06.327489 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:06.327441    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33ed296efac4e97cbc31904f89abf4871f684771e6c425803705d5d7f9ed6cc0"} err="failed to get container status \"33ed296efac4e97cbc31904f89abf4871f684771e6c425803705d5d7f9ed6cc0\": rpc error: code = NotFound desc = could not find container \"33ed296efac4e97cbc31904f89abf4871f684771e6c425803705d5d7f9ed6cc0\": container with ID starting with 33ed296efac4e97cbc31904f89abf4871f684771e6c425803705d5d7f9ed6cc0 not found: ID does not exist"
Sep 11 04:55:06.337608 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:06.337580    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"]
Sep 11 04:55:06.341507 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:06.341480    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fbfc153d-596dc4c486-tzw8l"]
Sep 11 04:55:06.814516 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:06.814484    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12d682ca-e887-4c11-bd5d-ab27f8b7b861" path="/var/lib/kubelet/pods/12d682ca-e887-4c11-bd5d-ab27f8b7b861/volumes"
Sep 11 04:55:15.302150 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:15.302109    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:55:33.096041 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:33.096000    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:55:41.423112 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:41.423072    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"]
Sep 11 04:55:41.423592 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:41.423321    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8" podUID="5670c7ea-29ff-4db1-9b49-f430d5281218" containerName="istio-proxy" containerID="cri-o://b23ec96e8f7368bf5a2f4c250f951de30b8d17014b24b9e8a381a520569b8a71" gracePeriod=30
Sep 11 04:55:46.398022 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.397984    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:55:46.692260 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.692235    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:55:46.805082 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.805047    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r28zn\" (UniqueName: \"kubernetes.io/projected/5670c7ea-29ff-4db1-9b49-f430d5281218-kube-api-access-r28zn\") pod \"5670c7ea-29ff-4db1-9b49-f430d5281218\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") "
Sep 11 04:55:46.805273 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.805138    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-credential-socket\") pod \"5670c7ea-29ff-4db1-9b49-f430d5281218\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") "
Sep 11 04:55:46.805273 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.805155    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5670c7ea-29ff-4db1-9b49-f430d5281218-istiod-ca-cert\") pod \"5670c7ea-29ff-4db1-9b49-f430d5281218\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") "
Sep 11 04:55:46.805273 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.805184    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-envoy\") pod \"5670c7ea-29ff-4db1-9b49-f430d5281218\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") "
Sep 11 04:55:46.805273 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.805230    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-podinfo\") pod \"5670c7ea-29ff-4db1-9b49-f430d5281218\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") "
Sep 11 04:55:46.805273 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.805255    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-token\") pod \"5670c7ea-29ff-4db1-9b49-f430d5281218\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") "
Sep 11 04:55:46.805561 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.805284    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-workload-certs\") pod \"5670c7ea-29ff-4db1-9b49-f430d5281218\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") "
Sep 11 04:55:46.805561 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.805366    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-workload-socket\") pod \"5670c7ea-29ff-4db1-9b49-f430d5281218\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") "
Sep 11 04:55:46.805561 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.805426    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-data\") pod \"5670c7ea-29ff-4db1-9b49-f430d5281218\" (UID: \"5670c7ea-29ff-4db1-9b49-f430d5281218\") "
Sep 11 04:55:46.805561 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.805510    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5670c7ea-29ff-4db1-9b49-f430d5281218" (UID: "5670c7ea-29ff-4db1-9b49-f430d5281218"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:55:46.805772 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.805712    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5670c7ea-29ff-4db1-9b49-f430d5281218" (UID: "5670c7ea-29ff-4db1-9b49-f430d5281218"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:55:46.805772 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.805731    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5670c7ea-29ff-4db1-9b49-f430d5281218-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5670c7ea-29ff-4db1-9b49-f430d5281218" (UID: "5670c7ea-29ff-4db1-9b49-f430d5281218"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:55:46.805772 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.805723    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5670c7ea-29ff-4db1-9b49-f430d5281218" (UID: "5670c7ea-29ff-4db1-9b49-f430d5281218"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:55:46.805930 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.805832    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-credential-socket\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:55:46.805998 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.805959    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-data" (OuterVolumeSpecName: "istio-data") pod "5670c7ea-29ff-4db1-9b49-f430d5281218" (UID: "5670c7ea-29ff-4db1-9b49-f430d5281218"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:55:46.808356 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.808310    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5670c7ea-29ff-4db1-9b49-f430d5281218" (UID: "5670c7ea-29ff-4db1-9b49-f430d5281218"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:55:46.808356 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.808313    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5670c7ea-29ff-4db1-9b49-f430d5281218" (UID: "5670c7ea-29ff-4db1-9b49-f430d5281218"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:55:46.808528 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.808359    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5670c7ea-29ff-4db1-9b49-f430d5281218-kube-api-access-r28zn" (OuterVolumeSpecName: "kube-api-access-r28zn") pod "5670c7ea-29ff-4db1-9b49-f430d5281218" (UID: "5670c7ea-29ff-4db1-9b49-f430d5281218"). InnerVolumeSpecName "kube-api-access-r28zn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:55:46.808528 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.808384    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-token" (OuterVolumeSpecName: "istio-token") pod "5670c7ea-29ff-4db1-9b49-f430d5281218" (UID: "5670c7ea-29ff-4db1-9b49-f430d5281218"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:55:46.907251 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.907200    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-workload-socket\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:55:46.907251 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.907246    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-data\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:55:46.907544 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.907261    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r28zn\" (UniqueName: \"kubernetes.io/projected/5670c7ea-29ff-4db1-9b49-f430d5281218-kube-api-access-r28zn\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:55:46.907544 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.907276    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5670c7ea-29ff-4db1-9b49-f430d5281218-istiod-ca-cert\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:55:46.907544 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.907289    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-envoy\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:55:46.907544 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.907302    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-podinfo\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:55:46.907544 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.907314    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5670c7ea-29ff-4db1-9b49-f430d5281218-istio-token\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:55:46.907544 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:46.907361    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5670c7ea-29ff-4db1-9b49-f430d5281218-workload-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:55:47.538666 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:47.538628    2554 generic.go:356] "Generic (PLEG): container finished" podID="5670c7ea-29ff-4db1-9b49-f430d5281218" containerID="b23ec96e8f7368bf5a2f4c250f951de30b8d17014b24b9e8a381a520569b8a71" exitCode=0
Sep 11 04:55:47.539161 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:47.538715    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8" event={"ID":"5670c7ea-29ff-4db1-9b49-f430d5281218","Type":"ContainerDied","Data":"b23ec96e8f7368bf5a2f4c250f951de30b8d17014b24b9e8a381a520569b8a71"}
Sep 11 04:55:47.539161 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:47.538738    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"
Sep 11 04:55:47.539161 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:47.538765    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8" event={"ID":"5670c7ea-29ff-4db1-9b49-f430d5281218","Type":"ContainerDied","Data":"6e4df68ed09e27b12c42e6892eff8888084d7b76b80491dee486cfa8e8da504b"}
Sep 11 04:55:47.539161 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:47.538787    2554 scope.go:117] "RemoveContainer" containerID="b23ec96e8f7368bf5a2f4c250f951de30b8d17014b24b9e8a381a520569b8a71"
Sep 11 04:55:47.548320 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:47.548303    2554 scope.go:117] "RemoveContainer" containerID="a3a8c836b14bb76131354ee553376c621a83cd5e6e1bdd21a36065796e305149"
Sep 11 04:55:47.556088 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:47.556054    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"]
Sep 11 04:55:47.558315 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:47.558289    2554 scope.go:117] "RemoveContainer" containerID="b23ec96e8f7368bf5a2f4c250f951de30b8d17014b24b9e8a381a520569b8a71"
Sep 11 04:55:47.558739 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:55:47.558711    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b23ec96e8f7368bf5a2f4c250f951de30b8d17014b24b9e8a381a520569b8a71\": container with ID starting with b23ec96e8f7368bf5a2f4c250f951de30b8d17014b24b9e8a381a520569b8a71 not found: ID does not exist" containerID="b23ec96e8f7368bf5a2f4c250f951de30b8d17014b24b9e8a381a520569b8a71"
Sep 11 04:55:47.558800 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:47.558751    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b23ec96e8f7368bf5a2f4c250f951de30b8d17014b24b9e8a381a520569b8a71"} err="failed to get container status \"b23ec96e8f7368bf5a2f4c250f951de30b8d17014b24b9e8a381a520569b8a71\": rpc error: code = NotFound desc = could not find container \"b23ec96e8f7368bf5a2f4c250f951de30b8d17014b24b9e8a381a520569b8a71\": container with ID starting with b23ec96e8f7368bf5a2f4c250f951de30b8d17014b24b9e8a381a520569b8a71 not found: ID does not exist"
Sep 11 04:55:47.558800 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:47.558775    2554 scope.go:117] "RemoveContainer" containerID="a3a8c836b14bb76131354ee553376c621a83cd5e6e1bdd21a36065796e305149"
Sep 11 04:55:47.559094 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:55:47.559076    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3a8c836b14bb76131354ee553376c621a83cd5e6e1bdd21a36065796e305149\": container with ID starting with a3a8c836b14bb76131354ee553376c621a83cd5e6e1bdd21a36065796e305149 not found: ID does not exist" containerID="a3a8c836b14bb76131354ee553376c621a83cd5e6e1bdd21a36065796e305149"
Sep 11 04:55:47.559164 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:47.559102    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a8c836b14bb76131354ee553376c621a83cd5e6e1bdd21a36065796e305149"} err="failed to get container status \"a3a8c836b14bb76131354ee553376c621a83cd5e6e1bdd21a36065796e305149\": rpc error: code = NotFound desc = could not find container \"a3a8c836b14bb76131354ee553376c621a83cd5e6e1bdd21a36065796e305149\": container with ID starting with a3a8c836b14bb76131354ee553376c621a83cd5e6e1bdd21a36065796e305149 not found: ID does not exist"
Sep 11 04:55:47.560147 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:47.560129    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-eefe49-openshift-default-7b75c666d-n8zj8"]
Sep 11 04:55:48.815010 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:55:48.814972    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5670c7ea-29ff-4db1-9b49-f430d5281218" path="/var/lib/kubelet/pods/5670c7ea-29ff-4db1-9b49-f430d5281218/volumes"
Sep 11 04:56:23.199271 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:23.199231    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:56:30.252305 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.252265    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"]
Sep 11 04:56:30.253772 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.253701    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht" podUID="7937f2e9-132e-40b5-9a80-c82d78b4e88b" containerName="maas-api" containerID="cri-o://a8a46c15743098b8b9f7ea0f333afca5efc1915f623a854c6742623c08f63b4a" gracePeriod=30
Sep 11 04:56:30.746489 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.746458    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"
Sep 11 04:56:30.772714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.772660    2554 generic.go:356] "Generic (PLEG): container finished" podID="7937f2e9-132e-40b5-9a80-c82d78b4e88b" containerID="a8a46c15743098b8b9f7ea0f333afca5efc1915f623a854c6742623c08f63b4a" exitCode=0
Sep 11 04:56:30.772714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.772702    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"
Sep 11 04:56:30.772987 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.772727    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht" event={"ID":"7937f2e9-132e-40b5-9a80-c82d78b4e88b","Type":"ContainerDied","Data":"a8a46c15743098b8b9f7ea0f333afca5efc1915f623a854c6742623c08f63b4a"}
Sep 11 04:56:30.772987 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.772795    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht" event={"ID":"7937f2e9-132e-40b5-9a80-c82d78b4e88b","Type":"ContainerDied","Data":"95de020a1087b99f6d717097f797c158e74850e5e898a4046567938fa813266e"}
Sep 11 04:56:30.772987 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.772827    2554 scope.go:117] "RemoveContainer" containerID="a8a46c15743098b8b9f7ea0f333afca5efc1915f623a854c6742623c08f63b4a"
Sep 11 04:56:30.783100 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.783069    2554 scope.go:117] "RemoveContainer" containerID="a8a46c15743098b8b9f7ea0f333afca5efc1915f623a854c6742623c08f63b4a"
Sep 11 04:56:30.783492 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:56:30.783466    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8a46c15743098b8b9f7ea0f333afca5efc1915f623a854c6742623c08f63b4a\": container with ID starting with a8a46c15743098b8b9f7ea0f333afca5efc1915f623a854c6742623c08f63b4a not found: ID does not exist" containerID="a8a46c15743098b8b9f7ea0f333afca5efc1915f623a854c6742623c08f63b4a"
Sep 11 04:56:30.783596 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.783506    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8a46c15743098b8b9f7ea0f333afca5efc1915f623a854c6742623c08f63b4a"} err="failed to get container status \"a8a46c15743098b8b9f7ea0f333afca5efc1915f623a854c6742623c08f63b4a\": rpc error: code = NotFound desc = could not find container \"a8a46c15743098b8b9f7ea0f333afca5efc1915f623a854c6742623c08f63b4a\": container with ID starting with a8a46c15743098b8b9f7ea0f333afca5efc1915f623a854c6742623c08f63b4a not found: ID does not exist"
Sep 11 04:56:30.833907 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.833813    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7937f2e9-132e-40b5-9a80-c82d78b4e88b-openshift-service-ca\") pod \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\" (UID: \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\") "
Sep 11 04:56:30.833907 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.833895    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7937f2e9-132e-40b5-9a80-c82d78b4e88b-maas-api-tls\") pod \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\" (UID: \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\") "
Sep 11 04:56:30.834141 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.833947    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znsnz\" (UniqueName: \"kubernetes.io/projected/7937f2e9-132e-40b5-9a80-c82d78b4e88b-kube-api-access-znsnz\") pod \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\" (UID: \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\") "
Sep 11 04:56:30.834141 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.833997    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7937f2e9-132e-40b5-9a80-c82d78b4e88b-metrics-certs\") pod \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\" (UID: \"7937f2e9-132e-40b5-9a80-c82d78b4e88b\") "
Sep 11 04:56:30.834263 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.834223    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7937f2e9-132e-40b5-9a80-c82d78b4e88b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7937f2e9-132e-40b5-9a80-c82d78b4e88b" (UID: "7937f2e9-132e-40b5-9a80-c82d78b4e88b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:56:30.836276 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.836247    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7937f2e9-132e-40b5-9a80-c82d78b4e88b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7937f2e9-132e-40b5-9a80-c82d78b4e88b" (UID: "7937f2e9-132e-40b5-9a80-c82d78b4e88b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:56:30.836803 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.836748    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7937f2e9-132e-40b5-9a80-c82d78b4e88b-kube-api-access-znsnz" (OuterVolumeSpecName: "kube-api-access-znsnz") pod "7937f2e9-132e-40b5-9a80-c82d78b4e88b" (UID: "7937f2e9-132e-40b5-9a80-c82d78b4e88b"). InnerVolumeSpecName "kube-api-access-znsnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:56:30.836803 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.836787    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7937f2e9-132e-40b5-9a80-c82d78b4e88b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7937f2e9-132e-40b5-9a80-c82d78b4e88b" (UID: "7937f2e9-132e-40b5-9a80-c82d78b4e88b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:56:30.935298 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.935269    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7937f2e9-132e-40b5-9a80-c82d78b4e88b-maas-api-tls\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:56:30.935298 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.935295    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znsnz\" (UniqueName: \"kubernetes.io/projected/7937f2e9-132e-40b5-9a80-c82d78b4e88b-kube-api-access-znsnz\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:56:30.935532 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.935309    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7937f2e9-132e-40b5-9a80-c82d78b4e88b-metrics-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:56:30.935532 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:30.935324    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7937f2e9-132e-40b5-9a80-c82d78b4e88b-openshift-service-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:56:31.095161 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:31.095079    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"]
Sep 11 04:56:31.098104 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:31.098075    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-831a1c-5677587875-pjsht"]
Sep 11 04:56:32.813883 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:32.813796    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7937f2e9-132e-40b5-9a80-c82d78b4e88b" path="/var/lib/kubelet/pods/7937f2e9-132e-40b5-9a80-c82d78b4e88b/volumes"
Sep 11 04:56:33.997654 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:33.997611    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:56:36.723795 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:36.723758    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"]
Sep 11 04:56:36.724213 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:36.724059    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92" podUID="ed631a0a-5452-4f22-a669-2960576df5d7" containerName="istio-proxy" containerID="cri-o://c7131e581118d4e93424ce022affc04738858adc4efb34d3b5d8e84483fdc6d0" gracePeriod=30
Sep 11 04:56:39.335342 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:39.335285    2554 patch_prober.go:28] interesting pod/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 04:56:39.335794 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:39.335386    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92" podUID="ed631a0a-5452-4f22-a669-2960576df5d7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 04:56:41.000283 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:41.000248    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:56:41.988968 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:41.988911    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:56:42.144572 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.144542    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-istio-data\") pod \"ed631a0a-5452-4f22-a669-2960576df5d7\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") "
Sep 11 04:56:42.144572 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.144579    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed631a0a-5452-4f22-a669-2960576df5d7-istiod-ca-cert\") pod \"ed631a0a-5452-4f22-a669-2960576df5d7\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") "
Sep 11 04:56:42.145089 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.144617    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-credential-socket\") pod \"ed631a0a-5452-4f22-a669-2960576df5d7\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") "
Sep 11 04:56:42.145089 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.144642    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hmmq\" (UniqueName: \"kubernetes.io/projected/ed631a0a-5452-4f22-a669-2960576df5d7-kube-api-access-4hmmq\") pod \"ed631a0a-5452-4f22-a669-2960576df5d7\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") "
Sep 11 04:56:42.145089 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.144678    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-workload-socket\") pod \"ed631a0a-5452-4f22-a669-2960576df5d7\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") "
Sep 11 04:56:42.145089 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.144729    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed631a0a-5452-4f22-a669-2960576df5d7-istio-podinfo\") pod \"ed631a0a-5452-4f22-a669-2960576df5d7\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") "
Sep 11 04:56:42.145089 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.144757    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed631a0a-5452-4f22-a669-2960576df5d7-istio-token\") pod \"ed631a0a-5452-4f22-a669-2960576df5d7\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") "
Sep 11 04:56:42.145089 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.144808    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-istio-envoy\") pod \"ed631a0a-5452-4f22-a669-2960576df5d7\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") "
Sep 11 04:56:42.145089 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.144900    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-workload-certs\") pod \"ed631a0a-5452-4f22-a669-2960576df5d7\" (UID: \"ed631a0a-5452-4f22-a669-2960576df5d7\") "
Sep 11 04:56:42.145089 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.144909    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-istio-data" (OuterVolumeSpecName: "istio-data") pod "ed631a0a-5452-4f22-a669-2960576df5d7" (UID: "ed631a0a-5452-4f22-a669-2960576df5d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:56:42.145089 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.144931    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ed631a0a-5452-4f22-a669-2960576df5d7" (UID: "ed631a0a-5452-4f22-a669-2960576df5d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:56:42.145089 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.145066    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ed631a0a-5452-4f22-a669-2960576df5d7" (UID: "ed631a0a-5452-4f22-a669-2960576df5d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:56:42.145089 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.144982    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed631a0a-5452-4f22-a669-2960576df5d7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ed631a0a-5452-4f22-a669-2960576df5d7" (UID: "ed631a0a-5452-4f22-a669-2960576df5d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:56:42.145877 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.145212    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-istio-data\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:56:42.145877 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.145230    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed631a0a-5452-4f22-a669-2960576df5d7-istiod-ca-cert\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:56:42.145877 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.145243    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-credential-socket\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:56:42.145877 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.145256    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-workload-socket\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:56:42.145877 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.145306    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ed631a0a-5452-4f22-a669-2960576df5d7" (UID: "ed631a0a-5452-4f22-a669-2960576df5d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:56:42.147166 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.147136    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed631a0a-5452-4f22-a669-2960576df5d7-istio-token" (OuterVolumeSpecName: "istio-token") pod "ed631a0a-5452-4f22-a669-2960576df5d7" (UID: "ed631a0a-5452-4f22-a669-2960576df5d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:56:42.147166 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.147150    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ed631a0a-5452-4f22-a669-2960576df5d7" (UID: "ed631a0a-5452-4f22-a669-2960576df5d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 04:56:42.147362 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.147224    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ed631a0a-5452-4f22-a669-2960576df5d7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ed631a0a-5452-4f22-a669-2960576df5d7" (UID: "ed631a0a-5452-4f22-a669-2960576df5d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 04:56:42.147362 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.147263    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed631a0a-5452-4f22-a669-2960576df5d7-kube-api-access-4hmmq" (OuterVolumeSpecName: "kube-api-access-4hmmq") pod "ed631a0a-5452-4f22-a669-2960576df5d7" (UID: "ed631a0a-5452-4f22-a669-2960576df5d7"). InnerVolumeSpecName "kube-api-access-4hmmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:56:42.246009 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.245923    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-workload-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:56:42.246009 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.245954    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hmmq\" (UniqueName: \"kubernetes.io/projected/ed631a0a-5452-4f22-a669-2960576df5d7-kube-api-access-4hmmq\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:56:42.246009 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.245964    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed631a0a-5452-4f22-a669-2960576df5d7-istio-podinfo\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:56:42.246009 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.245975    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed631a0a-5452-4f22-a669-2960576df5d7-istio-token\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:56:42.246009 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.245986    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed631a0a-5452-4f22-a669-2960576df5d7-istio-envoy\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:56:42.838022 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.837987    2554 generic.go:356] "Generic (PLEG): container finished" podID="ed631a0a-5452-4f22-a669-2960576df5d7" containerID="c7131e581118d4e93424ce022affc04738858adc4efb34d3b5d8e84483fdc6d0" exitCode=0
Sep 11 04:56:42.838150 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.838045    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"
Sep 11 04:56:42.838150 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.838077    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92" event={"ID":"ed631a0a-5452-4f22-a669-2960576df5d7","Type":"ContainerDied","Data":"c7131e581118d4e93424ce022affc04738858adc4efb34d3b5d8e84483fdc6d0"}
Sep 11 04:56:42.838150 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.838135    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92" event={"ID":"ed631a0a-5452-4f22-a669-2960576df5d7","Type":"ContainerDied","Data":"a1b966032876402a9dc1141e5935142f762f27df5ba8332a57a5998c28bfecf5"}
Sep 11 04:56:42.838275 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.838162    2554 scope.go:117] "RemoveContainer" containerID="c7131e581118d4e93424ce022affc04738858adc4efb34d3b5d8e84483fdc6d0"
Sep 11 04:56:42.846968 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.846950    2554 scope.go:117] "RemoveContainer" containerID="76ec04ecf6c4c71a74f68036f069e5fda265b1420559a11848b0bb9a06404e8c"
Sep 11 04:56:42.855385 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.855363    2554 scope.go:117] "RemoveContainer" containerID="c7131e581118d4e93424ce022affc04738858adc4efb34d3b5d8e84483fdc6d0"
Sep 11 04:56:42.855724 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:56:42.855704    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7131e581118d4e93424ce022affc04738858adc4efb34d3b5d8e84483fdc6d0\": container with ID starting with c7131e581118d4e93424ce022affc04738858adc4efb34d3b5d8e84483fdc6d0 not found: ID does not exist" containerID="c7131e581118d4e93424ce022affc04738858adc4efb34d3b5d8e84483fdc6d0"
Sep 11 04:56:42.855795 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.855740    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7131e581118d4e93424ce022affc04738858adc4efb34d3b5d8e84483fdc6d0"} err="failed to get container status \"c7131e581118d4e93424ce022affc04738858adc4efb34d3b5d8e84483fdc6d0\": rpc error: code = NotFound desc = could not find container \"c7131e581118d4e93424ce022affc04738858adc4efb34d3b5d8e84483fdc6d0\": container with ID starting with c7131e581118d4e93424ce022affc04738858adc4efb34d3b5d8e84483fdc6d0 not found: ID does not exist"
Sep 11 04:56:42.855795 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.855763    2554 scope.go:117] "RemoveContainer" containerID="76ec04ecf6c4c71a74f68036f069e5fda265b1420559a11848b0bb9a06404e8c"
Sep 11 04:56:42.856061 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:56:42.856044    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76ec04ecf6c4c71a74f68036f069e5fda265b1420559a11848b0bb9a06404e8c\": container with ID starting with 76ec04ecf6c4c71a74f68036f069e5fda265b1420559a11848b0bb9a06404e8c not found: ID does not exist" containerID="76ec04ecf6c4c71a74f68036f069e5fda265b1420559a11848b0bb9a06404e8c"
Sep 11 04:56:42.856125 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.856067    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76ec04ecf6c4c71a74f68036f069e5fda265b1420559a11848b0bb9a06404e8c"} err="failed to get container status \"76ec04ecf6c4c71a74f68036f069e5fda265b1420559a11848b0bb9a06404e8c\": rpc error: code = NotFound desc = could not find container \"76ec04ecf6c4c71a74f68036f069e5fda265b1420559a11848b0bb9a06404e8c\": container with ID starting with 76ec04ecf6c4c71a74f68036f069e5fda265b1420559a11848b0bb9a06404e8c not found: ID does not exist"
Sep 11 04:56:42.857856 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.857834    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"]
Sep 11 04:56:42.859572 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:42.859553    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-831a1c-openshift-default-6bd4488496-vft92"]
Sep 11 04:56:44.156539 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.156504    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"]
Sep 11 04:56:44.157026 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.156944    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7937f2e9-132e-40b5-9a80-c82d78b4e88b" containerName="maas-api"
Sep 11 04:56:44.157026 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.156958    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7937f2e9-132e-40b5-9a80-c82d78b4e88b" containerName="maas-api"
Sep 11 04:56:44.157026 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.156991    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8d1919-fce8-45fc-ab96-1f6f215f8b10" containerName="istio-proxy"
Sep 11 04:56:44.157026 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.156998    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8d1919-fce8-45fc-ab96-1f6f215f8b10" containerName="istio-proxy"
Sep 11 04:56:44.157026 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.157014    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5670c7ea-29ff-4db1-9b49-f430d5281218" containerName="istio-proxy"
Sep 11 04:56:44.157026 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.157020    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5670c7ea-29ff-4db1-9b49-f430d5281218" containerName="istio-proxy"
Sep 11 04:56:44.157026 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.157029    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed631a0a-5452-4f22-a669-2960576df5d7" containerName="istio-proxy"
Sep 11 04:56:44.157521 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.157034    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed631a0a-5452-4f22-a669-2960576df5d7" containerName="istio-proxy"
Sep 11 04:56:44.157521 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.157044    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12d682ca-e887-4c11-bd5d-ab27f8b7b861" containerName="maas-api"
Sep 11 04:56:44.157521 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.157049    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="12d682ca-e887-4c11-bd5d-ab27f8b7b861" containerName="maas-api"
Sep 11 04:56:44.157521 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.157064    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed631a0a-5452-4f22-a669-2960576df5d7" containerName="istio-proxy"
Sep 11 04:56:44.157521 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.157071    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed631a0a-5452-4f22-a669-2960576df5d7" containerName="istio-proxy"
Sep 11 04:56:44.157521 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.157166    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb8d1919-fce8-45fc-ab96-1f6f215f8b10" containerName="istio-proxy"
Sep 11 04:56:44.157521 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.157178    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5670c7ea-29ff-4db1-9b49-f430d5281218" containerName="istio-proxy"
Sep 11 04:56:44.157521 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.157188    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed631a0a-5452-4f22-a669-2960576df5d7" containerName="istio-proxy"
Sep 11 04:56:44.157521 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.157202    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7937f2e9-132e-40b5-9a80-c82d78b4e88b" containerName="maas-api"
Sep 11 04:56:44.157521 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.157211    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="12d682ca-e887-4c11-bd5d-ab27f8b7b861" containerName="maas-api"
Sep 11 04:56:44.162050 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.162028    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"
Sep 11 04:56:44.164213 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.164189    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ca9fd5b9-serving-cert\""
Sep 11 04:56:44.172918 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.172898    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"]
Sep 11 04:56:44.264696 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.264659    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-openshift-service-ca\") pod \"maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz\" (UID: \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"
Sep 11 04:56:44.264696 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.264701    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-metrics-certs\") pod \"maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz\" (UID: \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"
Sep 11 04:56:44.264913 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.264779    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckvr6\" (UniqueName: \"kubernetes.io/projected/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-kube-api-access-ckvr6\") pod \"maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz\" (UID: \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"
Sep 11 04:56:44.264913 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.264840    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-maas-api-tls\") pod \"maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz\" (UID: \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"
Sep 11 04:56:44.366155 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.366105    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-maas-api-tls\") pod \"maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz\" (UID: \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"
Sep 11 04:56:44.366376 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.366199    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-openshift-service-ca\") pod \"maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz\" (UID: \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"
Sep 11 04:56:44.366376 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.366301    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-metrics-certs\") pod \"maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz\" (UID: \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"
Sep 11 04:56:44.366532 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.366403    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckvr6\" (UniqueName: \"kubernetes.io/projected/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-kube-api-access-ckvr6\") pod \"maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz\" (UID: \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"
Sep 11 04:56:44.366999 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.366970    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-openshift-service-ca\") pod \"maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz\" (UID: \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"
Sep 11 04:56:44.369048 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.369018    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-maas-api-tls\") pod \"maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz\" (UID: \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"
Sep 11 04:56:44.369187 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.369137    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-metrics-certs\") pod \"maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz\" (UID: \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"
Sep 11 04:56:44.374878 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.374845    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckvr6\" (UniqueName: \"kubernetes.io/projected/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-kube-api-access-ckvr6\") pod \"maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz\" (UID: \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"
Sep 11 04:56:44.475716 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.475623    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"
Sep 11 04:56:44.749745 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.749652    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"]
Sep 11 04:56:44.752435 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:56:44.752391    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c1ceca_3cef_49fb_b5d2_68ca8eb590a8.slice/crio-3e6f05c1fa28f943f9e9e49d44ccdea380113b75b2926cf92547c656d49cc044 WatchSource:0}: Error finding container 3e6f05c1fa28f943f9e9e49d44ccdea380113b75b2926cf92547c656d49cc044: Status 404 returned error can't find the container with id 3e6f05c1fa28f943f9e9e49d44ccdea380113b75b2926cf92547c656d49cc044
Sep 11 04:56:44.813570 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.813539    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed631a0a-5452-4f22-a669-2960576df5d7" path="/var/lib/kubelet/pods/ed631a0a-5452-4f22-a669-2960576df5d7/volumes"
Sep 11 04:56:44.851645 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:44.851612    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz" event={"ID":"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8","Type":"ContainerStarted","Data":"3e6f05c1fa28f943f9e9e49d44ccdea380113b75b2926cf92547c656d49cc044"}
Sep 11 04:56:45.858218 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:45.858178    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz" event={"ID":"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8","Type":"ContainerStarted","Data":"9a8497ddd5416e9f6efa458bd4471489f81c9bd3a877c9af061a4905dbdbc60f"}
Sep 11 04:56:45.858653 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:45.858265    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"
Sep 11 04:56:45.875765 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:45.875712    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz" podStartSLOduration=1.373017005 podStartE2EDuration="1.875693294s" totalImagesPullingTime="502.676289ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:56:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:56:45.873498392 +0000 UTC m=+995.526758073" watchObservedRunningTime="2026-09-11 04:56:45.875693294 +0000 UTC m=+995.528952973"
Sep 11 04:56:47.676256 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:47.676219    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"]
Sep 11 04:56:47.676811 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:47.676498    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q" podUID="db9f59e7-071d-4ccb-88b9-120182e01026" containerName="maas-api" containerID="cri-o://64c4aa91f47dc2a2a7b203ddd423d7924d352524a65a7d75143ab3436e3e7be9" gracePeriod=30
Sep 11 04:56:48.102829 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.102791    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:56:48.151138 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.151113    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"
Sep 11 04:56:48.308188 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.308085    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db9f59e7-071d-4ccb-88b9-120182e01026-openshift-service-ca\") pod \"db9f59e7-071d-4ccb-88b9-120182e01026\" (UID: \"db9f59e7-071d-4ccb-88b9-120182e01026\") "
Sep 11 04:56:48.308382 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.308201    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db9f59e7-071d-4ccb-88b9-120182e01026-metrics-certs\") pod \"db9f59e7-071d-4ccb-88b9-120182e01026\" (UID: \"db9f59e7-071d-4ccb-88b9-120182e01026\") "
Sep 11 04:56:48.308382 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.308243    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8ntq\" (UniqueName: \"kubernetes.io/projected/db9f59e7-071d-4ccb-88b9-120182e01026-kube-api-access-f8ntq\") pod \"db9f59e7-071d-4ccb-88b9-120182e01026\" (UID: \"db9f59e7-071d-4ccb-88b9-120182e01026\") "
Sep 11 04:56:48.308382 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.308271    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db9f59e7-071d-4ccb-88b9-120182e01026-maas-api-tls\") pod \"db9f59e7-071d-4ccb-88b9-120182e01026\" (UID: \"db9f59e7-071d-4ccb-88b9-120182e01026\") "
Sep 11 04:56:48.308569 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.308511    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db9f59e7-071d-4ccb-88b9-120182e01026-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "db9f59e7-071d-4ccb-88b9-120182e01026" (UID: "db9f59e7-071d-4ccb-88b9-120182e01026"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:56:48.308650 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.308631    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db9f59e7-071d-4ccb-88b9-120182e01026-openshift-service-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:56:48.310689 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.310653    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db9f59e7-071d-4ccb-88b9-120182e01026-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "db9f59e7-071d-4ccb-88b9-120182e01026" (UID: "db9f59e7-071d-4ccb-88b9-120182e01026"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:56:48.311103 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.311073    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db9f59e7-071d-4ccb-88b9-120182e01026-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "db9f59e7-071d-4ccb-88b9-120182e01026" (UID: "db9f59e7-071d-4ccb-88b9-120182e01026"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:56:48.311103 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.311099    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db9f59e7-071d-4ccb-88b9-120182e01026-kube-api-access-f8ntq" (OuterVolumeSpecName: "kube-api-access-f8ntq") pod "db9f59e7-071d-4ccb-88b9-120182e01026" (UID: "db9f59e7-071d-4ccb-88b9-120182e01026"). InnerVolumeSpecName "kube-api-access-f8ntq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:56:48.409527 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.409465    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/db9f59e7-071d-4ccb-88b9-120182e01026-metrics-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:56:48.409527 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.409494    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8ntq\" (UniqueName: \"kubernetes.io/projected/db9f59e7-071d-4ccb-88b9-120182e01026-kube-api-access-f8ntq\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:56:48.409527 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.409504    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db9f59e7-071d-4ccb-88b9-120182e01026-maas-api-tls\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:56:48.875680 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.875642    2554 generic.go:356] "Generic (PLEG): container finished" podID="db9f59e7-071d-4ccb-88b9-120182e01026" containerID="64c4aa91f47dc2a2a7b203ddd423d7924d352524a65a7d75143ab3436e3e7be9" exitCode=0
Sep 11 04:56:48.876128 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.875689    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"
Sep 11 04:56:48.876128 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.875726    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q" event={"ID":"db9f59e7-071d-4ccb-88b9-120182e01026","Type":"ContainerDied","Data":"64c4aa91f47dc2a2a7b203ddd423d7924d352524a65a7d75143ab3436e3e7be9"}
Sep 11 04:56:48.876128 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.875784    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q" event={"ID":"db9f59e7-071d-4ccb-88b9-120182e01026","Type":"ContainerDied","Data":"d9fb813f62ad9a93042010043b2443a7224f39ad70d72f46c9a6c085c4d38dea"}
Sep 11 04:56:48.876128 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.875808    2554 scope.go:117] "RemoveContainer" containerID="64c4aa91f47dc2a2a7b203ddd423d7924d352524a65a7d75143ab3436e3e7be9"
Sep 11 04:56:48.885460 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.885437    2554 scope.go:117] "RemoveContainer" containerID="64c4aa91f47dc2a2a7b203ddd423d7924d352524a65a7d75143ab3436e3e7be9"
Sep 11 04:56:48.885859 ip-10-0-143-244 kubenswrapper[2554]: E0911 04:56:48.885815    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64c4aa91f47dc2a2a7b203ddd423d7924d352524a65a7d75143ab3436e3e7be9\": container with ID starting with 64c4aa91f47dc2a2a7b203ddd423d7924d352524a65a7d75143ab3436e3e7be9 not found: ID does not exist" containerID="64c4aa91f47dc2a2a7b203ddd423d7924d352524a65a7d75143ab3436e3e7be9"
Sep 11 04:56:48.885859 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.885852    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64c4aa91f47dc2a2a7b203ddd423d7924d352524a65a7d75143ab3436e3e7be9"} err="failed to get container status \"64c4aa91f47dc2a2a7b203ddd423d7924d352524a65a7d75143ab3436e3e7be9\": rpc error: code = NotFound desc = could not find container \"64c4aa91f47dc2a2a7b203ddd423d7924d352524a65a7d75143ab3436e3e7be9\": container with ID starting with 64c4aa91f47dc2a2a7b203ddd423d7924d352524a65a7d75143ab3436e3e7be9 not found: ID does not exist"
Sep 11 04:56:48.892617 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.892588    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"]
Sep 11 04:56:48.894448 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:48.894321    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7bdb3c-78b6c5444d-l5b7q"]
Sep 11 04:56:50.814304 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:50.814258    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db9f59e7-071d-4ccb-88b9-120182e01026" path="/var/lib/kubelet/pods/db9f59e7-071d-4ccb-88b9-120182e01026/volumes"
Sep 11 04:56:51.869135 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:51.869103    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"
Sep 11 04:56:54.971945 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:54.971907    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"]
Sep 11 04:56:54.972568 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:54.972546    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8d1919-fce8-45fc-ab96-1f6f215f8b10" containerName="istio-proxy"
Sep 11 04:56:54.972653 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:54.972571    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8d1919-fce8-45fc-ab96-1f6f215f8b10" containerName="istio-proxy"
Sep 11 04:56:54.972653 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:54.972594    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db9f59e7-071d-4ccb-88b9-120182e01026" containerName="maas-api"
Sep 11 04:56:54.972653 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:54.972602    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="db9f59e7-071d-4ccb-88b9-120182e01026" containerName="maas-api"
Sep 11 04:56:54.972653 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:54.972613    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5670c7ea-29ff-4db1-9b49-f430d5281218" containerName="istio-proxy"
Sep 11 04:56:54.972653 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:54.972621    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5670c7ea-29ff-4db1-9b49-f430d5281218" containerName="istio-proxy"
Sep 11 04:56:54.972901 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:54.972714    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb8d1919-fce8-45fc-ab96-1f6f215f8b10" containerName="istio-proxy"
Sep 11 04:56:54.972901 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:54.972729    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5670c7ea-29ff-4db1-9b49-f430d5281218" containerName="istio-proxy"
Sep 11 04:56:54.972901 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:54.972739    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed631a0a-5452-4f22-a669-2960576df5d7" containerName="istio-proxy"
Sep 11 04:56:54.972901 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:54.972750    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="db9f59e7-071d-4ccb-88b9-120182e01026" containerName="maas-api"
Sep 11 04:56:54.977798 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:54.977772    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:54.979985 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:54.979967    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-c1858a-openshift-default-dockercfg-dj9ns\""
Sep 11 04:56:54.985374 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:54.985350    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"]
Sep 11 04:56:55.070632 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.070578    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-credential-socket\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.070834 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.070642    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-data\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.070834 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.070681    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-workload-socket\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.070834 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.070772    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-workload-certs\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.071001 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.070947    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvntb\" (UniqueName: \"kubernetes.io/projected/789566f4-0b05-41ab-bfbc-e628b6c23f95-kube-api-access-vvntb\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.071064 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.071051    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-podinfo\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.071118 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.071092    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-token\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.071193 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.071168    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-envoy\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.071252 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.071204    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/789566f4-0b05-41ab-bfbc-e628b6c23f95-istiod-ca-cert\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.172638 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.172602    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-workload-certs\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.172835 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.172666    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvntb\" (UniqueName: \"kubernetes.io/projected/789566f4-0b05-41ab-bfbc-e628b6c23f95-kube-api-access-vvntb\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.172835 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.172697    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-podinfo\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.172835 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.172720    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-token\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.172835 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.172743    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-envoy\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.172835 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.172769    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/789566f4-0b05-41ab-bfbc-e628b6c23f95-istiod-ca-cert\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.172835 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.172800    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-credential-socket\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.172835 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.172827    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-data\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.173221 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.172859    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-workload-socket\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.173221 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.173168    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-workload-certs\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.173295 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.173263    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-workload-socket\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.173381 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.173315    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-credential-socket\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.173381 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.173350    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-data\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.173586 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.173568    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/789566f4-0b05-41ab-bfbc-e628b6c23f95-istiod-ca-cert\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.175237 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.175218    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-envoy\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.175513 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.175496    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-podinfo\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.180607 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.180582    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-token\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.180747 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.180616    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvntb\" (UniqueName: \"kubernetes.io/projected/789566f4-0b05-41ab-bfbc-e628b6c23f95-kube-api-access-vvntb\") pod \"e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") " pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.290572 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.290481    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:55.566912 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.566888    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"]
Sep 11 04:56:55.568889 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:56:55.568864    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod789566f4_0b05_41ab_bfbc_e628b6c23f95.slice/crio-c20ddba1be565745caf58e6de73a1ce0580645495d129edfb1a539f223c8f441 WatchSource:0}: Error finding container c20ddba1be565745caf58e6de73a1ce0580645495d129edfb1a539f223c8f441: Status 404 returned error can't find the container with id c20ddba1be565745caf58e6de73a1ce0580645495d129edfb1a539f223c8f441
Sep 11 04:56:55.571481 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.571448    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:56:55.571566 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.571524    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:56:55.571566 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.571553    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:56:55.918914 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.918874    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6" event={"ID":"789566f4-0b05-41ab-bfbc-e628b6c23f95","Type":"ContainerStarted","Data":"25ad39f526a401b7667539fe5229a01b91488328f7494d678d28c30feae38d33"}
Sep 11 04:56:55.919117 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.918933    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6" event={"ID":"789566f4-0b05-41ab-bfbc-e628b6c23f95","Type":"ContainerStarted","Data":"c20ddba1be565745caf58e6de73a1ce0580645495d129edfb1a539f223c8f441"}
Sep 11 04:56:55.937560 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:55.937482    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6" podStartSLOduration=1.937464692 podStartE2EDuration="1.937464692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:56:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:56:55.936712106 +0000 UTC m=+1005.589971785" watchObservedRunningTime="2026-09-11 04:56:55.937464692 +0000 UTC m=+1005.590724399"
Sep 11 04:56:56.291617 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:56.291527    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:56.297126 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:56.297100    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:56.802566 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:56.802528    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:56:56.930764 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:56.930732    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:56.931804 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:56.931778    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:56:59.911630 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:59.911596    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt"]
Sep 11 04:56:59.915384 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:59.915365    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt"
Sep 11 04:56:59.917694 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:59.917666    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-c1858a\""
Sep 11 04:56:59.918044 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:59.918021    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-c1858a-dockercfg-wq2jl\""
Sep 11 04:56:59.923519 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:56:59.923494    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt"]
Sep 11 04:57:00.019204 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:00.019160    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b91d50ba-50cc-4990-8409-c42bebd0d7ab-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt\" (UID: \"b91d50ba-50cc-4990-8409-c42bebd0d7ab\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt"
Sep 11 04:57:00.019419 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:00.019278    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll88n\" (UniqueName: \"kubernetes.io/projected/b91d50ba-50cc-4990-8409-c42bebd0d7ab-kube-api-access-ll88n\") pod \"payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt\" (UID: \"b91d50ba-50cc-4990-8409-c42bebd0d7ab\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt"
Sep 11 04:57:00.120477 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:00.120439    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b91d50ba-50cc-4990-8409-c42bebd0d7ab-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt\" (UID: \"b91d50ba-50cc-4990-8409-c42bebd0d7ab\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt"
Sep 11 04:57:00.120656 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:00.120508    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll88n\" (UniqueName: \"kubernetes.io/projected/b91d50ba-50cc-4990-8409-c42bebd0d7ab-kube-api-access-ll88n\") pod \"payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt\" (UID: \"b91d50ba-50cc-4990-8409-c42bebd0d7ab\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt"
Sep 11 04:57:00.121166 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:00.121145    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b91d50ba-50cc-4990-8409-c42bebd0d7ab-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt\" (UID: \"b91d50ba-50cc-4990-8409-c42bebd0d7ab\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt"
Sep 11 04:57:00.128610 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:00.128582    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll88n\" (UniqueName: \"kubernetes.io/projected/b91d50ba-50cc-4990-8409-c42bebd0d7ab-kube-api-access-ll88n\") pod \"payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt\" (UID: \"b91d50ba-50cc-4990-8409-c42bebd0d7ab\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt"
Sep 11 04:57:00.228023 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:00.227939    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt"
Sep 11 04:57:00.501802 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:00.501767    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt"]
Sep 11 04:57:00.503102 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:57:00.503074    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91d50ba_50cc_4990_8409_c42bebd0d7ab.slice/crio-acb5a0a62f39385d7814a4d143923992dcbadbcbd21a41cf8900a3716eae185e WatchSource:0}: Error finding container acb5a0a62f39385d7814a4d143923992dcbadbcbd21a41cf8900a3716eae185e: Status 404 returned error can't find the container with id acb5a0a62f39385d7814a4d143923992dcbadbcbd21a41cf8900a3716eae185e
Sep 11 04:57:00.954953 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:00.954918    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt" event={"ID":"b91d50ba-50cc-4990-8409-c42bebd0d7ab","Type":"ContainerStarted","Data":"089ce7612009769ef5b90bf501ad1f28b11bbe33dd04191cbb806539df8b60fe"}
Sep 11 04:57:00.955378 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:00.954975    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt" event={"ID":"b91d50ba-50cc-4990-8409-c42bebd0d7ab","Type":"ContainerStarted","Data":"acb5a0a62f39385d7814a4d143923992dcbadbcbd21a41cf8900a3716eae185e"}
Sep 11 04:57:00.955378 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:00.954995    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt"
Sep 11 04:57:00.969804 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:00.969753    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt" podStartSLOduration=1.969732487 podStartE2EDuration="1.969732487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:56:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:57:00.969248096 +0000 UTC m=+1010.622507789" watchObservedRunningTime="2026-09-11 04:57:00.969732487 +0000 UTC m=+1010.622992166"
Sep 11 04:57:07.902450 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:07.902392    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:57:11.962786 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:11.962747    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt"
Sep 11 04:57:12.783714 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:12.783670    2554 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": read tcp 10.134.0.2:57222->10.134.0.59:15021: read: connection reset by peer" start-of-body=
Sep 11 04:57:12.783912 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:12.783743    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6" podUID="789566f4-0b05-41ab-bfbc-e628b6c23f95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": read tcp 10.134.0.2:57222->10.134.0.59:15021: read: connection reset by peer"
Sep 11 04:57:13.023539 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:13.023460    2554 generic.go:356] "Generic (PLEG): container finished" podID="789566f4-0b05-41ab-bfbc-e628b6c23f95" containerID="25ad39f526a401b7667539fe5229a01b91488328f7494d678d28c30feae38d33" exitCode=0
Sep 11 04:57:13.023892 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:13.023532    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6" event={"ID":"789566f4-0b05-41ab-bfbc-e628b6c23f95","Type":"ContainerDied","Data":"25ad39f526a401b7667539fe5229a01b91488328f7494d678d28c30feae38d33"}
Sep 11 04:57:13.023976 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:13.023963    2554 scope.go:117] "RemoveContainer" containerID="25ad39f526a401b7667539fe5229a01b91488328f7494d678d28c30feae38d33"
Sep 11 04:57:13.025052 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:13.025029    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:57:13.025100 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:13.025090    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:57:13.025136 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:13.025123    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:57:14.030805 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:14.030773    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6" event={"ID":"789566f4-0b05-41ab-bfbc-e628b6c23f95","Type":"ContainerStarted","Data":"731a2d42e019d69c8db90f468364569f5df7dbe0c444cef6e679fca514c5f104"}
Sep 11 04:57:14.291371 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:14.291265    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:57:14.291553 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:14.291531    2554 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 11 04:57:14.291613 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:14.291594    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6" podUID="789566f4-0b05-41ab-bfbc-e628b6c23f95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 11 04:57:15.291876 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:15.291841    2554 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 11 04:57:15.292261 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:15.291904    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6" podUID="789566f4-0b05-41ab-bfbc-e628b6c23f95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 11 04:57:16.291789 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:16.291755    2554 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 11 04:57:16.292029 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:16.291822    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6" podUID="789566f4-0b05-41ab-bfbc-e628b6c23f95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 11 04:57:17.291357 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:17.291309    2554 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 11 04:57:17.291534 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:17.291384    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6" podUID="789566f4-0b05-41ab-bfbc-e628b6c23f95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 11 04:57:18.291144 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:18.291109    2554 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 11 04:57:18.291558 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:18.291168    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6" podUID="789566f4-0b05-41ab-bfbc-e628b6c23f95" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 11 04:57:19.294438 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:19.294400    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:57:19.294893 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:19.294692    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:57:19.295433 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:19.295416    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 04:57:25.900162 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:25.900127    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"]
Sep 11 04:57:25.900699 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:25.900413    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz" podUID="f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8" containerName="maas-api" containerID="cri-o://9a8497ddd5416e9f6efa458bd4471489f81c9bd3a877c9af061a4905dbdbc60f" gracePeriod=30
Sep 11 04:57:26.096398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:26.096218    2554 generic.go:356] "Generic (PLEG): container finished" podID="f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8" containerID="9a8497ddd5416e9f6efa458bd4471489f81c9bd3a877c9af061a4905dbdbc60f" exitCode=0
Sep 11 04:57:26.096398 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:26.096310    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz" event={"ID":"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8","Type":"ContainerDied","Data":"9a8497ddd5416e9f6efa458bd4471489f81c9bd3a877c9af061a4905dbdbc60f"}
Sep 11 04:57:26.153348 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:26.153274    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"
Sep 11 04:57:26.293678 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:26.293640    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-metrics-certs\") pod \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\" (UID: \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\") "
Sep 11 04:57:26.293857 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:26.293697    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckvr6\" (UniqueName: \"kubernetes.io/projected/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-kube-api-access-ckvr6\") pod \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\" (UID: \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\") "
Sep 11 04:57:26.293857 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:26.293746    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-openshift-service-ca\") pod \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\" (UID: \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\") "
Sep 11 04:57:26.293949 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:26.293856    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-maas-api-tls\") pod \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\" (UID: \"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8\") "
Sep 11 04:57:26.294243 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:26.294209    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8" (UID: "f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 04:57:26.296072 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:26.296041    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8" (UID: "f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:57:26.296172 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:26.296069    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8" (UID: "f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 04:57:26.296172 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:26.296159    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-kube-api-access-ckvr6" (OuterVolumeSpecName: "kube-api-access-ckvr6") pod "f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8" (UID: "f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8"). InnerVolumeSpecName "kube-api-access-ckvr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 04:57:26.395235 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:26.395200    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-maas-api-tls\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:57:26.395235 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:26.395228    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-metrics-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:57:26.395235 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:26.395238    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckvr6\" (UniqueName: \"kubernetes.io/projected/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-kube-api-access-ckvr6\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:57:26.395505 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:26.395247    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8-openshift-service-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 04:57:27.103197 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:27.103122    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"
Sep 11 04:57:27.103197 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:27.103132    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz" event={"ID":"f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8","Type":"ContainerDied","Data":"3e6f05c1fa28f943f9e9e49d44ccdea380113b75b2926cf92547c656d49cc044"}
Sep 11 04:57:27.103197 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:27.103194    2554 scope.go:117] "RemoveContainer" containerID="9a8497ddd5416e9f6efa458bd4471489f81c9bd3a877c9af061a4905dbdbc60f"
Sep 11 04:57:27.119439 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:27.119410    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"]
Sep 11 04:57:27.122832 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:27.122804    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ca9fd5b9-7999468dcc-k2rmz"]
Sep 11 04:57:28.212304 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.212269    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x"]
Sep 11 04:57:28.212707 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.212700    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8" containerName="maas-api"
Sep 11 04:57:28.212752 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.212712    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8" containerName="maas-api"
Sep 11 04:57:28.212790 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.212778    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8" containerName="maas-api"
Sep 11 04:57:28.215876 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.215859    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x"
Sep 11 04:57:28.218211 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.218188    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-16b799\""
Sep 11 04:57:28.218367 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.218247    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-16b799-dockercfg-p5btv\""
Sep 11 04:57:28.224958 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.224934    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x"]
Sep 11 04:57:28.264141 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.264106    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw"]
Sep 11 04:57:28.266712 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.266697    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw"
Sep 11 04:57:28.280882 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.280852    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw"]
Sep 11 04:57:28.312532 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.312485    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c19bab4a-f4d5-4271-860f-c1a0858d49ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x\" (UID: \"c19bab4a-f4d5-4271-860f-c1a0858d49ac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x"
Sep 11 04:57:28.312704 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.312553    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8cvv\" (UniqueName: \"kubernetes.io/projected/148610a5-7f17-4ff2-a473-40fb4138e244-kube-api-access-x8cvv\") pod \"payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw\" (UID: \"148610a5-7f17-4ff2-a473-40fb4138e244\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw"
Sep 11 04:57:28.312704 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.312599    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qpcd\" (UniqueName: \"kubernetes.io/projected/c19bab4a-f4d5-4271-860f-c1a0858d49ac-kube-api-access-7qpcd\") pod \"payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x\" (UID: \"c19bab4a-f4d5-4271-860f-c1a0858d49ac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x"
Sep 11 04:57:28.312704 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.312659    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/148610a5-7f17-4ff2-a473-40fb4138e244-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw\" (UID: \"148610a5-7f17-4ff2-a473-40fb4138e244\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw"
Sep 11 04:57:28.413548 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.413507    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8cvv\" (UniqueName: \"kubernetes.io/projected/148610a5-7f17-4ff2-a473-40fb4138e244-kube-api-access-x8cvv\") pod \"payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw\" (UID: \"148610a5-7f17-4ff2-a473-40fb4138e244\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw"
Sep 11 04:57:28.413725 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.413562    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qpcd\" (UniqueName: \"kubernetes.io/projected/c19bab4a-f4d5-4271-860f-c1a0858d49ac-kube-api-access-7qpcd\") pod \"payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x\" (UID: \"c19bab4a-f4d5-4271-860f-c1a0858d49ac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x"
Sep 11 04:57:28.413725 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.413588    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/148610a5-7f17-4ff2-a473-40fb4138e244-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw\" (UID: \"148610a5-7f17-4ff2-a473-40fb4138e244\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw"
Sep 11 04:57:28.413725 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.413653    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c19bab4a-f4d5-4271-860f-c1a0858d49ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x\" (UID: \"c19bab4a-f4d5-4271-860f-c1a0858d49ac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x"
Sep 11 04:57:28.414385 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.414365    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/148610a5-7f17-4ff2-a473-40fb4138e244-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw\" (UID: \"148610a5-7f17-4ff2-a473-40fb4138e244\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw"
Sep 11 04:57:28.414432 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.414421    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c19bab4a-f4d5-4271-860f-c1a0858d49ac-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x\" (UID: \"c19bab4a-f4d5-4271-860f-c1a0858d49ac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x"
Sep 11 04:57:28.421881 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.421843    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qpcd\" (UniqueName: \"kubernetes.io/projected/c19bab4a-f4d5-4271-860f-c1a0858d49ac-kube-api-access-7qpcd\") pod \"payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x\" (UID: \"c19bab4a-f4d5-4271-860f-c1a0858d49ac\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x"
Sep 11 04:57:28.421881 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.421851    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8cvv\" (UniqueName: \"kubernetes.io/projected/148610a5-7f17-4ff2-a473-40fb4138e244-kube-api-access-x8cvv\") pod \"payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw\" (UID: \"148610a5-7f17-4ff2-a473-40fb4138e244\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw"
Sep 11 04:57:28.527860 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.527744    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x"
Sep 11 04:57:28.577157 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.577092    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw"
Sep 11 04:57:28.800101 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.800068    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x"]
Sep 11 04:57:28.801840 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:57:28.801810    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc19bab4a_f4d5_4271_860f_c1a0858d49ac.slice/crio-da15ec432c72285d060ae6131f82b183f7cd2ae6cbc9e825c0b7796a858881a8 WatchSource:0}: Error finding container da15ec432c72285d060ae6131f82b183f7cd2ae6cbc9e825c0b7796a858881a8: Status 404 returned error can't find the container with id da15ec432c72285d060ae6131f82b183f7cd2ae6cbc9e825c0b7796a858881a8
Sep 11 04:57:28.813585 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.813558    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8" path="/var/lib/kubelet/pods/f8c1ceca-3cef-49fb-b5d2-68ca8eb590a8/volumes"
Sep 11 04:57:28.870112 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:28.870072    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw"]
Sep 11 04:57:28.870653 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:57:28.870627    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod148610a5_7f17_4ff2_a473_40fb4138e244.slice/crio-080b498fe0b96db60f6d638f8f61500f2feac17fce57c3fd3356496993430c60 WatchSource:0}: Error finding container 080b498fe0b96db60f6d638f8f61500f2feac17fce57c3fd3356496993430c60: Status 404 returned error can't find the container with id 080b498fe0b96db60f6d638f8f61500f2feac17fce57c3fd3356496993430c60
Sep 11 04:57:29.118897 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:29.118780    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw" event={"ID":"148610a5-7f17-4ff2-a473-40fb4138e244","Type":"ContainerStarted","Data":"2d98c6fda22ed1e0e989c05c4b015dfe735b60f7cae045816b1704d4176cb574"}
Sep 11 04:57:29.118897 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:29.118866    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw" event={"ID":"148610a5-7f17-4ff2-a473-40fb4138e244","Type":"ContainerStarted","Data":"080b498fe0b96db60f6d638f8f61500f2feac17fce57c3fd3356496993430c60"}
Sep 11 04:57:29.119187 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:29.118962    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw"
Sep 11 04:57:29.120643 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:29.120617    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x" event={"ID":"c19bab4a-f4d5-4271-860f-c1a0858d49ac","Type":"ContainerStarted","Data":"63dd1ce02dbbf0e4516e7c6dbd2b62df1c634121afee69f65bb877e27e1d2558"}
Sep 11 04:57:29.120774 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:29.120666    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x" event={"ID":"c19bab4a-f4d5-4271-860f-c1a0858d49ac","Type":"ContainerStarted","Data":"da15ec432c72285d060ae6131f82b183f7cd2ae6cbc9e825c0b7796a858881a8"}
Sep 11 04:57:29.120774 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:29.120707    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x"
Sep 11 04:57:29.136754 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:29.136699    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw" podStartSLOduration=1.136651956 podStartE2EDuration="1.136651956s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:57:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:57:29.133631381 +0000 UTC m=+1038.786891087" watchObservedRunningTime="2026-09-11 04:57:29.136651956 +0000 UTC m=+1038.789911637"
Sep 11 04:57:29.152346 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:29.152281    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x" podStartSLOduration=1.152265838 podStartE2EDuration="1.152265838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:57:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:57:29.150974849 +0000 UTC m=+1038.804234539" watchObservedRunningTime="2026-09-11 04:57:29.152265838 +0000 UTC m=+1038.805525517"
Sep 11 04:57:32.911842 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:32.911808    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:57:40.129322 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:40.129286    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw"
Sep 11 04:57:40.129723 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:40.129392    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x"
Sep 11 04:57:51.382893 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:51.382862    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz"]
Sep 11 04:57:51.385576 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:51.385558    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz"
Sep 11 04:57:51.388182 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:51.388157    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-f5e6f7-dockercfg-wdsrt\""
Sep 11 04:57:51.388586 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:51.388567    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-f5e6f7\""
Sep 11 04:57:51.395938 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:51.395912    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz"]
Sep 11 04:57:51.538177 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:51.538132    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7vwf\" (UniqueName: \"kubernetes.io/projected/98d8cbc8-7949-41af-b9c8-e1fd0a2d8699-kube-api-access-g7vwf\") pod \"payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz\" (UID: \"98d8cbc8-7949-41af-b9c8-e1fd0a2d8699\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz"
Sep 11 04:57:51.538409 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:51.538197    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98d8cbc8-7949-41af-b9c8-e1fd0a2d8699-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz\" (UID: \"98d8cbc8-7949-41af-b9c8-e1fd0a2d8699\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz"
Sep 11 04:57:51.638766 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:51.638664    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7vwf\" (UniqueName: \"kubernetes.io/projected/98d8cbc8-7949-41af-b9c8-e1fd0a2d8699-kube-api-access-g7vwf\") pod \"payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz\" (UID: \"98d8cbc8-7949-41af-b9c8-e1fd0a2d8699\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz"
Sep 11 04:57:51.638766 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:51.638719    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98d8cbc8-7949-41af-b9c8-e1fd0a2d8699-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz\" (UID: \"98d8cbc8-7949-41af-b9c8-e1fd0a2d8699\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz"
Sep 11 04:57:51.639415 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:51.639393    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98d8cbc8-7949-41af-b9c8-e1fd0a2d8699-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz\" (UID: \"98d8cbc8-7949-41af-b9c8-e1fd0a2d8699\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz"
Sep 11 04:57:51.647115 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:51.647082    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7vwf\" (UniqueName: \"kubernetes.io/projected/98d8cbc8-7949-41af-b9c8-e1fd0a2d8699-kube-api-access-g7vwf\") pod \"payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz\" (UID: \"98d8cbc8-7949-41af-b9c8-e1fd0a2d8699\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz"
Sep 11 04:57:51.697491 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:51.697454    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz"
Sep 11 04:57:51.983114 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:51.983089    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz"]
Sep 11 04:57:51.985388 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:57:51.985361    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98d8cbc8_7949_41af_b9c8_e1fd0a2d8699.slice/crio-07915d8620f8858514c1c4dc1271936d97b5899b9c8920849037ba6dac22363c WatchSource:0}: Error finding container 07915d8620f8858514c1c4dc1271936d97b5899b9c8920849037ba6dac22363c: Status 404 returned error can't find the container with id 07915d8620f8858514c1c4dc1271936d97b5899b9c8920849037ba6dac22363c
Sep 11 04:57:52.258447 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:52.258354    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz" event={"ID":"98d8cbc8-7949-41af-b9c8-e1fd0a2d8699","Type":"ContainerStarted","Data":"905085e1e5e67c2d81f86b23dd3f09b81b3cbaf77d5262906f19a3756c0d1c49"}
Sep 11 04:57:52.258447 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:52.258405    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz" event={"ID":"98d8cbc8-7949-41af-b9c8-e1fd0a2d8699","Type":"ContainerStarted","Data":"07915d8620f8858514c1c4dc1271936d97b5899b9c8920849037ba6dac22363c"}
Sep 11 04:57:52.258447 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:52.258444    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz"
Sep 11 04:57:52.274704 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:52.274653    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz" podStartSLOduration=1.274637549 podStartE2EDuration="1.274637549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:57:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:57:52.272938404 +0000 UTC m=+1061.926198084" watchObservedRunningTime="2026-09-11 04:57:52.274637549 +0000 UTC m=+1061.927897228"
Sep 11 04:57:56.007049 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:57:56.007011    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:58:03.266597 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:03.266521    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz"
Sep 11 04:58:19.554599 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:19.554564    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl"]
Sep 11 04:58:19.559622 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:19.559598    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl"
Sep 11 04:58:19.562080 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:19.562058    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-f81bf2\""
Sep 11 04:58:19.562218 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:19.562205    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-f81bf2-dockercfg-trsv5\""
Sep 11 04:58:19.570666 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:19.570642    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl"]
Sep 11 04:58:19.607955 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:19.607919    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9135b9fc-a163-485e-b413-1e8abdd6c5c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl\" (UID: \"9135b9fc-a163-485e-b413-1e8abdd6c5c0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl"
Sep 11 04:58:19.608139 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:19.608072    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qln9b\" (UniqueName: \"kubernetes.io/projected/9135b9fc-a163-485e-b413-1e8abdd6c5c0-kube-api-access-qln9b\") pod \"payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl\" (UID: \"9135b9fc-a163-485e-b413-1e8abdd6c5c0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl"
Sep 11 04:58:19.709363 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:19.709300    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9135b9fc-a163-485e-b413-1e8abdd6c5c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl\" (UID: \"9135b9fc-a163-485e-b413-1e8abdd6c5c0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl"
Sep 11 04:58:19.709546 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:19.709437    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qln9b\" (UniqueName: \"kubernetes.io/projected/9135b9fc-a163-485e-b413-1e8abdd6c5c0-kube-api-access-qln9b\") pod \"payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl\" (UID: \"9135b9fc-a163-485e-b413-1e8abdd6c5c0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl"
Sep 11 04:58:19.710044 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:19.710023    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9135b9fc-a163-485e-b413-1e8abdd6c5c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl\" (UID: \"9135b9fc-a163-485e-b413-1e8abdd6c5c0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl"
Sep 11 04:58:19.719102 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:19.719067    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qln9b\" (UniqueName: \"kubernetes.io/projected/9135b9fc-a163-485e-b413-1e8abdd6c5c0-kube-api-access-qln9b\") pod \"payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl\" (UID: \"9135b9fc-a163-485e-b413-1e8abdd6c5c0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl"
Sep 11 04:58:19.870617 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:19.870526    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl"
Sep 11 04:58:20.145260 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:20.145231    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl"]
Sep 11 04:58:20.147314 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:58:20.147286    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9135b9fc_a163_485e_b413_1e8abdd6c5c0.slice/crio-32286f0ca91a13b5073bc45a68ac738c774bf8877788f911bd4fd333541f4e47 WatchSource:0}: Error finding container 32286f0ca91a13b5073bc45a68ac738c774bf8877788f911bd4fd333541f4e47: Status 404 returned error can't find the container with id 32286f0ca91a13b5073bc45a68ac738c774bf8877788f911bd4fd333541f4e47
Sep 11 04:58:20.417739 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:20.417707    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl" event={"ID":"9135b9fc-a163-485e-b413-1e8abdd6c5c0","Type":"ContainerStarted","Data":"bf6f65647f0fe678e540b7754b384dfd7af0f4b527ad778614c56ed6077a1711"}
Sep 11 04:58:20.417936 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:20.417758    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl" event={"ID":"9135b9fc-a163-485e-b413-1e8abdd6c5c0","Type":"ContainerStarted","Data":"32286f0ca91a13b5073bc45a68ac738c774bf8877788f911bd4fd333541f4e47"}
Sep 11 04:58:20.417936 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:20.417787    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl"
Sep 11 04:58:20.435392 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:20.435304    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl" podStartSLOduration=1.435279685 podStartE2EDuration="1.435279685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:58:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:58:20.432320635 +0000 UTC m=+1090.085580329" watchObservedRunningTime="2026-09-11 04:58:20.435279685 +0000 UTC m=+1090.088539369"
Sep 11 04:58:24.499070 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:24.499033    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:58:31.425539 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:31.425503    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl"
Sep 11 04:58:35.128355 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:35.127743    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:58:52.515902 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.515860    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"]
Sep 11 04:58:52.520609 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.520581    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.525808 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.525785    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-89e681d0-openshift-default-dockercfg-jjq8p\""
Sep 11 04:58:52.530208 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.530180    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-podinfo\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.530208 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.530222    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-credential-socket\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.530508 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.530294    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-data\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.530508 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.530341    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-workload-socket\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.530508 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.530481    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-token\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.530715 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.530511    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-envoy\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.530715 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.530558    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdvbj\" (UniqueName: \"kubernetes.io/projected/58720041-5fb3-4f24-95a7-40947e5de0ff-kube-api-access-qdvbj\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.530715 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.530594    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-workload-certs\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.530715 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.530692    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58720041-5fb3-4f24-95a7-40947e5de0ff-istiod-ca-cert\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.534376 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.534350    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"]
Sep 11 04:58:52.631569 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.631530    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-podinfo\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.631569 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.631567    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-credential-socket\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.631838 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.631591    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-data\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.631838 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.631682    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-workload-socket\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.631838 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.631752    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-token\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.631838 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.631775    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-envoy\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.631838 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.631814    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdvbj\" (UniqueName: \"kubernetes.io/projected/58720041-5fb3-4f24-95a7-40947e5de0ff-kube-api-access-qdvbj\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.632124 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.631849    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-workload-certs\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.632124 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.631893    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58720041-5fb3-4f24-95a7-40947e5de0ff-istiod-ca-cert\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.632124 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.631962    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-data\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.632124 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.632099    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-workload-socket\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.632370 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.632207    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-workload-certs\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.632370 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.632267    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-credential-socket\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.632588 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.632568    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58720041-5fb3-4f24-95a7-40947e5de0ff-istiod-ca-cert\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.634219 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.634196    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-envoy\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.634308 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.634263    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-podinfo\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.640161 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.640131    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdvbj\" (UniqueName: \"kubernetes.io/projected/58720041-5fb3-4f24-95a7-40947e5de0ff-kube-api-access-qdvbj\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.640474 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.640454    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-token\") pod \"e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") " pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:52.832277 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:52.832180    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:53.114904 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:53.114870    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"]
Sep 11 04:58:53.116919 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:58:53.116891    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58720041_5fb3_4f24_95a7_40947e5de0ff.slice/crio-d43673c969ad1af866dc57ab34fe1e410f0751cf804aa419cbddb025169d9f42 WatchSource:0}: Error finding container d43673c969ad1af866dc57ab34fe1e410f0751cf804aa419cbddb025169d9f42: Status 404 returned error can't find the container with id d43673c969ad1af866dc57ab34fe1e410f0751cf804aa419cbddb025169d9f42
Sep 11 04:58:53.119624 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:53.119588    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:58:53.119732 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:53.119673    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:58:53.119732 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:53.119719    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:58:53.602739 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:53.602697    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn" event={"ID":"58720041-5fb3-4f24-95a7-40947e5de0ff","Type":"ContainerStarted","Data":"849d0a409fd9943061848bd1ee25ff29c342c98f5882e2186296e6997b6fb6c6"}
Sep 11 04:58:53.603136 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:53.602771    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn" event={"ID":"58720041-5fb3-4f24-95a7-40947e5de0ff","Type":"ContainerStarted","Data":"d43673c969ad1af866dc57ab34fe1e410f0751cf804aa419cbddb025169d9f42"}
Sep 11 04:58:53.623987 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:53.623933    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn" podStartSLOduration=1.623915937 podStartE2EDuration="1.623915937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:58:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:58:53.621495886 +0000 UTC m=+1123.274755568" watchObservedRunningTime="2026-09-11 04:58:53.623915937 +0000 UTC m=+1123.277175616"
Sep 11 04:58:53.832652 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:53.832623    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:54.838773 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:54.838737    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:55.614495 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:55.614461    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:55.615367 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:55.615312    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:58:56.674000 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:56.673967    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"]
Sep 11 04:58:56.677589 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:56.677569    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"
Sep 11 04:58:56.681607 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:56.681581    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-89e681d0-serving-cert\""
Sep 11 04:58:56.681767 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:56.681590    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-74gzc\""
Sep 11 04:58:56.703211 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:56.703175    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"]
Sep 11 04:58:56.767952 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:56.767901    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7842ce3-9b1d-478d-ab77-3877f8d1b070-openshift-service-ca\") pod \"maas-api-e2e-mt-89e681d0-84bcc95b75-68szh\" (UID: \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"
Sep 11 04:58:56.768156 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:56.767963    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7842ce3-9b1d-478d-ab77-3877f8d1b070-maas-api-tls\") pod \"maas-api-e2e-mt-89e681d0-84bcc95b75-68szh\" (UID: \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"
Sep 11 04:58:56.768156 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:56.767991    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7842ce3-9b1d-478d-ab77-3877f8d1b070-metrics-certs\") pod \"maas-api-e2e-mt-89e681d0-84bcc95b75-68szh\" (UID: \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"
Sep 11 04:58:56.768156 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:56.768055    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtz94\" (UniqueName: \"kubernetes.io/projected/a7842ce3-9b1d-478d-ab77-3877f8d1b070-kube-api-access-qtz94\") pod \"maas-api-e2e-mt-89e681d0-84bcc95b75-68szh\" (UID: \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"
Sep 11 04:58:56.869305 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:56.869264    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7842ce3-9b1d-478d-ab77-3877f8d1b070-openshift-service-ca\") pod \"maas-api-e2e-mt-89e681d0-84bcc95b75-68szh\" (UID: \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"
Sep 11 04:58:56.869567 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:56.869362    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7842ce3-9b1d-478d-ab77-3877f8d1b070-maas-api-tls\") pod \"maas-api-e2e-mt-89e681d0-84bcc95b75-68szh\" (UID: \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"
Sep 11 04:58:56.869567 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:56.869409    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7842ce3-9b1d-478d-ab77-3877f8d1b070-metrics-certs\") pod \"maas-api-e2e-mt-89e681d0-84bcc95b75-68szh\" (UID: \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"
Sep 11 04:58:56.869567 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:56.869440    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtz94\" (UniqueName: \"kubernetes.io/projected/a7842ce3-9b1d-478d-ab77-3877f8d1b070-kube-api-access-qtz94\") pod \"maas-api-e2e-mt-89e681d0-84bcc95b75-68szh\" (UID: \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"
Sep 11 04:58:56.870146 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:56.870119    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7842ce3-9b1d-478d-ab77-3877f8d1b070-openshift-service-ca\") pod \"maas-api-e2e-mt-89e681d0-84bcc95b75-68szh\" (UID: \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"
Sep 11 04:58:56.872199 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:56.872179    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7842ce3-9b1d-478d-ab77-3877f8d1b070-metrics-certs\") pod \"maas-api-e2e-mt-89e681d0-84bcc95b75-68szh\" (UID: \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"
Sep 11 04:58:56.872363 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:56.872322    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7842ce3-9b1d-478d-ab77-3877f8d1b070-maas-api-tls\") pod \"maas-api-e2e-mt-89e681d0-84bcc95b75-68szh\" (UID: \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"
Sep 11 04:58:56.882871 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:56.882846    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtz94\" (UniqueName: \"kubernetes.io/projected/a7842ce3-9b1d-478d-ab77-3877f8d1b070-kube-api-access-qtz94\") pod \"maas-api-e2e-mt-89e681d0-84bcc95b75-68szh\" (UID: \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"
Sep 11 04:58:56.989861 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:56.989770    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"
Sep 11 04:58:57.266245 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:57.266219    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"]
Sep 11 04:58:57.268270 ip-10-0-143-244 kubenswrapper[2554]: W0911 04:58:57.268242    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7842ce3_9b1d_478d_ab77_3877f8d1b070.slice/crio-1110ecc3c0b839ee07470a39effde935c19b060a03a7dcb2fec96497346ca02d WatchSource:0}: Error finding container 1110ecc3c0b839ee07470a39effde935c19b060a03a7dcb2fec96497346ca02d: Status 404 returned error can't find the container with id 1110ecc3c0b839ee07470a39effde935c19b060a03a7dcb2fec96497346ca02d
Sep 11 04:58:57.269696 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:57.269680    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 04:58:57.626903 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:57.626815    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh" event={"ID":"a7842ce3-9b1d-478d-ab77-3877f8d1b070","Type":"ContainerStarted","Data":"1110ecc3c0b839ee07470a39effde935c19b060a03a7dcb2fec96497346ca02d"}
Sep 11 04:58:58.633995 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:58.633956    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh" event={"ID":"a7842ce3-9b1d-478d-ab77-3877f8d1b070","Type":"ContainerStarted","Data":"8d2ba94496b261c2d47ae055f5878996382254c921d9518ebdd2071dda99ae43"}
Sep 11 04:58:58.634521 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:58.634062    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"
Sep 11 04:58:58.657607 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:58:58.657552    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh" podStartSLOduration=2.149411168 podStartE2EDuration="2.657533303s" totalImagesPullingTime="508.122135ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 04:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 04:58:58.655064298 +0000 UTC m=+1128.308323991" watchObservedRunningTime="2026-09-11 04:58:58.657533303 +0000 UTC m=+1128.310792983"
Sep 11 04:59:04.645439 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:04.645409    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"
Sep 11 04:59:06.311483 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:06.311442    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:59:16.748134 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:16.748093    2554 generic.go:356] "Generic (PLEG): container finished" podID="58720041-5fb3-4f24-95a7-40947e5de0ff" containerID="849d0a409fd9943061848bd1ee25ff29c342c98f5882e2186296e6997b6fb6c6" exitCode=0
Sep 11 04:59:16.748612 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:16.748167    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn" event={"ID":"58720041-5fb3-4f24-95a7-40947e5de0ff","Type":"ContainerDied","Data":"849d0a409fd9943061848bd1ee25ff29c342c98f5882e2186296e6997b6fb6c6"}
Sep 11 04:59:16.748687 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:16.748673    2554 scope.go:117] "RemoveContainer" containerID="849d0a409fd9943061848bd1ee25ff29c342c98f5882e2186296e6997b6fb6c6"
Sep 11 04:59:16.749853 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:16.749822    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:59:16.749981 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:16.749906    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:59:16.749981 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:16.749952    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 04:59:17.756120 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:17.756085    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn" event={"ID":"58720041-5fb3-4f24-95a7-40947e5de0ff","Type":"ContainerStarted","Data":"79428b0775af5126d34eb152a65801c8127325f87e78a08cb9b7c31645cfa93d"}
Sep 11 04:59:17.832410 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:17.832358    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:59:17.832630 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:17.832609    2554 patch_prober.go:28] interesting pod/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 11 04:59:17.832682 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:17.832657    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn" podUID="58720041-5fb3-4f24-95a7-40947e5de0ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 11 04:59:18.833039 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:18.833001    2554 patch_prober.go:28] interesting pod/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 11 04:59:18.833490 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:18.833060    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn" podUID="58720041-5fb3-4f24-95a7-40947e5de0ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 11 04:59:19.833094 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:19.833054    2554 patch_prober.go:28] interesting pod/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 11 04:59:19.833527 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:19.833146    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn" podUID="58720041-5fb3-4f24-95a7-40947e5de0ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 11 04:59:20.833280 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:20.833246    2554 patch_prober.go:28] interesting pod/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 11 04:59:20.833691 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:20.833309    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn" podUID="58720041-5fb3-4f24-95a7-40947e5de0ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 11 04:59:21.832783 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:21.832742    2554 patch_prober.go:28] interesting pod/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 11 04:59:21.832967 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:21.832808    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn" podUID="58720041-5fb3-4f24-95a7-40947e5de0ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 11 04:59:22.614024 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:22.613967    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:59:22.833213 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:22.833175    2554 patch_prober.go:28] interesting pod/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 11 04:59:22.833416 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:22.833232    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn" podUID="58720041-5fb3-4f24-95a7-40947e5de0ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 11 04:59:23.836856 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:23.836824    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:59:23.837362 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:23.837220    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:59:23.837885 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:23.837869    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 04:59:37.902242 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:37.902157    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 04:59:53.318234 ip-10-0-143-244 kubenswrapper[2554]: I0911 04:59:53.318192    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:00:00.158394 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:00.158351    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f5e6f7-29818380-nk62q"]
Sep 11 05:00:00.162430 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:00.162405    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f5e6f7-29818380-nk62q"
Sep 11 05:00:00.165030 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:00.165001    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vl9kf\""
Sep 11 05:00:00.174161 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:00.174134    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f5e6f7-29818380-nk62q"
Sep 11 05:00:00.176906 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:00.176846    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f5e6f7-29818380-nk62q"]
Sep 11 05:00:00.179593 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:00.179570    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-16b799-29818380-l26xs"]
Sep 11 05:00:00.183705 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:00.183682    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-16b799-29818380-l26xs"
Sep 11 05:00:00.196897 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:00.196866    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-16b799-29818380-l26xs"]
Sep 11 05:00:00.223705 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:00.223681    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-16b799-29818380-l26xs"
Sep 11 05:00:00.471244 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:00.471220    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f5e6f7-29818380-nk62q"]
Sep 11 05:00:00.473572 ip-10-0-143-244 kubenswrapper[2554]: W0911 05:00:00.473545    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefee0304_c88b_4ed5_9d3e_9be2433d9c27.slice/crio-d1f26c35ec26fba0e04943d53d287ee3e78a069e1bdc234a5d5a70acfc377c05 WatchSource:0}: Error finding container d1f26c35ec26fba0e04943d53d287ee3e78a069e1bdc234a5d5a70acfc377c05: Status 404 returned error can't find the container with id d1f26c35ec26fba0e04943d53d287ee3e78a069e1bdc234a5d5a70acfc377c05
Sep 11 05:00:00.509690 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:00.509660    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-16b799-29818380-l26xs"]
Sep 11 05:00:00.511439 ip-10-0-143-244 kubenswrapper[2554]: W0911 05:00:00.511400    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8819c073_a3a3_4ca0_977b_815a65159f52.slice/crio-da8a95aea622e78b9740e7e9d559b87dbb5517ad00842408183ce546889cc10a WatchSource:0}: Error finding container da8a95aea622e78b9740e7e9d559b87dbb5517ad00842408183ce546889cc10a: Status 404 returned error can't find the container with id da8a95aea622e78b9740e7e9d559b87dbb5517ad00842408183ce546889cc10a
Sep 11 05:00:01.002132 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:01.002092    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-16b799-29818380-l26xs" event={"ID":"8819c073-a3a3-4ca0-977b-815a65159f52","Type":"ContainerStarted","Data":"da8a95aea622e78b9740e7e9d559b87dbb5517ad00842408183ce546889cc10a"}
Sep 11 05:00:01.003470 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:01.003441    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f5e6f7-29818380-nk62q" event={"ID":"efee0304-c88b-4ed5-9d3e-9be2433d9c27","Type":"ContainerStarted","Data":"d1f26c35ec26fba0e04943d53d287ee3e78a069e1bdc234a5d5a70acfc377c05"}
Sep 11 05:00:04.024853 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:04.024816    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f5e6f7-29818380-nk62q" event={"ID":"efee0304-c88b-4ed5-9d3e-9be2433d9c27","Type":"ContainerStarted","Data":"0c6f4c478fcbf581b399e432a9400aa99fb9ac55d99f57c14654550f8b9cc545"}
Sep 11 05:00:04.026485 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:04.026457    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-16b799-29818380-l26xs" event={"ID":"8819c073-a3a3-4ca0-977b-815a65159f52","Type":"ContainerStarted","Data":"f18ab919ffa046ba7e41e1de30e9dc959dd60812d1f2d44ebf7ce43892dd441d"}
Sep 11 05:00:04.042531 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:04.042193    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f5e6f7-29818380-nk62q" podStartSLOduration=1.466695705 podStartE2EDuration="4.042151009s" totalImagesPullingTime="2.575455304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:00:04.041558166 +0000 UTC m=+1193.694817852" watchObservedRunningTime="2026-09-11 05:00:04.042151009 +0000 UTC m=+1193.695410690"
Sep 11 05:00:04.059008 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:04.058956    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-16b799-29818380-l26xs" podStartSLOduration=1.516172789 podStartE2EDuration="4.058938005s" totalImagesPullingTime="2.542765216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:00:04.055873232 +0000 UTC m=+1193.709132913" watchObservedRunningTime="2026-09-11 05:00:04.058938005 +0000 UTC m=+1193.712197685"
Sep 11 05:00:05.033924 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:05.033887    2554 generic.go:356] "Generic (PLEG): container finished" podID="efee0304-c88b-4ed5-9d3e-9be2433d9c27" containerID="0c6f4c478fcbf581b399e432a9400aa99fb9ac55d99f57c14654550f8b9cc545" exitCode=0
Sep 11 05:00:05.034358 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:05.033976    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f5e6f7-29818380-nk62q" event={"ID":"efee0304-c88b-4ed5-9d3e-9be2433d9c27","Type":"ContainerDied","Data":"0c6f4c478fcbf581b399e432a9400aa99fb9ac55d99f57c14654550f8b9cc545"}
Sep 11 05:00:05.035561 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:05.035532    2554 generic.go:356] "Generic (PLEG): container finished" podID="8819c073-a3a3-4ca0-977b-815a65159f52" containerID="f18ab919ffa046ba7e41e1de30e9dc959dd60812d1f2d44ebf7ce43892dd441d" exitCode=0
Sep 11 05:00:05.035637 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:05.035616    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-16b799-29818380-l26xs" event={"ID":"8819c073-a3a3-4ca0-977b-815a65159f52","Type":"ContainerDied","Data":"f18ab919ffa046ba7e41e1de30e9dc959dd60812d1f2d44ebf7ce43892dd441d"}
Sep 11 05:00:06.197643 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:06.197553    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f5e6f7-29818380-nk62q"
Sep 11 05:00:06.225053 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:06.225019    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-16b799-29818380-l26xs"
Sep 11 05:00:07.055345 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:07.055307    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f5e6f7-29818380-nk62q"
Sep 11 05:00:07.055345 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:07.055318    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f5e6f7-29818380-nk62q" event={"ID":"efee0304-c88b-4ed5-9d3e-9be2433d9c27","Type":"ContainerDied","Data":"d1f26c35ec26fba0e04943d53d287ee3e78a069e1bdc234a5d5a70acfc377c05"}
Sep 11 05:00:07.055571 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:07.055418    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1f26c35ec26fba0e04943d53d287ee3e78a069e1bdc234a5d5a70acfc377c05"
Sep 11 05:00:07.056801 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:07.056782    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-16b799-29818380-l26xs"
Sep 11 05:00:07.056948 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:07.056780    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-16b799-29818380-l26xs" event={"ID":"8819c073-a3a3-4ca0-977b-815a65159f52","Type":"ContainerDied","Data":"da8a95aea622e78b9740e7e9d559b87dbb5517ad00842408183ce546889cc10a"}
Sep 11 05:00:07.056948 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:07.056925    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da8a95aea622e78b9740e7e9d559b87dbb5517ad00842408183ce546889cc10a"
Sep 11 05:00:10.714897 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:10.714856    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:00:27.303270 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:27.303237    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:00:30.465938 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:30.465885    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"]
Sep 11 05:00:30.466465 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:30.466181    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh" podUID="a7842ce3-9b1d-478d-ab77-3877f8d1b070" containerName="maas-api" containerID="cri-o://8d2ba94496b261c2d47ae055f5878996382254c921d9518ebdd2071dda99ae43" gracePeriod=30
Sep 11 05:00:30.739952 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:30.739921    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"
Sep 11 05:00:30.830606 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:30.830575    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7842ce3-9b1d-478d-ab77-3877f8d1b070-metrics-certs\") pod \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\" (UID: \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\") "
Sep 11 05:00:30.830773 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:30.830614    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtz94\" (UniqueName: \"kubernetes.io/projected/a7842ce3-9b1d-478d-ab77-3877f8d1b070-kube-api-access-qtz94\") pod \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\" (UID: \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\") "
Sep 11 05:00:30.830773 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:30.830648    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7842ce3-9b1d-478d-ab77-3877f8d1b070-openshift-service-ca\") pod \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\" (UID: \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\") "
Sep 11 05:00:30.830773 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:30.830740    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7842ce3-9b1d-478d-ab77-3877f8d1b070-maas-api-tls\") pod \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\" (UID: \"a7842ce3-9b1d-478d-ab77-3877f8d1b070\") "
Sep 11 05:00:30.831135 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:30.831102    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7842ce3-9b1d-478d-ab77-3877f8d1b070-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a7842ce3-9b1d-478d-ab77-3877f8d1b070" (UID: "a7842ce3-9b1d-478d-ab77-3877f8d1b070"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 05:00:30.832994 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:30.832964    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7842ce3-9b1d-478d-ab77-3877f8d1b070-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a7842ce3-9b1d-478d-ab77-3877f8d1b070" (UID: "a7842ce3-9b1d-478d-ab77-3877f8d1b070"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 05:00:30.833182 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:30.833142    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7842ce3-9b1d-478d-ab77-3877f8d1b070-kube-api-access-qtz94" (OuterVolumeSpecName: "kube-api-access-qtz94") pod "a7842ce3-9b1d-478d-ab77-3877f8d1b070" (UID: "a7842ce3-9b1d-478d-ab77-3877f8d1b070"). InnerVolumeSpecName "kube-api-access-qtz94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:00:30.833464 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:30.833442    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7842ce3-9b1d-478d-ab77-3877f8d1b070-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a7842ce3-9b1d-478d-ab77-3877f8d1b070" (UID: "a7842ce3-9b1d-478d-ab77-3877f8d1b070"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 05:00:30.932283 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:30.932246    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7842ce3-9b1d-478d-ab77-3877f8d1b070-maas-api-tls\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:00:30.932283 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:30.932276    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7842ce3-9b1d-478d-ab77-3877f8d1b070-metrics-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:00:30.932283 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:30.932285    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtz94\" (UniqueName: \"kubernetes.io/projected/a7842ce3-9b1d-478d-ab77-3877f8d1b070-kube-api-access-qtz94\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:00:30.932283 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:30.932293    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7842ce3-9b1d-478d-ab77-3877f8d1b070-openshift-service-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:00:31.202508 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:31.202473    2554 generic.go:356] "Generic (PLEG): container finished" podID="a7842ce3-9b1d-478d-ab77-3877f8d1b070" containerID="8d2ba94496b261c2d47ae055f5878996382254c921d9518ebdd2071dda99ae43" exitCode=0
Sep 11 05:00:31.202700 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:31.202520    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"
Sep 11 05:00:31.202700 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:31.202565    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh" event={"ID":"a7842ce3-9b1d-478d-ab77-3877f8d1b070","Type":"ContainerDied","Data":"8d2ba94496b261c2d47ae055f5878996382254c921d9518ebdd2071dda99ae43"}
Sep 11 05:00:31.202700 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:31.202614    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh" event={"ID":"a7842ce3-9b1d-478d-ab77-3877f8d1b070","Type":"ContainerDied","Data":"1110ecc3c0b839ee07470a39effde935c19b060a03a7dcb2fec96497346ca02d"}
Sep 11 05:00:31.202700 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:31.202636    2554 scope.go:117] "RemoveContainer" containerID="8d2ba94496b261c2d47ae055f5878996382254c921d9518ebdd2071dda99ae43"
Sep 11 05:00:31.212559 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:31.212535    2554 scope.go:117] "RemoveContainer" containerID="8d2ba94496b261c2d47ae055f5878996382254c921d9518ebdd2071dda99ae43"
Sep 11 05:00:31.212964 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:00:31.212941    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d2ba94496b261c2d47ae055f5878996382254c921d9518ebdd2071dda99ae43\": container with ID starting with 8d2ba94496b261c2d47ae055f5878996382254c921d9518ebdd2071dda99ae43 not found: ID does not exist" containerID="8d2ba94496b261c2d47ae055f5878996382254c921d9518ebdd2071dda99ae43"
Sep 11 05:00:31.213037 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:31.212976    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d2ba94496b261c2d47ae055f5878996382254c921d9518ebdd2071dda99ae43"} err="failed to get container status \"8d2ba94496b261c2d47ae055f5878996382254c921d9518ebdd2071dda99ae43\": rpc error: code = NotFound desc = could not find container \"8d2ba94496b261c2d47ae055f5878996382254c921d9518ebdd2071dda99ae43\": container with ID starting with 8d2ba94496b261c2d47ae055f5878996382254c921d9518ebdd2071dda99ae43 not found: ID does not exist"
Sep 11 05:00:31.223581 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:31.223552    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"]
Sep 11 05:00:31.231066 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:31.231039    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89e681d0-84bcc95b75-68szh"]
Sep 11 05:00:32.813925 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:32.813890    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7842ce3-9b1d-478d-ab77-3877f8d1b070" path="/var/lib/kubelet/pods/a7842ce3-9b1d-478d-ab77-3877f8d1b070/volumes"
Sep 11 05:00:45.202252 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:45.202212    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:00:52.564082 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:52.564044    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7518-636775"]
Sep 11 05:00:52.564542 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:52.564528    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7842ce3-9b1d-478d-ab77-3877f8d1b070" containerName="maas-api"
Sep 11 05:00:52.564542 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:52.564543    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7842ce3-9b1d-478d-ab77-3877f8d1b070" containerName="maas-api"
Sep 11 05:00:52.564627 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:52.564552    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8819c073-a3a3-4ca0-977b-815a65159f52" containerName="cleanup"
Sep 11 05:00:52.564627 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:52.564557    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8819c073-a3a3-4ca0-977b-815a65159f52" containerName="cleanup"
Sep 11 05:00:52.564627 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:52.564564    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efee0304-c88b-4ed5-9d3e-9be2433d9c27" containerName="cleanup"
Sep 11 05:00:52.564627 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:52.564570    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="efee0304-c88b-4ed5-9d3e-9be2433d9c27" containerName="cleanup"
Sep 11 05:00:52.564754 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:52.564652    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="efee0304-c88b-4ed5-9d3e-9be2433d9c27" containerName="cleanup"
Sep 11 05:00:52.564754 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:52.564664    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7842ce3-9b1d-478d-ab77-3877f8d1b070" containerName="maas-api"
Sep 11 05:00:52.564754 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:52.564671    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8819c073-a3a3-4ca0-977b-815a65159f52" containerName="cleanup"
Sep 11 05:00:52.567953 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:52.567937    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7518-636775"
Sep 11 05:00:52.570248 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:52.570230    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mgwvk\""
Sep 11 05:00:52.574069 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:52.574046    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7518-636775"]
Sep 11 05:00:52.650226 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:52.650173    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5scdf\" (UniqueName: \"kubernetes.io/projected/62859b43-a5e3-4824-88b7-70a801d88f7e-kube-api-access-5scdf\") pod \"test-curl-7518-636775\" (UID: \"62859b43-a5e3-4824-88b7-70a801d88f7e\") " pod="opendatahub/test-curl-7518-636775"
Sep 11 05:00:52.751166 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:52.751119    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5scdf\" (UniqueName: \"kubernetes.io/projected/62859b43-a5e3-4824-88b7-70a801d88f7e-kube-api-access-5scdf\") pod \"test-curl-7518-636775\" (UID: \"62859b43-a5e3-4824-88b7-70a801d88f7e\") " pod="opendatahub/test-curl-7518-636775"
Sep 11 05:00:52.759653 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:52.759625    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5scdf\" (UniqueName: \"kubernetes.io/projected/62859b43-a5e3-4824-88b7-70a801d88f7e-kube-api-access-5scdf\") pod \"test-curl-7518-636775\" (UID: \"62859b43-a5e3-4824-88b7-70a801d88f7e\") " pod="opendatahub/test-curl-7518-636775"
Sep 11 05:00:52.878809 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:52.878718    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7518-636775"
Sep 11 05:00:53.150876 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:53.150847    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7518-636775"]
Sep 11 05:00:53.152495 ip-10-0-143-244 kubenswrapper[2554]: W0911 05:00:53.152468    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62859b43_a5e3_4824_88b7_70a801d88f7e.slice/crio-a9cdc32cfe7b7f8a9af697233881b9b7b16fc604ead2afdf2958595e6bf41fef WatchSource:0}: Error finding container a9cdc32cfe7b7f8a9af697233881b9b7b16fc604ead2afdf2958595e6bf41fef: Status 404 returned error can't find the container with id a9cdc32cfe7b7f8a9af697233881b9b7b16fc604ead2afdf2958595e6bf41fef
Sep 11 05:00:53.323864 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:53.323829    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7518-636775" event={"ID":"62859b43-a5e3-4824-88b7-70a801d88f7e","Type":"ContainerStarted","Data":"309def8d0ef9be4e478de5422fbe2372c54bc735720c160e223592976c5b1b90"}
Sep 11 05:00:53.324064 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:53.323874    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7518-636775" event={"ID":"62859b43-a5e3-4824-88b7-70a801d88f7e","Type":"ContainerStarted","Data":"a9cdc32cfe7b7f8a9af697233881b9b7b16fc604ead2afdf2958595e6bf41fef"}
Sep 11 05:00:53.340181 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:53.340133    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7518-636775" podStartSLOduration=1.340116198 podStartE2EDuration="1.340116198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:00:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:00:53.338121399 +0000 UTC m=+1242.991381079" watchObservedRunningTime="2026-09-11 05:00:53.340116198 +0000 UTC m=+1242.993375894"
Sep 11 05:00:53.929916 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:53.929883    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7518-636775"]
Sep 11 05:00:53.938672 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:53.938643    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7518-636775"]
Sep 11 05:00:54.330351 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:00:54.330258    2554 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7518-636775" container="test-curl-7518-636775"
Sep 11 05:00:55.335422 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:55.335383    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7518-636775" podUID="62859b43-a5e3-4824-88b7-70a801d88f7e" containerName="test-curl-7518-636775" containerID="cri-o://309def8d0ef9be4e478de5422fbe2372c54bc735720c160e223592976c5b1b90" gracePeriod=2
Sep 11 05:00:57.537097 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:57.537074    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7518-636775"
Sep 11 05:00:57.600258 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:57.600177    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5scdf\" (UniqueName: \"kubernetes.io/projected/62859b43-a5e3-4824-88b7-70a801d88f7e-kube-api-access-5scdf\") pod \"62859b43-a5e3-4824-88b7-70a801d88f7e\" (UID: \"62859b43-a5e3-4824-88b7-70a801d88f7e\") "
Sep 11 05:00:57.602482 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:57.602450    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62859b43-a5e3-4824-88b7-70a801d88f7e-kube-api-access-5scdf" (OuterVolumeSpecName: "kube-api-access-5scdf") pod "62859b43-a5e3-4824-88b7-70a801d88f7e" (UID: "62859b43-a5e3-4824-88b7-70a801d88f7e"). InnerVolumeSpecName "kube-api-access-5scdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:00:57.701126 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:57.701080    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5scdf\" (UniqueName: \"kubernetes.io/projected/62859b43-a5e3-4824-88b7-70a801d88f7e-kube-api-access-5scdf\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:00:58.353719 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:58.353683    2554 generic.go:356] "Generic (PLEG): container finished" podID="62859b43-a5e3-4824-88b7-70a801d88f7e" containerID="309def8d0ef9be4e478de5422fbe2372c54bc735720c160e223592976c5b1b90" exitCode=137
Sep 11 05:00:58.353906 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:58.353725    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7518-636775"
Sep 11 05:00:58.353906 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:58.353745    2554 scope.go:117] "RemoveContainer" containerID="309def8d0ef9be4e478de5422fbe2372c54bc735720c160e223592976c5b1b90"
Sep 11 05:00:58.362948 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:58.362923    2554 scope.go:117] "RemoveContainer" containerID="309def8d0ef9be4e478de5422fbe2372c54bc735720c160e223592976c5b1b90"
Sep 11 05:00:58.363227 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:00:58.363208    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"309def8d0ef9be4e478de5422fbe2372c54bc735720c160e223592976c5b1b90\": container with ID starting with 309def8d0ef9be4e478de5422fbe2372c54bc735720c160e223592976c5b1b90 not found: ID does not exist" containerID="309def8d0ef9be4e478de5422fbe2372c54bc735720c160e223592976c5b1b90"
Sep 11 05:00:58.363267 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:58.363236    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"309def8d0ef9be4e478de5422fbe2372c54bc735720c160e223592976c5b1b90"} err="failed to get container status \"309def8d0ef9be4e478de5422fbe2372c54bc735720c160e223592976c5b1b90\": rpc error: code = NotFound desc = could not find container \"309def8d0ef9be4e478de5422fbe2372c54bc735720c160e223592976c5b1b90\": container with ID starting with 309def8d0ef9be4e478de5422fbe2372c54bc735720c160e223592976c5b1b90 not found: ID does not exist"
Sep 11 05:00:58.363686 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:00:58.363662    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7518-636775\" is forbidden: User \"system:node:ip-10-0-143-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-244.ec2.internal' and this object" podUID="62859b43-a5e3-4824-88b7-70a801d88f7e" pod="opendatahub/test-curl-7518-636775"
Sep 11 05:00:58.813813 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:58.813776    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62859b43-a5e3-4824-88b7-70a801d88f7e" path="/var/lib/kubelet/pods/62859b43-a5e3-4824-88b7-70a801d88f7e/volumes"
Sep 11 05:00:59.317879 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:00:59.317843    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:01:22.283114 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:22.283074    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"]
Sep 11 05:01:22.283665 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:22.283309    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn" podUID="58720041-5fb3-4f24-95a7-40947e5de0ff" containerName="istio-proxy" containerID="cri-o://79428b0775af5126d34eb152a65801c8127325f87e78a08cb9b7c31645cfa93d" gracePeriod=30
Sep 11 05:01:23.839903 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:23.839866    2554 patch_prober.go:28] interesting pod/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 05:01:23.840271 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:23.839929    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn" podUID="58720041-5fb3-4f24-95a7-40947e5de0ff" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 05:01:27.211667 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.211628    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:01:27.517360 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.517248    2554 generic.go:356] "Generic (PLEG): container finished" podID="58720041-5fb3-4f24-95a7-40947e5de0ff" containerID="79428b0775af5126d34eb152a65801c8127325f87e78a08cb9b7c31645cfa93d" exitCode=0
Sep 11 05:01:27.517360 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.517304    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn" event={"ID":"58720041-5fb3-4f24-95a7-40947e5de0ff","Type":"ContainerDied","Data":"79428b0775af5126d34eb152a65801c8127325f87e78a08cb9b7c31645cfa93d"}
Sep 11 05:01:27.517572 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.517469    2554 scope.go:117] "RemoveContainer" containerID="849d0a409fd9943061848bd1ee25ff29c342c98f5882e2186296e6997b6fb6c6"
Sep 11 05:01:27.558465 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.558437    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 05:01:27.606085 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.606052    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-podinfo\") pod \"58720041-5fb3-4f24-95a7-40947e5de0ff\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") "
Sep 11 05:01:27.606290 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.606101    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-token\") pod \"58720041-5fb3-4f24-95a7-40947e5de0ff\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") "
Sep 11 05:01:27.606290 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.606136    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-workload-socket\") pod \"58720041-5fb3-4f24-95a7-40947e5de0ff\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") "
Sep 11 05:01:27.606290 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.606178    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-workload-certs\") pod \"58720041-5fb3-4f24-95a7-40947e5de0ff\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") "
Sep 11 05:01:27.606290 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.606227    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdvbj\" (UniqueName: \"kubernetes.io/projected/58720041-5fb3-4f24-95a7-40947e5de0ff-kube-api-access-qdvbj\") pod \"58720041-5fb3-4f24-95a7-40947e5de0ff\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") "
Sep 11 05:01:27.606290 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.606256    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-data\") pod \"58720041-5fb3-4f24-95a7-40947e5de0ff\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") "
Sep 11 05:01:27.606640 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.606308    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-credential-socket\") pod \"58720041-5fb3-4f24-95a7-40947e5de0ff\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") "
Sep 11 05:01:27.606640 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.606361    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-envoy\") pod \"58720041-5fb3-4f24-95a7-40947e5de0ff\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") "
Sep 11 05:01:27.606640 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.606399    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58720041-5fb3-4f24-95a7-40947e5de0ff-istiod-ca-cert\") pod \"58720041-5fb3-4f24-95a7-40947e5de0ff\" (UID: \"58720041-5fb3-4f24-95a7-40947e5de0ff\") "
Sep 11 05:01:27.606640 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.606534    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "58720041-5fb3-4f24-95a7-40947e5de0ff" (UID: "58720041-5fb3-4f24-95a7-40947e5de0ff"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:01:27.606853 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.606731    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "58720041-5fb3-4f24-95a7-40947e5de0ff" (UID: "58720041-5fb3-4f24-95a7-40947e5de0ff"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:01:27.606853 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.606803    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-workload-socket\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:01:27.606965 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.606889    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-data" (OuterVolumeSpecName: "istio-data") pod "58720041-5fb3-4f24-95a7-40947e5de0ff" (UID: "58720041-5fb3-4f24-95a7-40947e5de0ff"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:01:27.606965 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.606919    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "58720041-5fb3-4f24-95a7-40947e5de0ff" (UID: "58720041-5fb3-4f24-95a7-40947e5de0ff"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:01:27.606965 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.606932    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58720041-5fb3-4f24-95a7-40947e5de0ff-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "58720041-5fb3-4f24-95a7-40947e5de0ff" (UID: "58720041-5fb3-4f24-95a7-40947e5de0ff"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 05:01:27.608957 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.608910    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58720041-5fb3-4f24-95a7-40947e5de0ff-kube-api-access-qdvbj" (OuterVolumeSpecName: "kube-api-access-qdvbj") pod "58720041-5fb3-4f24-95a7-40947e5de0ff" (UID: "58720041-5fb3-4f24-95a7-40947e5de0ff"). InnerVolumeSpecName "kube-api-access-qdvbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:01:27.609102 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.609041    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-token" (OuterVolumeSpecName: "istio-token") pod "58720041-5fb3-4f24-95a7-40947e5de0ff" (UID: "58720041-5fb3-4f24-95a7-40947e5de0ff"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:01:27.609376 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.609352    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "58720041-5fb3-4f24-95a7-40947e5de0ff" (UID: "58720041-5fb3-4f24-95a7-40947e5de0ff"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 05:01:27.609523 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.609497    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "58720041-5fb3-4f24-95a7-40947e5de0ff" (UID: "58720041-5fb3-4f24-95a7-40947e5de0ff"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:01:27.707557 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.707516    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-workload-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:01:27.707557 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.707549    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdvbj\" (UniqueName: \"kubernetes.io/projected/58720041-5fb3-4f24-95a7-40947e5de0ff-kube-api-access-qdvbj\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:01:27.707557 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.707560    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-data\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:01:27.707557 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.707569    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-credential-socket\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:01:27.707832 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.707578    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-envoy\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:01:27.707832 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.707587    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/58720041-5fb3-4f24-95a7-40947e5de0ff-istiod-ca-cert\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:01:27.707832 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.707594    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-podinfo\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:01:27.707832 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:27.707601    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/58720041-5fb3-4f24-95a7-40947e5de0ff-istio-token\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:01:28.524805 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:28.524770    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn" event={"ID":"58720041-5fb3-4f24-95a7-40947e5de0ff","Type":"ContainerDied","Data":"d43673c969ad1af866dc57ab34fe1e410f0751cf804aa419cbddb025169d9f42"}
Sep 11 05:01:28.524805 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:28.524792    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"
Sep 11 05:01:28.525285 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:28.524829    2554 scope.go:117] "RemoveContainer" containerID="79428b0775af5126d34eb152a65801c8127325f87e78a08cb9b7c31645cfa93d"
Sep 11 05:01:28.567731 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:28.567698    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"]
Sep 11 05:01:28.576658 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:28.576627    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-89e681d0-openshift-default-84dff8548d-ss7dn"]
Sep 11 05:01:28.814368 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:28.814255    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58720041-5fb3-4f24-95a7-40947e5de0ff" path="/var/lib/kubelet/pods/58720041-5fb3-4f24-95a7-40947e5de0ff/volumes"
Sep 11 05:01:42.802488 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:42.802449    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:01:50.803639 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:01:50.803605    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:02:14.813787 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:14.813754    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:02:16.293957 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.293920    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"]
Sep 11 05:02:16.294622 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.294600    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58720041-5fb3-4f24-95a7-40947e5de0ff" containerName="istio-proxy"
Sep 11 05:02:16.294622 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.294624    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="58720041-5fb3-4f24-95a7-40947e5de0ff" containerName="istio-proxy"
Sep 11 05:02:16.294781 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.294635    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62859b43-a5e3-4824-88b7-70a801d88f7e" containerName="test-curl-7518-636775"
Sep 11 05:02:16.294781 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.294645    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="62859b43-a5e3-4824-88b7-70a801d88f7e" containerName="test-curl-7518-636775"
Sep 11 05:02:16.294887 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.294786    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="62859b43-a5e3-4824-88b7-70a801d88f7e" containerName="test-curl-7518-636775"
Sep 11 05:02:16.294887 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.294804    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="58720041-5fb3-4f24-95a7-40947e5de0ff" containerName="istio-proxy"
Sep 11 05:02:16.299534 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.299512    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.302563 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.302543    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-b9198b-openshift-default-dockercfg-qspqg\""
Sep 11 05:02:16.310008 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.309982    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"]
Sep 11 05:02:16.389440 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.389397    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcj4r\" (UniqueName: \"kubernetes.io/projected/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-kube-api-access-lcj4r\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.389645 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.389457    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-credential-socket\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.389645 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.389499    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-token\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.389645 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.389523    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istiod-ca-cert\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.389645 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.389563    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-workload-socket\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.389645 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.389601    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-podinfo\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.389645 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.389629    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-data\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.389874 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.389654    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-workload-certs\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.389874 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.389671    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-envoy\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.490780 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.490746    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-data\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.490984 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.490787    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-workload-certs\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.490984 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.490806    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-envoy\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.490984 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.490851    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcj4r\" (UniqueName: \"kubernetes.io/projected/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-kube-api-access-lcj4r\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.490984 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.490901    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-credential-socket\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.490984 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.490948    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-token\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.490984 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.490985    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istiod-ca-cert\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.491300 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.491026    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-workload-socket\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.491300 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.491092    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-podinfo\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.491300 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.491212    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-data\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.491300 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.491244    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-workload-certs\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.491475 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.491313    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-credential-socket\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.491528 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.491508    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-workload-socket\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.491793 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.491772    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istiod-ca-cert\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.493476 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.493457    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-envoy\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.493619 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.493600    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-podinfo\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.499052 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.499027    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-token\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.499161 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.499035    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcj4r\" (UniqueName: \"kubernetes.io/projected/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-kube-api-access-lcj4r\") pod \"e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") " pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.611676 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.611590    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:16.888299 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.888274    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"]
Sep 11 05:02:16.890043 ip-10-0-143-244 kubenswrapper[2554]: W0911 05:02:16.890013    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc64b7fe0_4eaf_42fe_9c54_92d6e8d16648.slice/crio-850a50a6bf0a6bced7472e07f6e147a21093af6d2d3f1c22dd8383bd59537abe WatchSource:0}: Error finding container 850a50a6bf0a6bced7472e07f6e147a21093af6d2d3f1c22dd8383bd59537abe: Status 404 returned error can't find the container with id 850a50a6bf0a6bced7472e07f6e147a21093af6d2d3f1c22dd8383bd59537abe
Sep 11 05:02:16.892530 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.892494    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 05:02:16.892600 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.892587    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 05:02:16.892649 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:16.892634    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 05:02:17.802213 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:17.802175    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz" event={"ID":"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648","Type":"ContainerStarted","Data":"a8b43e85c27d17610efbef4be75590927023b317f57392615436ead5eeb0f5d3"}
Sep 11 05:02:17.802604 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:17.802228    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz" event={"ID":"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648","Type":"ContainerStarted","Data":"850a50a6bf0a6bced7472e07f6e147a21093af6d2d3f1c22dd8383bd59537abe"}
Sep 11 05:02:17.826573 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:17.826507    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz" podStartSLOduration=1.8264895270000001 podStartE2EDuration="1.826489527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:02:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:02:17.825368879 +0000 UTC m=+1327.478628559" watchObservedRunningTime="2026-09-11 05:02:17.826489527 +0000 UTC m=+1327.479749253"
Sep 11 05:02:18.612059 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:18.612024    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:18.617977 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:18.617947    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:18.814242 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:18.814216    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:18.814690 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:18.814281    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:20.878269 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:20.878237    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"]
Sep 11 05:02:20.878765 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:20.878693    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58720041-5fb3-4f24-95a7-40947e5de0ff" containerName="istio-proxy"
Sep 11 05:02:20.878765 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:20.878704    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="58720041-5fb3-4f24-95a7-40947e5de0ff" containerName="istio-proxy"
Sep 11 05:02:20.878886 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:20.878788    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="58720041-5fb3-4f24-95a7-40947e5de0ff" containerName="istio-proxy"
Sep 11 05:02:20.882359 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:20.882320    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"
Sep 11 05:02:20.885292 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:20.885261    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-b9198b-serving-cert\""
Sep 11 05:02:20.885498 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:20.885399    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-74gzc\""
Sep 11 05:02:20.893751 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:20.893725    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"]
Sep 11 05:02:20.936085 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:20.936050    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9xms\" (UniqueName: \"kubernetes.io/projected/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-kube-api-access-s9xms\") pod \"maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq\" (UID: \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"
Sep 11 05:02:20.936281 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:20.936089    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-maas-api-tls\") pod \"maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq\" (UID: \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"
Sep 11 05:02:20.936370 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:20.936306    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-metrics-certs\") pod \"maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq\" (UID: \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"
Sep 11 05:02:20.936442 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:20.936402    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-openshift-service-ca\") pod \"maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq\" (UID: \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"
Sep 11 05:02:21.037215 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:21.037172    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-openshift-service-ca\") pod \"maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq\" (UID: \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"
Sep 11 05:02:21.037459 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:21.037229    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9xms\" (UniqueName: \"kubernetes.io/projected/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-kube-api-access-s9xms\") pod \"maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq\" (UID: \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"
Sep 11 05:02:21.037459 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:21.037252    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-maas-api-tls\") pod \"maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq\" (UID: \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"
Sep 11 05:02:21.037459 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:21.037377    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-metrics-certs\") pod \"maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq\" (UID: \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"
Sep 11 05:02:21.037641 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:02:21.037456    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-serving-cert: secret "maas-api-e2e-api-a-b9198b-serving-cert" not found
Sep 11 05:02:21.037641 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:02:21.037521    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-maas-api-tls podName:c603e922-0f16-4f7d-aaab-6d9c1a54a35f nodeName:}" failed. No retries permitted until 2026-09-11 05:02:21.537505362 +0000 UTC m=+1331.190765025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-maas-api-tls") pod "maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq" (UID: "c603e922-0f16-4f7d-aaab-6d9c1a54a35f") : secret "maas-api-e2e-api-a-b9198b-serving-cert" not found
Sep 11 05:02:21.037906 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:21.037886    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-openshift-service-ca\") pod \"maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq\" (UID: \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"
Sep 11 05:02:21.039968 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:21.039947    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-metrics-certs\") pod \"maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq\" (UID: \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"
Sep 11 05:02:21.048437 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:21.048412    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9xms\" (UniqueName: \"kubernetes.io/projected/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-kube-api-access-s9xms\") pod \"maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq\" (UID: \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"
Sep 11 05:02:21.542755 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:21.542715    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-maas-api-tls\") pod \"maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq\" (UID: \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"
Sep 11 05:02:21.545302 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:21.545281    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-maas-api-tls\") pod \"maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq\" (UID: \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"
Sep 11 05:02:21.796936 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:21.796773    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"
Sep 11 05:02:22.076968 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:22.076944    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"]
Sep 11 05:02:22.078492 ip-10-0-143-244 kubenswrapper[2554]: W0911 05:02:22.078466    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc603e922_0f16_4f7d_aaab_6d9c1a54a35f.slice/crio-8dde1e7afce72f53f269597b09b2e6720fd2a0abefc1947f155ed3a7567c3cfe WatchSource:0}: Error finding container 8dde1e7afce72f53f269597b09b2e6720fd2a0abefc1947f155ed3a7567c3cfe: Status 404 returned error can't find the container with id 8dde1e7afce72f53f269597b09b2e6720fd2a0abefc1947f155ed3a7567c3cfe
Sep 11 05:02:22.833015 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:22.832979    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq" event={"ID":"c603e922-0f16-4f7d-aaab-6d9c1a54a35f","Type":"ContainerStarted","Data":"b7ec57a45d78fbf94eb7ec1363fc1e27763f8f441eba1424f8a26e71924f1172"}
Sep 11 05:02:22.833203 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:22.833039    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq" event={"ID":"c603e922-0f16-4f7d-aaab-6d9c1a54a35f","Type":"ContainerStarted","Data":"8dde1e7afce72f53f269597b09b2e6720fd2a0abefc1947f155ed3a7567c3cfe"}
Sep 11 05:02:22.833203 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:22.833103    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"
Sep 11 05:02:22.852183 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:22.852055    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq" podStartSLOduration=2.343914972 podStartE2EDuration="2.852034912s" totalImagesPullingTime="508.11994ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:02:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:02:22.850973629 +0000 UTC m=+1332.504233320" watchObservedRunningTime="2026-09-11 05:02:22.852034912 +0000 UTC m=+1332.505294595"
Sep 11 05:02:28.844835 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:28.844808    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"
Sep 11 05:02:34.849553 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:34.849508    2554 patch_prober.go:28] interesting pod/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 05:02:34.849909 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:34.849581    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz" podUID="c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 05:02:35.908766 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:35.908737    2554 generic.go:356] "Generic (PLEG): container finished" podID="c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" containerID="a8b43e85c27d17610efbef4be75590927023b317f57392615436ead5eeb0f5d3" exitCode=0
Sep 11 05:02:35.909176 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:35.908820    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz" event={"ID":"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648","Type":"ContainerDied","Data":"a8b43e85c27d17610efbef4be75590927023b317f57392615436ead5eeb0f5d3"}
Sep 11 05:02:35.909244 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:35.909230    2554 scope.go:117] "RemoveContainer" containerID="a8b43e85c27d17610efbef4be75590927023b317f57392615436ead5eeb0f5d3"
Sep 11 05:02:35.910417 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:35.910389    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 05:02:35.910511 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:35.910459    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 05:02:35.910511 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:35.910489    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 05:02:36.916507 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:36.916464    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz" event={"ID":"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648","Type":"ContainerStarted","Data":"9e0beccb68f4e52fcaea8e5de0bfd702f3aed31b780582f36d3aa87025ed5b7b"}
Sep 11 05:02:37.309051 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:37.308944    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:02:37.612774 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:37.612669    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:37.613473 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:37.613438    2554 patch_prober.go:28] interesting pod/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 11 05:02:37.613624 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:37.613513    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz" podUID="c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 11 05:02:38.613017 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:38.612975    2554 patch_prober.go:28] interesting pod/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 11 05:02:38.613565 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:38.613066    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz" podUID="c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 11 05:02:39.612016 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:39.611978    2554 patch_prober.go:28] interesting pod/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 11 05:02:39.612344 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:39.612297    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz" podUID="c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 11 05:02:40.612710 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:40.612673    2554 patch_prober.go:28] interesting pod/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 11 05:02:40.613736 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:40.613292    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz" podUID="c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 11 05:02:41.612204 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:41.612164    2554 patch_prober.go:28] interesting pod/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 11 05:02:41.612605 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:41.612570    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz" podUID="c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 11 05:02:42.850614 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:42.850579    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:42.851297 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:42.851261    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:42.859269 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:42.852403    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:02:49.777539 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:49.777495    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"]
Sep 11 05:02:49.782224 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:49.782204    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"
Sep 11 05:02:49.784815 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:49.784790    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-9c1509-serving-cert\""
Sep 11 05:02:49.793540 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:49.793514    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"]
Sep 11 05:02:49.826104 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:49.826072    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbvm7\" (UniqueName: \"kubernetes.io/projected/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-kube-api-access-mbvm7\") pod \"maas-api-e2e-api-b-9c1509-65b9558575-bczsm\" (UID: \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"
Sep 11 05:02:49.826303 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:49.826202    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-openshift-service-ca\") pod \"maas-api-e2e-api-b-9c1509-65b9558575-bczsm\" (UID: \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"
Sep 11 05:02:49.826402 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:49.826320    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-metrics-certs\") pod \"maas-api-e2e-api-b-9c1509-65b9558575-bczsm\" (UID: \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"
Sep 11 05:02:49.826468 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:49.826412    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-maas-api-tls\") pod \"maas-api-e2e-api-b-9c1509-65b9558575-bczsm\" (UID: \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"
Sep 11 05:02:49.928360 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:49.928300    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbvm7\" (UniqueName: \"kubernetes.io/projected/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-kube-api-access-mbvm7\") pod \"maas-api-e2e-api-b-9c1509-65b9558575-bczsm\" (UID: \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"
Sep 11 05:02:49.928836 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:49.928807    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-openshift-service-ca\") pod \"maas-api-e2e-api-b-9c1509-65b9558575-bczsm\" (UID: \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"
Sep 11 05:02:49.928969 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:49.928928    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-metrics-certs\") pod \"maas-api-e2e-api-b-9c1509-65b9558575-bczsm\" (UID: \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"
Sep 11 05:02:49.929033 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:49.928980    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-maas-api-tls\") pod \"maas-api-e2e-api-b-9c1509-65b9558575-bczsm\" (UID: \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"
Sep 11 05:02:49.929169 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:02:49.929150    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-serving-cert: secret "maas-api-e2e-api-b-9c1509-serving-cert" not found
Sep 11 05:02:49.929419 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:02:49.929403    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-maas-api-tls podName:ca3ffab6-d195-44c4-a45d-2f0fdae13d7d nodeName:}" failed. No retries permitted until 2026-09-11 05:02:50.429366067 +0000 UTC m=+1360.082625758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-maas-api-tls") pod "maas-api-e2e-api-b-9c1509-65b9558575-bczsm" (UID: "ca3ffab6-d195-44c4-a45d-2f0fdae13d7d") : secret "maas-api-e2e-api-b-9c1509-serving-cert" not found
Sep 11 05:02:49.929633 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:49.929606    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-openshift-service-ca\") pod \"maas-api-e2e-api-b-9c1509-65b9558575-bczsm\" (UID: \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"
Sep 11 05:02:49.932722 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:49.932696    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-metrics-certs\") pod \"maas-api-e2e-api-b-9c1509-65b9558575-bczsm\" (UID: \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"
Sep 11 05:02:49.938345 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:49.938310    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbvm7\" (UniqueName: \"kubernetes.io/projected/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-kube-api-access-mbvm7\") pod \"maas-api-e2e-api-b-9c1509-65b9558575-bczsm\" (UID: \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"
Sep 11 05:02:50.433738 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:50.433700    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-maas-api-tls\") pod \"maas-api-e2e-api-b-9c1509-65b9558575-bczsm\" (UID: \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"
Sep 11 05:02:50.436286 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:50.436263    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-maas-api-tls\") pod \"maas-api-e2e-api-b-9c1509-65b9558575-bczsm\" (UID: \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"
Sep 11 05:02:50.652374 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:50.652322    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq"]
Sep 11 05:02:50.656378 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:50.656355    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq"
Sep 11 05:02:50.659244 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:50.659221    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-9c1509-dockercfg-wp9h5\""
Sep 11 05:02:50.659431 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:50.659412    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-9c1509\""
Sep 11 05:02:50.668894 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:50.668868    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq"]
Sep 11 05:02:50.697171 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:50.697083    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"
Sep 11 05:02:50.736177 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:50.736130    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0018c96-f391-491e-8317-b94999c5b54d-plugins-config-volume\") pod \"payload-processing-e2e-api-b-9c1509-68f864477f-27wsq\" (UID: \"a0018c96-f391-491e-8317-b94999c5b54d\") " pod="openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq"
Sep 11 05:02:50.736404 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:50.736185    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfm9l\" (UniqueName: \"kubernetes.io/projected/a0018c96-f391-491e-8317-b94999c5b54d-kube-api-access-kfm9l\") pod \"payload-processing-e2e-api-b-9c1509-68f864477f-27wsq\" (UID: \"a0018c96-f391-491e-8317-b94999c5b54d\") " pod="openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq"
Sep 11 05:02:50.837597 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:50.837559    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0018c96-f391-491e-8317-b94999c5b54d-plugins-config-volume\") pod \"payload-processing-e2e-api-b-9c1509-68f864477f-27wsq\" (UID: \"a0018c96-f391-491e-8317-b94999c5b54d\") " pod="openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq"
Sep 11 05:02:50.838053 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:50.837608    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfm9l\" (UniqueName: \"kubernetes.io/projected/a0018c96-f391-491e-8317-b94999c5b54d-kube-api-access-kfm9l\") pod \"payload-processing-e2e-api-b-9c1509-68f864477f-27wsq\" (UID: \"a0018c96-f391-491e-8317-b94999c5b54d\") " pod="openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq"
Sep 11 05:02:50.838324 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:50.838305    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0018c96-f391-491e-8317-b94999c5b54d-plugins-config-volume\") pod \"payload-processing-e2e-api-b-9c1509-68f864477f-27wsq\" (UID: \"a0018c96-f391-491e-8317-b94999c5b54d\") " pod="openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq"
Sep 11 05:02:50.846196 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:50.846169    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfm9l\" (UniqueName: \"kubernetes.io/projected/a0018c96-f391-491e-8317-b94999c5b54d-kube-api-access-kfm9l\") pod \"payload-processing-e2e-api-b-9c1509-68f864477f-27wsq\" (UID: \"a0018c96-f391-491e-8317-b94999c5b54d\") " pod="openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq"
Sep 11 05:02:50.968835 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:50.968733    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq"
Sep 11 05:02:50.978703 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:50.978677    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"]
Sep 11 05:02:50.980737 ip-10-0-143-244 kubenswrapper[2554]: W0911 05:02:50.980711    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca3ffab6_d195_44c4_a45d_2f0fdae13d7d.slice/crio-1bf38e184e64e19b1b4edfb07c806c0abbbe3b1042e95df14fc79030b43b4302 WatchSource:0}: Error finding container 1bf38e184e64e19b1b4edfb07c806c0abbbe3b1042e95df14fc79030b43b4302: Status 404 returned error can't find the container with id 1bf38e184e64e19b1b4edfb07c806c0abbbe3b1042e95df14fc79030b43b4302
Sep 11 05:02:51.000583 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:51.000500    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm" event={"ID":"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d","Type":"ContainerStarted","Data":"1bf38e184e64e19b1b4edfb07c806c0abbbe3b1042e95df14fc79030b43b4302"}
Sep 11 05:02:51.249370 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:51.249322    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq"]
Sep 11 05:02:51.251186 ip-10-0-143-244 kubenswrapper[2554]: W0911 05:02:51.251159    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0018c96_f391_491e_8317_b94999c5b54d.slice/crio-1885552b15b091b519b52aca55ebe37c4b5572037c63a98f05da89f2e8a07b27 WatchSource:0}: Error finding container 1885552b15b091b519b52aca55ebe37c4b5572037c63a98f05da89f2e8a07b27: Status 404 returned error can't find the container with id 1885552b15b091b519b52aca55ebe37c4b5572037c63a98f05da89f2e8a07b27
Sep 11 05:02:52.008117 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:52.008078    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq" event={"ID":"a0018c96-f391-491e-8317-b94999c5b54d","Type":"ContainerStarted","Data":"3ac5fbb160d706470e8786fc7849e45c4dea22fe23dbc7dc472996394fc4077f"}
Sep 11 05:02:52.008607 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:52.008182    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq"
Sep 11 05:02:52.008607 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:52.008206    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq" event={"ID":"a0018c96-f391-491e-8317-b94999c5b54d","Type":"ContainerStarted","Data":"1885552b15b091b519b52aca55ebe37c4b5572037c63a98f05da89f2e8a07b27"}
Sep 11 05:02:52.009845 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:52.009823    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm" event={"ID":"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d","Type":"ContainerStarted","Data":"e0d796b3a4c6c5a6b14ec72ddd39c72a275334994fa25ea85586c50fee265d4c"}
Sep 11 05:02:52.009957 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:52.009944    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"
Sep 11 05:02:52.025476 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:52.025432    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq" podStartSLOduration=2.025417854 podStartE2EDuration="2.025417854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:02:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:02:52.024061664 +0000 UTC m=+1361.677321349" watchObservedRunningTime="2026-09-11 05:02:52.025417854 +0000 UTC m=+1361.678677545"
Sep 11 05:02:52.042586 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:52.042533    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm" podStartSLOduration=2.673599223 podStartE2EDuration="3.042515144s" totalImagesPullingTime="368.915921ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:02:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:02:52.040460173 +0000 UTC m=+1361.693719857" watchObservedRunningTime="2026-09-11 05:02:52.042515144 +0000 UTC m=+1361.695774815"
Sep 11 05:02:58.020623 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:58.020587    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"
Sep 11 05:02:58.109208 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:02:58.109173    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:03:03.017959 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:03.017929    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq"
Sep 11 05:03:31.612514 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:31.612478    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"]
Sep 11 05:03:31.613051 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:31.612771    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq" podUID="c603e922-0f16-4f7d-aaab-6d9c1a54a35f" containerName="maas-api" containerID="cri-o://b7ec57a45d78fbf94eb7ec1363fc1e27763f8f441eba1424f8a26e71924f1172" gracePeriod=30
Sep 11 05:03:31.869211 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:31.869150    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"
Sep 11 05:03:31.954833 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:31.954797    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-maas-api-tls\") pod \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\" (UID: \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\") "
Sep 11 05:03:31.955030 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:31.954851    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-metrics-certs\") pod \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\" (UID: \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\") "
Sep 11 05:03:31.955030 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:31.954896    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9xms\" (UniqueName: \"kubernetes.io/projected/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-kube-api-access-s9xms\") pod \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\" (UID: \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\") "
Sep 11 05:03:31.955030 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:31.954979    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-openshift-service-ca\") pod \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\" (UID: \"c603e922-0f16-4f7d-aaab-6d9c1a54a35f\") "
Sep 11 05:03:31.955448 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:31.955420    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c603e922-0f16-4f7d-aaab-6d9c1a54a35f" (UID: "c603e922-0f16-4f7d-aaab-6d9c1a54a35f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 05:03:31.957166 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:31.957134    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c603e922-0f16-4f7d-aaab-6d9c1a54a35f" (UID: "c603e922-0f16-4f7d-aaab-6d9c1a54a35f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 05:03:31.957246 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:31.957181    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c603e922-0f16-4f7d-aaab-6d9c1a54a35f" (UID: "c603e922-0f16-4f7d-aaab-6d9c1a54a35f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 05:03:31.957296 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:31.957268    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-kube-api-access-s9xms" (OuterVolumeSpecName: "kube-api-access-s9xms") pod "c603e922-0f16-4f7d-aaab-6d9c1a54a35f" (UID: "c603e922-0f16-4f7d-aaab-6d9c1a54a35f"). InnerVolumeSpecName "kube-api-access-s9xms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:03:32.056516 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:32.056475    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-openshift-service-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:03:32.056516 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:32.056510    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-maas-api-tls\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:03:32.056516 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:32.056523    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-metrics-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:03:32.056753 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:32.056534    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9xms\" (UniqueName: \"kubernetes.io/projected/c603e922-0f16-4f7d-aaab-6d9c1a54a35f-kube-api-access-s9xms\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:03:32.239061 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:32.239026    2554 generic.go:356] "Generic (PLEG): container finished" podID="c603e922-0f16-4f7d-aaab-6d9c1a54a35f" containerID="b7ec57a45d78fbf94eb7ec1363fc1e27763f8f441eba1424f8a26e71924f1172" exitCode=0
Sep 11 05:03:32.239266 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:32.239069    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"
Sep 11 05:03:32.239266 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:32.239125    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq" event={"ID":"c603e922-0f16-4f7d-aaab-6d9c1a54a35f","Type":"ContainerDied","Data":"b7ec57a45d78fbf94eb7ec1363fc1e27763f8f441eba1424f8a26e71924f1172"}
Sep 11 05:03:32.239266 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:32.239175    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq" event={"ID":"c603e922-0f16-4f7d-aaab-6d9c1a54a35f","Type":"ContainerDied","Data":"8dde1e7afce72f53f269597b09b2e6720fd2a0abefc1947f155ed3a7567c3cfe"}
Sep 11 05:03:32.239266 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:32.239198    2554 scope.go:117] "RemoveContainer" containerID="b7ec57a45d78fbf94eb7ec1363fc1e27763f8f441eba1424f8a26e71924f1172"
Sep 11 05:03:32.250660 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:32.250642    2554 scope.go:117] "RemoveContainer" containerID="b7ec57a45d78fbf94eb7ec1363fc1e27763f8f441eba1424f8a26e71924f1172"
Sep 11 05:03:32.250964 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:03:32.250943    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7ec57a45d78fbf94eb7ec1363fc1e27763f8f441eba1424f8a26e71924f1172\": container with ID starting with b7ec57a45d78fbf94eb7ec1363fc1e27763f8f441eba1424f8a26e71924f1172 not found: ID does not exist" containerID="b7ec57a45d78fbf94eb7ec1363fc1e27763f8f441eba1424f8a26e71924f1172"
Sep 11 05:03:32.251015 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:32.250973    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7ec57a45d78fbf94eb7ec1363fc1e27763f8f441eba1424f8a26e71924f1172"} err="failed to get container status \"b7ec57a45d78fbf94eb7ec1363fc1e27763f8f441eba1424f8a26e71924f1172\": rpc error: code = NotFound desc = could not find container \"b7ec57a45d78fbf94eb7ec1363fc1e27763f8f441eba1424f8a26e71924f1172\": container with ID starting with b7ec57a45d78fbf94eb7ec1363fc1e27763f8f441eba1424f8a26e71924f1172 not found: ID does not exist"
Sep 11 05:03:32.262792 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:32.262766    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"]
Sep 11 05:03:32.264860 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:32.264838    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b9198b-658b6b57f8-7qdqq"]
Sep 11 05:03:32.814638 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:32.814603    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c603e922-0f16-4f7d-aaab-6d9c1a54a35f" path="/var/lib/kubelet/pods/c603e922-0f16-4f7d-aaab-6d9c1a54a35f/volumes"
Sep 11 05:03:36.509791 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:36.509756    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:03:38.985865 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:38.985828    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"]
Sep 11 05:03:38.986282 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:38.986097    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz" podUID="c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" containerName="istio-proxy" containerID="cri-o://9e0beccb68f4e52fcaea8e5de0bfd702f3aed31b780582f36d3aa87025ed5b7b" gracePeriod=30
Sep 11 05:03:42.854420 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:42.854373    2554 patch_prober.go:28] interesting pod/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 05:03:42.854799 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:42.854452    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz" podUID="c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 05:03:44.262928 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.262866    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:03:44.315567 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.315534    2554 generic.go:356] "Generic (PLEG): container finished" podID="c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" containerID="9e0beccb68f4e52fcaea8e5de0bfd702f3aed31b780582f36d3aa87025ed5b7b" exitCode=0
Sep 11 05:03:44.315759 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.315605    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"
Sep 11 05:03:44.315759 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.315620    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz" event={"ID":"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648","Type":"ContainerDied","Data":"9e0beccb68f4e52fcaea8e5de0bfd702f3aed31b780582f36d3aa87025ed5b7b"}
Sep 11 05:03:44.315759 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.315719    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz" event={"ID":"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648","Type":"ContainerDied","Data":"850a50a6bf0a6bced7472e07f6e147a21093af6d2d3f1c22dd8383bd59537abe"}
Sep 11 05:03:44.315759 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.315752    2554 scope.go:117] "RemoveContainer" containerID="9e0beccb68f4e52fcaea8e5de0bfd702f3aed31b780582f36d3aa87025ed5b7b"
Sep 11 05:03:44.327535 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.327516    2554 scope.go:117] "RemoveContainer" containerID="a8b43e85c27d17610efbef4be75590927023b317f57392615436ead5eeb0f5d3"
Sep 11 05:03:44.336381 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.336359    2554 scope.go:117] "RemoveContainer" containerID="9e0beccb68f4e52fcaea8e5de0bfd702f3aed31b780582f36d3aa87025ed5b7b"
Sep 11 05:03:44.336694 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:03:44.336662    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e0beccb68f4e52fcaea8e5de0bfd702f3aed31b780582f36d3aa87025ed5b7b\": container with ID starting with 9e0beccb68f4e52fcaea8e5de0bfd702f3aed31b780582f36d3aa87025ed5b7b not found: ID does not exist" containerID="9e0beccb68f4e52fcaea8e5de0bfd702f3aed31b780582f36d3aa87025ed5b7b"
Sep 11 05:03:44.336759 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.336701    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e0beccb68f4e52fcaea8e5de0bfd702f3aed31b780582f36d3aa87025ed5b7b"} err="failed to get container status \"9e0beccb68f4e52fcaea8e5de0bfd702f3aed31b780582f36d3aa87025ed5b7b\": rpc error: code = NotFound desc = could not find container \"9e0beccb68f4e52fcaea8e5de0bfd702f3aed31b780582f36d3aa87025ed5b7b\": container with ID starting with 9e0beccb68f4e52fcaea8e5de0bfd702f3aed31b780582f36d3aa87025ed5b7b not found: ID does not exist"
Sep 11 05:03:44.336759 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.336719    2554 scope.go:117] "RemoveContainer" containerID="a8b43e85c27d17610efbef4be75590927023b317f57392615436ead5eeb0f5d3"
Sep 11 05:03:44.337056 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:03:44.337033    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8b43e85c27d17610efbef4be75590927023b317f57392615436ead5eeb0f5d3\": container with ID starting with a8b43e85c27d17610efbef4be75590927023b317f57392615436ead5eeb0f5d3 not found: ID does not exist" containerID="a8b43e85c27d17610efbef4be75590927023b317f57392615436ead5eeb0f5d3"
Sep 11 05:03:44.337126 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.337067    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8b43e85c27d17610efbef4be75590927023b317f57392615436ead5eeb0f5d3"} err="failed to get container status \"a8b43e85c27d17610efbef4be75590927023b317f57392615436ead5eeb0f5d3\": rpc error: code = NotFound desc = could not find container \"a8b43e85c27d17610efbef4be75590927023b317f57392615436ead5eeb0f5d3\": container with ID starting with a8b43e85c27d17610efbef4be75590927023b317f57392615436ead5eeb0f5d3 not found: ID does not exist"
Sep 11 05:03:44.378556 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.378520    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-token\") pod \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") "
Sep 11 05:03:44.378751 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.378601    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-workload-socket\") pod \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") "
Sep 11 05:03:44.378751 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.378632    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istiod-ca-cert\") pod \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") "
Sep 11 05:03:44.378751 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.378656    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-data\") pod \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") "
Sep 11 05:03:44.378751 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.378685    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-credential-socket\") pod \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") "
Sep 11 05:03:44.378751 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.378709    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcj4r\" (UniqueName: \"kubernetes.io/projected/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-kube-api-access-lcj4r\") pod \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") "
Sep 11 05:03:44.379022 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.378764    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-workload-certs\") pod \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") "
Sep 11 05:03:44.379022 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.378822    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-envoy\") pod \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") "
Sep 11 05:03:44.379022 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.378852    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-podinfo\") pod \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\" (UID: \"c64b7fe0-4eaf-42fe-9c54-92d6e8d16648\") "
Sep 11 05:03:44.379022 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.378900    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" (UID: "c64b7fe0-4eaf-42fe-9c54-92d6e8d16648"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:03:44.379022 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.378977    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-data" (OuterVolumeSpecName: "istio-data") pod "c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" (UID: "c64b7fe0-4eaf-42fe-9c54-92d6e8d16648"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:03:44.379284 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.379174    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" (UID: "c64b7fe0-4eaf-42fe-9c54-92d6e8d16648"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:03:44.379284 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.379177    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" (UID: "c64b7fe0-4eaf-42fe-9c54-92d6e8d16648"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 05:03:44.379284 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.379251    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-data\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:03:44.379426 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.379285    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" (UID: "c64b7fe0-4eaf-42fe-9c54-92d6e8d16648"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:03:44.379426 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.379300    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-workload-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:03:44.379426 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.379314    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-workload-socket\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:03:44.380983 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.380953    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-token" (OuterVolumeSpecName: "istio-token") pod "c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" (UID: "c64b7fe0-4eaf-42fe-9c54-92d6e8d16648"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:03:44.381084 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.381070    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" (UID: "c64b7fe0-4eaf-42fe-9c54-92d6e8d16648"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 05:03:44.381248 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.381221    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" (UID: "c64b7fe0-4eaf-42fe-9c54-92d6e8d16648"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:03:44.381651 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.381625    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-kube-api-access-lcj4r" (OuterVolumeSpecName: "kube-api-access-lcj4r") pod "c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" (UID: "c64b7fe0-4eaf-42fe-9c54-92d6e8d16648"). InnerVolumeSpecName "kube-api-access-lcj4r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:03:44.480810 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.480774    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-envoy\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:03:44.480810 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.480802    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-podinfo\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:03:44.480810 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.480810    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istio-token\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:03:44.480810 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.480819    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-istiod-ca-cert\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:03:44.481070 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.480828    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-credential-socket\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:03:44.481070 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.480837    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcj4r\" (UniqueName: \"kubernetes.io/projected/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648-kube-api-access-lcj4r\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:03:44.639043 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.639006    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"]
Sep 11 05:03:44.644378 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.644348    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-b9198b-openshift-default-76989b885d-ddwjz"]
Sep 11 05:03:44.814541 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:44.814507    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" path="/var/lib/kubelet/pods/c64b7fe0-4eaf-42fe-9c54-92d6e8d16648/volumes"
Sep 11 05:03:55.039192 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.039151    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"]
Sep 11 05:03:55.039799 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.039472    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm" podUID="ca3ffab6-d195-44c4-a45d-2f0fdae13d7d" containerName="maas-api" containerID="cri-o://e0d796b3a4c6c5a6b14ec72ddd39c72a275334994fa25ea85586c50fee265d4c" gracePeriod=30
Sep 11 05:03:55.101753 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.101704    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq"]
Sep 11 05:03:55.102054 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.102025    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq" podUID="a0018c96-f391-491e-8317-b94999c5b54d" containerName="payload-processing" containerID="cri-o://3ac5fbb160d706470e8786fc7849e45c4dea22fe23dbc7dc472996394fc4077f" gracePeriod=30
Sep 11 05:03:55.367711 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.367683    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"
Sep 11 05:03:55.378468 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.378291    2554 generic.go:356] "Generic (PLEG): container finished" podID="a0018c96-f391-491e-8317-b94999c5b54d" containerID="3ac5fbb160d706470e8786fc7849e45c4dea22fe23dbc7dc472996394fc4077f" exitCode=0
Sep 11 05:03:55.378468 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.378381    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq" event={"ID":"a0018c96-f391-491e-8317-b94999c5b54d","Type":"ContainerDied","Data":"3ac5fbb160d706470e8786fc7849e45c4dea22fe23dbc7dc472996394fc4077f"}
Sep 11 05:03:55.379800 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.379773    2554 generic.go:356] "Generic (PLEG): container finished" podID="ca3ffab6-d195-44c4-a45d-2f0fdae13d7d" containerID="e0d796b3a4c6c5a6b14ec72ddd39c72a275334994fa25ea85586c50fee265d4c" exitCode=0
Sep 11 05:03:55.379946 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.379823    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"
Sep 11 05:03:55.379946 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.379850    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm" event={"ID":"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d","Type":"ContainerDied","Data":"e0d796b3a4c6c5a6b14ec72ddd39c72a275334994fa25ea85586c50fee265d4c"}
Sep 11 05:03:55.379946 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.379916    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm" event={"ID":"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d","Type":"ContainerDied","Data":"1bf38e184e64e19b1b4edfb07c806c0abbbe3b1042e95df14fc79030b43b4302"}
Sep 11 05:03:55.379946 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.379930    2554 scope.go:117] "RemoveContainer" containerID="e0d796b3a4c6c5a6b14ec72ddd39c72a275334994fa25ea85586c50fee265d4c"
Sep 11 05:03:55.404048 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.404023    2554 scope.go:117] "RemoveContainer" containerID="e0d796b3a4c6c5a6b14ec72ddd39c72a275334994fa25ea85586c50fee265d4c"
Sep 11 05:03:55.404442 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:03:55.404382    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0d796b3a4c6c5a6b14ec72ddd39c72a275334994fa25ea85586c50fee265d4c\": container with ID starting with e0d796b3a4c6c5a6b14ec72ddd39c72a275334994fa25ea85586c50fee265d4c not found: ID does not exist" containerID="e0d796b3a4c6c5a6b14ec72ddd39c72a275334994fa25ea85586c50fee265d4c"
Sep 11 05:03:55.404442 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.404426    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0d796b3a4c6c5a6b14ec72ddd39c72a275334994fa25ea85586c50fee265d4c"} err="failed to get container status \"e0d796b3a4c6c5a6b14ec72ddd39c72a275334994fa25ea85586c50fee265d4c\": rpc error: code = NotFound desc = could not find container \"e0d796b3a4c6c5a6b14ec72ddd39c72a275334994fa25ea85586c50fee265d4c\": container with ID starting with e0d796b3a4c6c5a6b14ec72ddd39c72a275334994fa25ea85586c50fee265d4c not found: ID does not exist"
Sep 11 05:03:55.406242 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.406183    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq"
Sep 11 05:03:55.492086 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.492039    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-openshift-service-ca\") pod \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\" (UID: \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\") "
Sep 11 05:03:55.492308 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.492157    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-metrics-certs\") pod \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\" (UID: \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\") "
Sep 11 05:03:55.492308 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.492182    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-maas-api-tls\") pod \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\" (UID: \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\") "
Sep 11 05:03:55.492308 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.492215    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbvm7\" (UniqueName: \"kubernetes.io/projected/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-kube-api-access-mbvm7\") pod \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\" (UID: \"ca3ffab6-d195-44c4-a45d-2f0fdae13d7d\") "
Sep 11 05:03:55.492535 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.492508    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ca3ffab6-d195-44c4-a45d-2f0fdae13d7d" (UID: "ca3ffab6-d195-44c4-a45d-2f0fdae13d7d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 05:03:55.492631 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.492608    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-openshift-service-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:03:55.495041 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.495009    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ca3ffab6-d195-44c4-a45d-2f0fdae13d7d" (UID: "ca3ffab6-d195-44c4-a45d-2f0fdae13d7d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 05:03:55.495179 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.495062    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-kube-api-access-mbvm7" (OuterVolumeSpecName: "kube-api-access-mbvm7") pod "ca3ffab6-d195-44c4-a45d-2f0fdae13d7d" (UID: "ca3ffab6-d195-44c4-a45d-2f0fdae13d7d"). InnerVolumeSpecName "kube-api-access-mbvm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:03:55.495179 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.495110    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ca3ffab6-d195-44c4-a45d-2f0fdae13d7d" (UID: "ca3ffab6-d195-44c4-a45d-2f0fdae13d7d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 05:03:55.594103 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.593987    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfm9l\" (UniqueName: \"kubernetes.io/projected/a0018c96-f391-491e-8317-b94999c5b54d-kube-api-access-kfm9l\") pod \"a0018c96-f391-491e-8317-b94999c5b54d\" (UID: \"a0018c96-f391-491e-8317-b94999c5b54d\") "
Sep 11 05:03:55.594103 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.594098    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0018c96-f391-491e-8317-b94999c5b54d-plugins-config-volume\") pod \"a0018c96-f391-491e-8317-b94999c5b54d\" (UID: \"a0018c96-f391-491e-8317-b94999c5b54d\") "
Sep 11 05:03:55.594463 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.594443    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-metrics-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:03:55.594538 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.594467    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-maas-api-tls\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:03:55.594538 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.594482    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbvm7\" (UniqueName: \"kubernetes.io/projected/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d-kube-api-access-mbvm7\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:03:55.594629 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.594546    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0018c96-f391-491e-8317-b94999c5b54d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a0018c96-f391-491e-8317-b94999c5b54d" (UID: "a0018c96-f391-491e-8317-b94999c5b54d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 05:03:55.596296 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.596274    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0018c96-f391-491e-8317-b94999c5b54d-kube-api-access-kfm9l" (OuterVolumeSpecName: "kube-api-access-kfm9l") pod "a0018c96-f391-491e-8317-b94999c5b54d" (UID: "a0018c96-f391-491e-8317-b94999c5b54d"). InnerVolumeSpecName "kube-api-access-kfm9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:03:55.695417 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.695383    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a0018c96-f391-491e-8317-b94999c5b54d-plugins-config-volume\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:03:55.695417 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.695407    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfm9l\" (UniqueName: \"kubernetes.io/projected/a0018c96-f391-491e-8317-b94999c5b54d-kube-api-access-kfm9l\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:03:55.702622 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.702593    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"]
Sep 11 05:03:55.708200 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:55.708173    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9c1509-65b9558575-bczsm"]
Sep 11 05:03:56.386723 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:56.386632    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq" event={"ID":"a0018c96-f391-491e-8317-b94999c5b54d","Type":"ContainerDied","Data":"1885552b15b091b519b52aca55ebe37c4b5572037c63a98f05da89f2e8a07b27"}
Sep 11 05:03:56.386723 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:56.386638    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq"
Sep 11 05:03:56.386723 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:56.386693    2554 scope.go:117] "RemoveContainer" containerID="3ac5fbb160d706470e8786fc7849e45c4dea22fe23dbc7dc472996394fc4077f"
Sep 11 05:03:56.408956 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:56.408918    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq"]
Sep 11 05:03:56.412783 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:56.412754    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9c1509-68f864477f-27wsq"]
Sep 11 05:03:56.814695 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:56.814661    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0018c96-f391-491e-8317-b94999c5b54d" path="/var/lib/kubelet/pods/a0018c96-f391-491e-8317-b94999c5b54d/volumes"
Sep 11 05:03:56.815056 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:56.815042    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca3ffab6-d195-44c4-a45d-2f0fdae13d7d" path="/var/lib/kubelet/pods/ca3ffab6-d195-44c4-a45d-2f0fdae13d7d/volumes"
Sep 11 05:03:59.701995 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:03:59.701956    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:04:12.762708 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:12.762666    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f5e6f7-29818380-nk62q"]
Sep 11 05:04:12.765147 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:12.765123    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-f5e6f7-29818380-nk62q"]
Sep 11 05:04:12.790765 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:12.790726    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz"]
Sep 11 05:04:12.791225 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:12.791187    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz" podUID="98d8cbc8-7949-41af-b9c8-e1fd0a2d8699" containerName="payload-processing" containerID="cri-o://905085e1e5e67c2d81f86b23dd3f09b81b3cbaf77d5262906f19a3756c0d1c49" gracePeriod=30
Sep 11 05:04:12.816496 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:12.816467    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efee0304-c88b-4ed5-9d3e-9be2433d9c27" path="/var/lib/kubelet/pods/efee0304-c88b-4ed5-9d3e-9be2433d9c27/volumes"
Sep 11 05:04:13.063600 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:13.063574    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz"
Sep 11 05:04:13.164716 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:13.164679    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98d8cbc8-7949-41af-b9c8-e1fd0a2d8699-plugins-config-volume\") pod \"98d8cbc8-7949-41af-b9c8-e1fd0a2d8699\" (UID: \"98d8cbc8-7949-41af-b9c8-e1fd0a2d8699\") "
Sep 11 05:04:13.164716 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:13.164715    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7vwf\" (UniqueName: \"kubernetes.io/projected/98d8cbc8-7949-41af-b9c8-e1fd0a2d8699-kube-api-access-g7vwf\") pod \"98d8cbc8-7949-41af-b9c8-e1fd0a2d8699\" (UID: \"98d8cbc8-7949-41af-b9c8-e1fd0a2d8699\") "
Sep 11 05:04:13.165085 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:13.165057    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98d8cbc8-7949-41af-b9c8-e1fd0a2d8699-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "98d8cbc8-7949-41af-b9c8-e1fd0a2d8699" (UID: "98d8cbc8-7949-41af-b9c8-e1fd0a2d8699"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 05:04:13.167015 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:13.166984    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98d8cbc8-7949-41af-b9c8-e1fd0a2d8699-kube-api-access-g7vwf" (OuterVolumeSpecName: "kube-api-access-g7vwf") pod "98d8cbc8-7949-41af-b9c8-e1fd0a2d8699" (UID: "98d8cbc8-7949-41af-b9c8-e1fd0a2d8699"). InnerVolumeSpecName "kube-api-access-g7vwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:04:13.265791 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:13.265753    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98d8cbc8-7949-41af-b9c8-e1fd0a2d8699-plugins-config-volume\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:04:13.265791 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:13.265783    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7vwf\" (UniqueName: \"kubernetes.io/projected/98d8cbc8-7949-41af-b9c8-e1fd0a2d8699-kube-api-access-g7vwf\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:04:13.482789 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:13.482756    2554 generic.go:356] "Generic (PLEG): container finished" podID="98d8cbc8-7949-41af-b9c8-e1fd0a2d8699" containerID="905085e1e5e67c2d81f86b23dd3f09b81b3cbaf77d5262906f19a3756c0d1c49" exitCode=0
Sep 11 05:04:13.482986 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:13.482805    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz"
Sep 11 05:04:13.482986 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:13.482840    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz" event={"ID":"98d8cbc8-7949-41af-b9c8-e1fd0a2d8699","Type":"ContainerDied","Data":"905085e1e5e67c2d81f86b23dd3f09b81b3cbaf77d5262906f19a3756c0d1c49"}
Sep 11 05:04:13.482986 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:13.482893    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz" event={"ID":"98d8cbc8-7949-41af-b9c8-e1fd0a2d8699","Type":"ContainerDied","Data":"07915d8620f8858514c1c4dc1271936d97b5899b9c8920849037ba6dac22363c"}
Sep 11 05:04:13.482986 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:13.482916    2554 scope.go:117] "RemoveContainer" containerID="905085e1e5e67c2d81f86b23dd3f09b81b3cbaf77d5262906f19a3756c0d1c49"
Sep 11 05:04:13.492041 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:13.492020    2554 scope.go:117] "RemoveContainer" containerID="905085e1e5e67c2d81f86b23dd3f09b81b3cbaf77d5262906f19a3756c0d1c49"
Sep 11 05:04:13.492435 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:04:13.492408    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"905085e1e5e67c2d81f86b23dd3f09b81b3cbaf77d5262906f19a3756c0d1c49\": container with ID starting with 905085e1e5e67c2d81f86b23dd3f09b81b3cbaf77d5262906f19a3756c0d1c49 not found: ID does not exist" containerID="905085e1e5e67c2d81f86b23dd3f09b81b3cbaf77d5262906f19a3756c0d1c49"
Sep 11 05:04:13.492485 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:13.492448    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"905085e1e5e67c2d81f86b23dd3f09b81b3cbaf77d5262906f19a3756c0d1c49"} err="failed to get container status \"905085e1e5e67c2d81f86b23dd3f09b81b3cbaf77d5262906f19a3756c0d1c49\": rpc error: code = NotFound desc = could not find container \"905085e1e5e67c2d81f86b23dd3f09b81b3cbaf77d5262906f19a3756c0d1c49\": container with ID starting with 905085e1e5e67c2d81f86b23dd3f09b81b3cbaf77d5262906f19a3756c0d1c49 not found: ID does not exist"
Sep 11 05:04:13.504712 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:13.504680    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz"]
Sep 11 05:04:13.513286 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:13.513254    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f5e6f7-58dbb5b859-pm5nz"]
Sep 11 05:04:14.814471 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:14.814441    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98d8cbc8-7949-41af-b9c8-e1fd0a2d8699" path="/var/lib/kubelet/pods/98d8cbc8-7949-41af-b9c8-e1fd0a2d8699/volumes"
Sep 11 05:04:17.298144 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:17.298106    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:04:22.542821 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.542790    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"]
Sep 11 05:04:22.543432 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.543412    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c603e922-0f16-4f7d-aaab-6d9c1a54a35f" containerName="maas-api"
Sep 11 05:04:22.543540 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.543434    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c603e922-0f16-4f7d-aaab-6d9c1a54a35f" containerName="maas-api"
Sep 11 05:04:22.543540 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.543450    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" containerName="istio-proxy"
Sep 11 05:04:22.543540 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.543458    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" containerName="istio-proxy"
Sep 11 05:04:22.543540 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.543470    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" containerName="istio-proxy"
Sep 11 05:04:22.543540 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.543479    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" containerName="istio-proxy"
Sep 11 05:04:22.543540 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.543487    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0018c96-f391-491e-8317-b94999c5b54d" containerName="payload-processing"
Sep 11 05:04:22.543540 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.543497    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0018c96-f391-491e-8317-b94999c5b54d" containerName="payload-processing"
Sep 11 05:04:22.543540 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.543516    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98d8cbc8-7949-41af-b9c8-e1fd0a2d8699" containerName="payload-processing"
Sep 11 05:04:22.543540 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.543523    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="98d8cbc8-7949-41af-b9c8-e1fd0a2d8699" containerName="payload-processing"
Sep 11 05:04:22.543540 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.543544    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca3ffab6-d195-44c4-a45d-2f0fdae13d7d" containerName="maas-api"
Sep 11 05:04:22.544076 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.543552    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca3ffab6-d195-44c4-a45d-2f0fdae13d7d" containerName="maas-api"
Sep 11 05:04:22.544076 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.543667    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" containerName="istio-proxy"
Sep 11 05:04:22.544076 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.543677    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0018c96-f391-491e-8317-b94999c5b54d" containerName="payload-processing"
Sep 11 05:04:22.544076 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.543690    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="98d8cbc8-7949-41af-b9c8-e1fd0a2d8699" containerName="payload-processing"
Sep 11 05:04:22.544076 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.543701    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c603e922-0f16-4f7d-aaab-6d9c1a54a35f" containerName="maas-api"
Sep 11 05:04:22.544076 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.543710    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca3ffab6-d195-44c4-a45d-2f0fdae13d7d" containerName="maas-api"
Sep 11 05:04:22.548028 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.548008    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.550227 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.550205    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-909c76-openshift-default-dockercfg-cjq4c\""
Sep 11 05:04:22.557275 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.557247    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"]
Sep 11 05:04:22.653639 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.653603    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-workload-certs\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.653838 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.653679    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-token\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.653838 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.653733    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-credential-socket\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.653838 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.653786    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8969a317-921b-498d-87eb-79b7a5bd22e1-istiod-ca-cert\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.654002 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.653864    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-podinfo\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.654002 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.653888    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmtx8\" (UniqueName: \"kubernetes.io/projected/8969a317-921b-498d-87eb-79b7a5bd22e1-kube-api-access-vmtx8\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.654002 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.653928    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-workload-socket\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.654002 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.653962    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-data\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.654002 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.653999    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-envoy\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.755287 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.755256    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-podinfo\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.755287 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.755289    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmtx8\" (UniqueName: \"kubernetes.io/projected/8969a317-921b-498d-87eb-79b7a5bd22e1-kube-api-access-vmtx8\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.755581 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.755319    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-workload-socket\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.755581 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.755376    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-data\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.755581 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.755413    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-envoy\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.755581 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.755437    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-workload-certs\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.755581 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.755462    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-token\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.755581 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.755494    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-credential-socket\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.755581 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.755527    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8969a317-921b-498d-87eb-79b7a5bd22e1-istiod-ca-cert\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.755929 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.755805    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-workload-socket\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.755929 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.755832    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-workload-certs\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.755929 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.755897    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-data\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.756112 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.756006    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-credential-socket\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.756175 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.756145    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8969a317-921b-498d-87eb-79b7a5bd22e1-istiod-ca-cert\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.757888 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.757862    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-envoy\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.758265 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.758249    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-podinfo\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.763030 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.763004    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-token\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.763128 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.763097    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmtx8\" (UniqueName: \"kubernetes.io/projected/8969a317-921b-498d-87eb-79b7a5bd22e1-kube-api-access-vmtx8\") pod \"e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") " pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:22.860121 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:22.860036    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:23.139035 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:23.139012    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"]
Sep 11 05:04:23.141561 ip-10-0-143-244 kubenswrapper[2554]: W0911 05:04:23.141533    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8969a317_921b_498d_87eb_79b7a5bd22e1.slice/crio-3a612486a4fb286e85844ef6292ca6b419704da83f5631a22621ad5951c0816b WatchSource:0}: Error finding container 3a612486a4fb286e85844ef6292ca6b419704da83f5631a22621ad5951c0816b: Status 404 returned error can't find the container with id 3a612486a4fb286e85844ef6292ca6b419704da83f5631a22621ad5951c0816b
Sep 11 05:04:23.143851 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:23.143816    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 05:04:23.143963 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:23.143901    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 05:04:23.143963 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:23.143946    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 05:04:23.543627 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:23.543590    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx" event={"ID":"8969a317-921b-498d-87eb-79b7a5bd22e1","Type":"ContainerStarted","Data":"c1f1d7217d2ff6402efc9e18e7a6644757b894ae2f140942bd71d2ed51240a4f"}
Sep 11 05:04:23.544012 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:23.543651    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx" event={"ID":"8969a317-921b-498d-87eb-79b7a5bd22e1","Type":"ContainerStarted","Data":"3a612486a4fb286e85844ef6292ca6b419704da83f5631a22621ad5951c0816b"}
Sep 11 05:04:23.560285 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:23.560237    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx" podStartSLOduration=1.5602187170000001 podStartE2EDuration="1.560218717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:04:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:04:23.559371643 +0000 UTC m=+1453.212631324" watchObservedRunningTime="2026-09-11 05:04:23.560218717 +0000 UTC m=+1453.213478399"
Sep 11 05:04:23.860950 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:23.860869    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:24.867043 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:24.867016    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:25.555134 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:25.555099    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:25.556096 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:25.556078    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:27.117855 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.117819    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55"]
Sep 11 05:04:27.118369 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.118353    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c64b7fe0-4eaf-42fe-9c54-92d6e8d16648" containerName="istio-proxy"
Sep 11 05:04:27.121686 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.121671    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55"
Sep 11 05:04:27.126215 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.126191    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-909c76-dockercfg-87rwk\""
Sep 11 05:04:27.126385 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.126191    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-909c76\""
Sep 11 05:04:27.136915 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.136888    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55"]
Sep 11 05:04:27.152309 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.152276    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4"]
Sep 11 05:04:27.155917 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.155895    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4"
Sep 11 05:04:27.165682 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.165656    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4"]
Sep 11 05:04:27.201393 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.201317    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab1e6089-5963-43d1-8682-486fadbc1f42-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55\" (UID: \"ab1e6089-5963-43d1-8682-486fadbc1f42\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55"
Sep 11 05:04:27.201596 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.201448    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgzh2\" (UniqueName: \"kubernetes.io/projected/ab1e6089-5963-43d1-8682-486fadbc1f42-kube-api-access-wgzh2\") pod \"payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55\" (UID: \"ab1e6089-5963-43d1-8682-486fadbc1f42\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55"
Sep 11 05:04:27.303029 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.302984    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab1e6089-5963-43d1-8682-486fadbc1f42-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55\" (UID: \"ab1e6089-5963-43d1-8682-486fadbc1f42\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55"
Sep 11 05:04:27.303029 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.303029    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxck7\" (UniqueName: \"kubernetes.io/projected/1bdff62b-2a84-48b9-b554-0242a39a9aa1-kube-api-access-xxck7\") pod \"payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4\" (UID: \"1bdff62b-2a84-48b9-b554-0242a39a9aa1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4"
Sep 11 05:04:27.303299 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.303080    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgzh2\" (UniqueName: \"kubernetes.io/projected/ab1e6089-5963-43d1-8682-486fadbc1f42-kube-api-access-wgzh2\") pod \"payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55\" (UID: \"ab1e6089-5963-43d1-8682-486fadbc1f42\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55"
Sep 11 05:04:27.303299 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.303220    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bdff62b-2a84-48b9-b554-0242a39a9aa1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4\" (UID: \"1bdff62b-2a84-48b9-b554-0242a39a9aa1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4"
Sep 11 05:04:27.303727 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.303707    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab1e6089-5963-43d1-8682-486fadbc1f42-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55\" (UID: \"ab1e6089-5963-43d1-8682-486fadbc1f42\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55"
Sep 11 05:04:27.311568 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.311541    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgzh2\" (UniqueName: \"kubernetes.io/projected/ab1e6089-5963-43d1-8682-486fadbc1f42-kube-api-access-wgzh2\") pod \"payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55\" (UID: \"ab1e6089-5963-43d1-8682-486fadbc1f42\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55"
Sep 11 05:04:27.404046 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.403942    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bdff62b-2a84-48b9-b554-0242a39a9aa1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4\" (UID: \"1bdff62b-2a84-48b9-b554-0242a39a9aa1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4"
Sep 11 05:04:27.404046 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.404017    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxck7\" (UniqueName: \"kubernetes.io/projected/1bdff62b-2a84-48b9-b554-0242a39a9aa1-kube-api-access-xxck7\") pod \"payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4\" (UID: \"1bdff62b-2a84-48b9-b554-0242a39a9aa1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4"
Sep 11 05:04:27.404733 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.404707    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bdff62b-2a84-48b9-b554-0242a39a9aa1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4\" (UID: \"1bdff62b-2a84-48b9-b554-0242a39a9aa1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4"
Sep 11 05:04:27.411457 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.411434    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxck7\" (UniqueName: \"kubernetes.io/projected/1bdff62b-2a84-48b9-b554-0242a39a9aa1-kube-api-access-xxck7\") pod \"payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4\" (UID: \"1bdff62b-2a84-48b9-b554-0242a39a9aa1\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4"
Sep 11 05:04:27.432401 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.432366    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55"
Sep 11 05:04:27.468911 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.468868    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4"
Sep 11 05:04:27.707598 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.707561    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55"]
Sep 11 05:04:27.708405 ip-10-0-143-244 kubenswrapper[2554]: W0911 05:04:27.708377    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab1e6089_5963_43d1_8682_486fadbc1f42.slice/crio-db194f501a09e8ee940cc4b67c67f1ee02b5d0bb7b641e6382d17f49d1f29612 WatchSource:0}: Error finding container db194f501a09e8ee940cc4b67c67f1ee02b5d0bb7b641e6382d17f49d1f29612: Status 404 returned error can't find the container with id db194f501a09e8ee940cc4b67c67f1ee02b5d0bb7b641e6382d17f49d1f29612
Sep 11 05:04:27.764488 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:27.764459    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4"]
Sep 11 05:04:27.766186 ip-10-0-143-244 kubenswrapper[2554]: W0911 05:04:27.766158    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bdff62b_2a84_48b9_b554_0242a39a9aa1.slice/crio-ba2b204d6965cb2743ab920b8d0f4b878797ef76083f8d78c5108bce9f88ea52 WatchSource:0}: Error finding container ba2b204d6965cb2743ab920b8d0f4b878797ef76083f8d78c5108bce9f88ea52: Status 404 returned error can't find the container with id ba2b204d6965cb2743ab920b8d0f4b878797ef76083f8d78c5108bce9f88ea52
Sep 11 05:04:28.573344 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:28.573301    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55" event={"ID":"ab1e6089-5963-43d1-8682-486fadbc1f42","Type":"ContainerStarted","Data":"abfbb9b102a06ae910e6ffb72024f12d80df6d7457f4a0f57698a7725dcbf1c3"}
Sep 11 05:04:28.573795 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:28.573434    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55"
Sep 11 05:04:28.573795 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:28.573460    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55" event={"ID":"ab1e6089-5963-43d1-8682-486fadbc1f42","Type":"ContainerStarted","Data":"db194f501a09e8ee940cc4b67c67f1ee02b5d0bb7b641e6382d17f49d1f29612"}
Sep 11 05:04:28.574942 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:28.574916    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4" event={"ID":"1bdff62b-2a84-48b9-b554-0242a39a9aa1","Type":"ContainerStarted","Data":"74cb5f2da89a1ea15209d6255ec6bad7795d328571863082565df719c22368de"}
Sep 11 05:04:28.575048 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:28.574966    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4" event={"ID":"1bdff62b-2a84-48b9-b554-0242a39a9aa1","Type":"ContainerStarted","Data":"ba2b204d6965cb2743ab920b8d0f4b878797ef76083f8d78c5108bce9f88ea52"}
Sep 11 05:04:28.575048 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:28.575027    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4"
Sep 11 05:04:28.591014 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:28.590968    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55" podStartSLOduration=1.5909540039999999 podStartE2EDuration="1.590954004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:04:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:04:28.588755948 +0000 UTC m=+1458.242015627" watchObservedRunningTime="2026-09-11 05:04:28.590954004 +0000 UTC m=+1458.244213683"
Sep 11 05:04:28.605852 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:28.605797    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4" podStartSLOduration=1.605781683 podStartE2EDuration="1.605781683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:04:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:04:28.604448038 +0000 UTC m=+1458.257707719" watchObservedRunningTime="2026-09-11 05:04:28.605781683 +0000 UTC m=+1458.259041366"
Sep 11 05:04:30.146318 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:30.146283    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl"]
Sep 11 05:04:30.146848 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:30.146813    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl" podUID="9135b9fc-a163-485e-b413-1e8abdd6c5c0" containerName="payload-pre-processing" containerID="cri-o://bf6f65647f0fe678e540b7754b384dfd7af0f4b527ad778614c56ed6077a1711" gracePeriod=30
Sep 11 05:04:30.420907 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:30.420884    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl"
Sep 11 05:04:30.536543 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:30.536501    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9135b9fc-a163-485e-b413-1e8abdd6c5c0-plugins-config-volume\") pod \"9135b9fc-a163-485e-b413-1e8abdd6c5c0\" (UID: \"9135b9fc-a163-485e-b413-1e8abdd6c5c0\") "
Sep 11 05:04:30.536722 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:30.536562    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qln9b\" (UniqueName: \"kubernetes.io/projected/9135b9fc-a163-485e-b413-1e8abdd6c5c0-kube-api-access-qln9b\") pod \"9135b9fc-a163-485e-b413-1e8abdd6c5c0\" (UID: \"9135b9fc-a163-485e-b413-1e8abdd6c5c0\") "
Sep 11 05:04:30.536953 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:30.536926    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9135b9fc-a163-485e-b413-1e8abdd6c5c0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9135b9fc-a163-485e-b413-1e8abdd6c5c0" (UID: "9135b9fc-a163-485e-b413-1e8abdd6c5c0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 05:04:30.538826 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:30.538799    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9135b9fc-a163-485e-b413-1e8abdd6c5c0-kube-api-access-qln9b" (OuterVolumeSpecName: "kube-api-access-qln9b") pod "9135b9fc-a163-485e-b413-1e8abdd6c5c0" (UID: "9135b9fc-a163-485e-b413-1e8abdd6c5c0"). InnerVolumeSpecName "kube-api-access-qln9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:04:30.587546 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:30.587515    2554 generic.go:356] "Generic (PLEG): container finished" podID="9135b9fc-a163-485e-b413-1e8abdd6c5c0" containerID="bf6f65647f0fe678e540b7754b384dfd7af0f4b527ad778614c56ed6077a1711" exitCode=0
Sep 11 05:04:30.587714 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:30.587558    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl"
Sep 11 05:04:30.587714 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:30.587560    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl" event={"ID":"9135b9fc-a163-485e-b413-1e8abdd6c5c0","Type":"ContainerDied","Data":"bf6f65647f0fe678e540b7754b384dfd7af0f4b527ad778614c56ed6077a1711"}
Sep 11 05:04:30.587714 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:30.587665    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl" event={"ID":"9135b9fc-a163-485e-b413-1e8abdd6c5c0","Type":"ContainerDied","Data":"32286f0ca91a13b5073bc45a68ac738c774bf8877788f911bd4fd333541f4e47"}
Sep 11 05:04:30.587714 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:30.587685    2554 scope.go:117] "RemoveContainer" containerID="bf6f65647f0fe678e540b7754b384dfd7af0f4b527ad778614c56ed6077a1711"
Sep 11 05:04:30.597275 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:30.597256    2554 scope.go:117] "RemoveContainer" containerID="bf6f65647f0fe678e540b7754b384dfd7af0f4b527ad778614c56ed6077a1711"
Sep 11 05:04:30.597599 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:04:30.597582    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf6f65647f0fe678e540b7754b384dfd7af0f4b527ad778614c56ed6077a1711\": container with ID starting with bf6f65647f0fe678e540b7754b384dfd7af0f4b527ad778614c56ed6077a1711 not found: ID does not exist" containerID="bf6f65647f0fe678e540b7754b384dfd7af0f4b527ad778614c56ed6077a1711"
Sep 11 05:04:30.597656 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:30.597607    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf6f65647f0fe678e540b7754b384dfd7af0f4b527ad778614c56ed6077a1711"} err="failed to get container status \"bf6f65647f0fe678e540b7754b384dfd7af0f4b527ad778614c56ed6077a1711\": rpc error: code = NotFound desc = could not find container \"bf6f65647f0fe678e540b7754b384dfd7af0f4b527ad778614c56ed6077a1711\": container with ID starting with bf6f65647f0fe678e540b7754b384dfd7af0f4b527ad778614c56ed6077a1711 not found: ID does not exist"
Sep 11 05:04:30.607997 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:30.607974    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl"]
Sep 11 05:04:30.611766 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:30.611745    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f81bf2-789bc7497d-nqftl"]
Sep 11 05:04:30.638015 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:30.637987    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9135b9fc-a163-485e-b413-1e8abdd6c5c0-plugins-config-volume\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:04:30.638015 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:30.638010    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qln9b\" (UniqueName: \"kubernetes.io/projected/9135b9fc-a163-485e-b413-1e8abdd6c5c0-kube-api-access-qln9b\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:04:30.814194 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:30.814153    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9135b9fc-a163-485e-b413-1e8abdd6c5c0" path="/var/lib/kubelet/pods/9135b9fc-a163-485e-b413-1e8abdd6c5c0/volumes"
Sep 11 05:04:31.009711 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:31.009674    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:04:39.582384 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:39.582319    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55"
Sep 11 05:04:39.582752 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:39.582526    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4"
Sep 11 05:04:40.558598 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:40.557496    2554 patch_prober.go:28] interesting pod/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 05:04:40.558598 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:40.557566    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx" podUID="8969a317-921b-498d-87eb-79b7a5bd22e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 05:04:40.665912 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:40.665875    2554 generic.go:356] "Generic (PLEG): container finished" podID="8969a317-921b-498d-87eb-79b7a5bd22e1" containerID="c1f1d7217d2ff6402efc9e18e7a6644757b894ae2f140942bd71d2ed51240a4f" exitCode=0
Sep 11 05:04:40.666283 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:40.665952    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx" event={"ID":"8969a317-921b-498d-87eb-79b7a5bd22e1","Type":"ContainerDied","Data":"c1f1d7217d2ff6402efc9e18e7a6644757b894ae2f140942bd71d2ed51240a4f"}
Sep 11 05:04:40.666402 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:40.666387    2554 scope.go:117] "RemoveContainer" containerID="c1f1d7217d2ff6402efc9e18e7a6644757b894ae2f140942bd71d2ed51240a4f"
Sep 11 05:04:40.667501 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:40.667468    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 05:04:40.667563 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:40.667543    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 05:04:40.667599 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:40.667572    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 05:04:41.672836 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:41.672801    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx" event={"ID":"8969a317-921b-498d-87eb-79b7a5bd22e1","Type":"ContainerStarted","Data":"cc30fc6fadf6d1fd2b2593451193975a8862407880cfa6dc8c14b3de406006fa"}
Sep 11 05:04:41.860535 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:41.860500    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:41.860789 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:41.860766    2554 patch_prober.go:28] interesting pod/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 05:04:41.860836 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:41.860819    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx" podUID="8969a317-921b-498d-87eb-79b7a5bd22e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 05:04:42.861166 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:42.861126    2554 patch_prober.go:28] interesting pod/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 05:04:42.861694 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:42.861199    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx" podUID="8969a317-921b-498d-87eb-79b7a5bd22e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 05:04:43.860633 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:43.860595    2554 patch_prober.go:28] interesting pod/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 05:04:43.860815 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:43.860651    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx" podUID="8969a317-921b-498d-87eb-79b7a5bd22e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 05:04:44.861218 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:44.861177    2554 patch_prober.go:28] interesting pod/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 05:04:44.861671 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:44.861243    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx" podUID="8969a317-921b-498d-87eb-79b7a5bd22e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 05:04:45.492808 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:45.492777    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:04:45.860981 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:45.860887    2554 patch_prober.go:28] interesting pod/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 05:04:45.860981 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:45.860947    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx" podUID="8969a317-921b-498d-87eb-79b7a5bd22e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 05:04:46.860677 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:46.860642    2554 patch_prober.go:28] interesting pod/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 05:04:46.861059 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:46.860710    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx" podUID="8969a317-921b-498d-87eb-79b7a5bd22e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 05:04:47.864620 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:47.864589    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:47.865075 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:47.864962    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:04:47.865592 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:04:47.865574    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:05:01.896199 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:01.896163    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:05:32.002218 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:32.002125    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:05:48.200366 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:48.200318    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:05:54.446370 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:54.446320    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4_1bdff62b-2a84-48b9-b554-0242a39a9aa1/payload-processing/0.log"
Sep 11 05:05:59.656197 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:59.656154    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"]
Sep 11 05:05:59.656978 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:59.656934    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9135b9fc-a163-485e-b413-1e8abdd6c5c0" containerName="payload-pre-processing"
Sep 11 05:05:59.657162 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:59.657146    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9135b9fc-a163-485e-b413-1e8abdd6c5c0" containerName="payload-pre-processing"
Sep 11 05:05:59.657808 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:59.657466    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9135b9fc-a163-485e-b413-1e8abdd6c5c0" containerName="payload-pre-processing"
Sep 11 05:05:59.661800 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:59.661780    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"
Sep 11 05:05:59.663843 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:59.663818    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-d69099-serving-cert\""
Sep 11 05:05:59.663843 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:59.663833    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-74gzc\""
Sep 11 05:05:59.671501 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:59.671477    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"]
Sep 11 05:05:59.724621 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:59.724582    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0210828-30e6-4c21-af57-fd4846a09a64-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887\" (UID: \"b0210828-30e6-4c21-af57-fd4846a09a64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"
Sep 11 05:05:59.724800 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:59.724644    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz7df\" (UniqueName: \"kubernetes.io/projected/b0210828-30e6-4c21-af57-fd4846a09a64-kube-api-access-cz7df\") pod \"maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887\" (UID: \"b0210828-30e6-4c21-af57-fd4846a09a64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"
Sep 11 05:05:59.724800 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:59.724678    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0210828-30e6-4c21-af57-fd4846a09a64-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887\" (UID: \"b0210828-30e6-4c21-af57-fd4846a09a64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"
Sep 11 05:05:59.724800 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:59.724723    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0210828-30e6-4c21-af57-fd4846a09a64-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887\" (UID: \"b0210828-30e6-4c21-af57-fd4846a09a64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"
Sep 11 05:05:59.826216 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:59.826178    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz7df\" (UniqueName: \"kubernetes.io/projected/b0210828-30e6-4c21-af57-fd4846a09a64-kube-api-access-cz7df\") pod \"maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887\" (UID: \"b0210828-30e6-4c21-af57-fd4846a09a64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"
Sep 11 05:05:59.826460 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:59.826230    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0210828-30e6-4c21-af57-fd4846a09a64-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887\" (UID: \"b0210828-30e6-4c21-af57-fd4846a09a64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"
Sep 11 05:05:59.826460 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:59.826320    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0210828-30e6-4c21-af57-fd4846a09a64-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887\" (UID: \"b0210828-30e6-4c21-af57-fd4846a09a64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"
Sep 11 05:05:59.826460 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:05:59.826364    2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-serving-cert: secret "maas-api-e2e-ipp-cleanup-d69099-serving-cert" not found
Sep 11 05:05:59.826460 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:05:59.826448    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0210828-30e6-4c21-af57-fd4846a09a64-maas-api-tls podName:b0210828-30e6-4c21-af57-fd4846a09a64 nodeName:}" failed. No retries permitted until 2026-09-11 05:06:00.326426486 +0000 UTC m=+1549.979686143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b0210828-30e6-4c21-af57-fd4846a09a64-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887" (UID: "b0210828-30e6-4c21-af57-fd4846a09a64") : secret "maas-api-e2e-ipp-cleanup-d69099-serving-cert" not found
Sep 11 05:05:59.826715 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:59.826510    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0210828-30e6-4c21-af57-fd4846a09a64-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887\" (UID: \"b0210828-30e6-4c21-af57-fd4846a09a64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"
Sep 11 05:05:59.827073 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:59.827054    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0210828-30e6-4c21-af57-fd4846a09a64-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887\" (UID: \"b0210828-30e6-4c21-af57-fd4846a09a64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"
Sep 11 05:05:59.828875 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:59.828857    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0210828-30e6-4c21-af57-fd4846a09a64-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887\" (UID: \"b0210828-30e6-4c21-af57-fd4846a09a64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"
Sep 11 05:05:59.834753 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:05:59.834734    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz7df\" (UniqueName: \"kubernetes.io/projected/b0210828-30e6-4c21-af57-fd4846a09a64-kube-api-access-cz7df\") pod \"maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887\" (UID: \"b0210828-30e6-4c21-af57-fd4846a09a64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"
Sep 11 05:06:00.330319 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:00.330286    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0210828-30e6-4c21-af57-fd4846a09a64-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887\" (UID: \"b0210828-30e6-4c21-af57-fd4846a09a64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"
Sep 11 05:06:00.332771 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:00.332753    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0210828-30e6-4c21-af57-fd4846a09a64-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887\" (UID: \"b0210828-30e6-4c21-af57-fd4846a09a64\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"
Sep 11 05:06:00.574734 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:00.574696    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"
Sep 11 05:06:00.851046 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:00.851016    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"]
Sep 11 05:06:00.853360 ip-10-0-143-244 kubenswrapper[2554]: W0911 05:06:00.853312    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0210828_30e6_4c21_af57_fd4846a09a64.slice/crio-2bc4c36152c2ca4b98a6bbe66c0e2c74961fd919583b40974ce055d31832dd76 WatchSource:0}: Error finding container 2bc4c36152c2ca4b98a6bbe66c0e2c74961fd919583b40974ce055d31832dd76: Status 404 returned error can't find the container with id 2bc4c36152c2ca4b98a6bbe66c0e2c74961fd919583b40974ce055d31832dd76
Sep 11 05:06:00.854760 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:00.854741    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 05:06:01.128795 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:01.128717    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887" event={"ID":"b0210828-30e6-4c21-af57-fd4846a09a64","Type":"ContainerStarted","Data":"2bc4c36152c2ca4b98a6bbe66c0e2c74961fd919583b40974ce055d31832dd76"}
Sep 11 05:06:02.137694 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:02.137656    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887" event={"ID":"b0210828-30e6-4c21-af57-fd4846a09a64","Type":"ContainerStarted","Data":"3936210fb2910b5c6682caf7fd625e21bf30d6b664cf89e4103eb57d96205a4c"}
Sep 11 05:06:02.138083 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:02.137817    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"
Sep 11 05:06:02.156017 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:02.155964    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887" podStartSLOduration=2.60551574 podStartE2EDuration="3.155942651s" totalImagesPullingTime="550.426911ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:05:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:06:02.152764177 +0000 UTC m=+1551.806023855" watchObservedRunningTime="2026-09-11 05:06:02.155942651 +0000 UTC m=+1551.809202331"
Sep 11 05:06:07.604131 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:07.604096    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:06:08.149292 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:08.149266    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"
Sep 11 05:06:11.021032 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:11.020995    2554 scope.go:117] "RemoveContainer" containerID="0c6f4c478fcbf581b399e432a9400aa99fb9ac55d99f57c14654550f8b9cc545"
Sep 11 05:06:30.133279 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:30.133239    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"]
Sep 11 05:06:30.133844 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:30.133507    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887" podUID="b0210828-30e6-4c21-af57-fd4846a09a64" containerName="maas-api" containerID="cri-o://3936210fb2910b5c6682caf7fd625e21bf30d6b664cf89e4103eb57d96205a4c" gracePeriod=30
Sep 11 05:06:30.294527 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:30.294491    2554 generic.go:356] "Generic (PLEG): container finished" podID="b0210828-30e6-4c21-af57-fd4846a09a64" containerID="3936210fb2910b5c6682caf7fd625e21bf30d6b664cf89e4103eb57d96205a4c" exitCode=0
Sep 11 05:06:30.294696 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:30.294566    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887" event={"ID":"b0210828-30e6-4c21-af57-fd4846a09a64","Type":"ContainerDied","Data":"3936210fb2910b5c6682caf7fd625e21bf30d6b664cf89e4103eb57d96205a4c"}
Sep 11 05:06:30.403431 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:30.403406    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"
Sep 11 05:06:30.535536 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:30.535500    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cz7df\" (UniqueName: \"kubernetes.io/projected/b0210828-30e6-4c21-af57-fd4846a09a64-kube-api-access-cz7df\") pod \"b0210828-30e6-4c21-af57-fd4846a09a64\" (UID: \"b0210828-30e6-4c21-af57-fd4846a09a64\") "
Sep 11 05:06:30.535536 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:30.535538    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0210828-30e6-4c21-af57-fd4846a09a64-metrics-certs\") pod \"b0210828-30e6-4c21-af57-fd4846a09a64\" (UID: \"b0210828-30e6-4c21-af57-fd4846a09a64\") "
Sep 11 05:06:30.535780 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:30.535613    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0210828-30e6-4c21-af57-fd4846a09a64-openshift-service-ca\") pod \"b0210828-30e6-4c21-af57-fd4846a09a64\" (UID: \"b0210828-30e6-4c21-af57-fd4846a09a64\") "
Sep 11 05:06:30.535780 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:30.535688    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0210828-30e6-4c21-af57-fd4846a09a64-maas-api-tls\") pod \"b0210828-30e6-4c21-af57-fd4846a09a64\" (UID: \"b0210828-30e6-4c21-af57-fd4846a09a64\") "
Sep 11 05:06:30.536010 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:30.535979    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0210828-30e6-4c21-af57-fd4846a09a64-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b0210828-30e6-4c21-af57-fd4846a09a64" (UID: "b0210828-30e6-4c21-af57-fd4846a09a64"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 05:06:30.536156 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:30.536082    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0210828-30e6-4c21-af57-fd4846a09a64-openshift-service-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:06:30.537916 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:30.537891    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0210828-30e6-4c21-af57-fd4846a09a64-kube-api-access-cz7df" (OuterVolumeSpecName: "kube-api-access-cz7df") pod "b0210828-30e6-4c21-af57-fd4846a09a64" (UID: "b0210828-30e6-4c21-af57-fd4846a09a64"). InnerVolumeSpecName "kube-api-access-cz7df". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:06:30.538008 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:30.537927    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0210828-30e6-4c21-af57-fd4846a09a64-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b0210828-30e6-4c21-af57-fd4846a09a64" (UID: "b0210828-30e6-4c21-af57-fd4846a09a64"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 05:06:30.538008 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:30.537942    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0210828-30e6-4c21-af57-fd4846a09a64-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b0210828-30e6-4c21-af57-fd4846a09a64" (UID: "b0210828-30e6-4c21-af57-fd4846a09a64"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 05:06:30.636903 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:30.636816    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b0210828-30e6-4c21-af57-fd4846a09a64-maas-api-tls\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:06:30.636903 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:30.636848    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cz7df\" (UniqueName: \"kubernetes.io/projected/b0210828-30e6-4c21-af57-fd4846a09a64-kube-api-access-cz7df\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:06:30.636903 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:30.636858    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b0210828-30e6-4c21-af57-fd4846a09a64-metrics-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:06:31.301346 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:31.301298    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"
Sep 11 05:06:31.301346 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:31.301339    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887" event={"ID":"b0210828-30e6-4c21-af57-fd4846a09a64","Type":"ContainerDied","Data":"2bc4c36152c2ca4b98a6bbe66c0e2c74961fd919583b40974ce055d31832dd76"}
Sep 11 05:06:31.301896 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:31.301411    2554 scope.go:117] "RemoveContainer" containerID="3936210fb2910b5c6682caf7fd625e21bf30d6b664cf89e4103eb57d96205a4c"
Sep 11 05:06:31.316535 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:31.316508    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"]
Sep 11 05:06:31.320462 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:31.320436    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d69099-5dbb75774b-m5887"]
Sep 11 05:06:32.814029 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:32.813999    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0210828-30e6-4c21-af57-fd4846a09a64" path="/var/lib/kubelet/pods/b0210828-30e6-4c21-af57-fd4846a09a64/volumes"
Sep 11 05:06:35.093871 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:35.093831    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:06:52.997891 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:52.997847    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:06:55.471907 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:55.471819    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4"]
Sep 11 05:06:55.472445 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:55.472080    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4" podUID="1bdff62b-2a84-48b9-b554-0242a39a9aa1" containerName="payload-processing" containerID="cri-o://74cb5f2da89a1ea15209d6255ec6bad7795d328571863082565df719c22368de" gracePeriod=30
Sep 11 05:06:55.479956 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:55.479926    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55"]
Sep 11 05:06:55.480726 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:55.480181    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55" podUID="ab1e6089-5963-43d1-8682-486fadbc1f42" containerName="payload-pre-processing" containerID="cri-o://abfbb9b102a06ae910e6ffb72024f12d80df6d7457f4a0f57698a7725dcbf1c3" gracePeriod=30
Sep 11 05:06:55.756577 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:55.756552    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4"
Sep 11 05:06:55.794663 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:55.794633    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55"
Sep 11 05:06:55.879910 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:55.879873    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgzh2\" (UniqueName: \"kubernetes.io/projected/ab1e6089-5963-43d1-8682-486fadbc1f42-kube-api-access-wgzh2\") pod \"ab1e6089-5963-43d1-8682-486fadbc1f42\" (UID: \"ab1e6089-5963-43d1-8682-486fadbc1f42\") "
Sep 11 05:06:55.880114 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:55.879954    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxck7\" (UniqueName: \"kubernetes.io/projected/1bdff62b-2a84-48b9-b554-0242a39a9aa1-kube-api-access-xxck7\") pod \"1bdff62b-2a84-48b9-b554-0242a39a9aa1\" (UID: \"1bdff62b-2a84-48b9-b554-0242a39a9aa1\") "
Sep 11 05:06:55.880114 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:55.879977    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bdff62b-2a84-48b9-b554-0242a39a9aa1-plugins-config-volume\") pod \"1bdff62b-2a84-48b9-b554-0242a39a9aa1\" (UID: \"1bdff62b-2a84-48b9-b554-0242a39a9aa1\") "
Sep 11 05:06:55.880114 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:55.880009    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab1e6089-5963-43d1-8682-486fadbc1f42-plugins-config-volume\") pod \"ab1e6089-5963-43d1-8682-486fadbc1f42\" (UID: \"ab1e6089-5963-43d1-8682-486fadbc1f42\") "
Sep 11 05:06:55.880421 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:55.880389    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bdff62b-2a84-48b9-b554-0242a39a9aa1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1bdff62b-2a84-48b9-b554-0242a39a9aa1" (UID: "1bdff62b-2a84-48b9-b554-0242a39a9aa1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 05:06:55.880549 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:55.880470    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab1e6089-5963-43d1-8682-486fadbc1f42-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ab1e6089-5963-43d1-8682-486fadbc1f42" (UID: "ab1e6089-5963-43d1-8682-486fadbc1f42"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 05:06:55.882260 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:55.882238    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bdff62b-2a84-48b9-b554-0242a39a9aa1-kube-api-access-xxck7" (OuterVolumeSpecName: "kube-api-access-xxck7") pod "1bdff62b-2a84-48b9-b554-0242a39a9aa1" (UID: "1bdff62b-2a84-48b9-b554-0242a39a9aa1"). InnerVolumeSpecName "kube-api-access-xxck7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:06:55.882260 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:55.882248    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab1e6089-5963-43d1-8682-486fadbc1f42-kube-api-access-wgzh2" (OuterVolumeSpecName: "kube-api-access-wgzh2") pod "ab1e6089-5963-43d1-8682-486fadbc1f42" (UID: "ab1e6089-5963-43d1-8682-486fadbc1f42"). InnerVolumeSpecName "kube-api-access-wgzh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:06:55.982105 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:55.982023    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxck7\" (UniqueName: \"kubernetes.io/projected/1bdff62b-2a84-48b9-b554-0242a39a9aa1-kube-api-access-xxck7\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:06:55.982105 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:55.982057    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1bdff62b-2a84-48b9-b554-0242a39a9aa1-plugins-config-volume\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:06:55.982105 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:55.982067    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab1e6089-5963-43d1-8682-486fadbc1f42-plugins-config-volume\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:06:55.982105 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:55.982078    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgzh2\" (UniqueName: \"kubernetes.io/projected/ab1e6089-5963-43d1-8682-486fadbc1f42-kube-api-access-wgzh2\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:06:56.439429 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.439394    2554 generic.go:356] "Generic (PLEG): container finished" podID="ab1e6089-5963-43d1-8682-486fadbc1f42" containerID="abfbb9b102a06ae910e6ffb72024f12d80df6d7457f4a0f57698a7725dcbf1c3" exitCode=0
Sep 11 05:06:56.439640 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.439441    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55"
Sep 11 05:06:56.439640 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.439486    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55" event={"ID":"ab1e6089-5963-43d1-8682-486fadbc1f42","Type":"ContainerDied","Data":"abfbb9b102a06ae910e6ffb72024f12d80df6d7457f4a0f57698a7725dcbf1c3"}
Sep 11 05:06:56.439640 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.439545    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55" event={"ID":"ab1e6089-5963-43d1-8682-486fadbc1f42","Type":"ContainerDied","Data":"db194f501a09e8ee940cc4b67c67f1ee02b5d0bb7b641e6382d17f49d1f29612"}
Sep 11 05:06:56.439640 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.439575    2554 scope.go:117] "RemoveContainer" containerID="abfbb9b102a06ae910e6ffb72024f12d80df6d7457f4a0f57698a7725dcbf1c3"
Sep 11 05:06:56.440955 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.440937    2554 generic.go:356] "Generic (PLEG): container finished" podID="1bdff62b-2a84-48b9-b554-0242a39a9aa1" containerID="74cb5f2da89a1ea15209d6255ec6bad7795d328571863082565df719c22368de" exitCode=0
Sep 11 05:06:56.441035 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.440983    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4"
Sep 11 05:06:56.441092 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.441036    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4" event={"ID":"1bdff62b-2a84-48b9-b554-0242a39a9aa1","Type":"ContainerDied","Data":"74cb5f2da89a1ea15209d6255ec6bad7795d328571863082565df719c22368de"}
Sep 11 05:06:56.441143 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.441095    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4" event={"ID":"1bdff62b-2a84-48b9-b554-0242a39a9aa1","Type":"ContainerDied","Data":"ba2b204d6965cb2743ab920b8d0f4b878797ef76083f8d78c5108bce9f88ea52"}
Sep 11 05:06:56.449604 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.449582    2554 scope.go:117] "RemoveContainer" containerID="abfbb9b102a06ae910e6ffb72024f12d80df6d7457f4a0f57698a7725dcbf1c3"
Sep 11 05:06:56.449959 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:06:56.449939    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abfbb9b102a06ae910e6ffb72024f12d80df6d7457f4a0f57698a7725dcbf1c3\": container with ID starting with abfbb9b102a06ae910e6ffb72024f12d80df6d7457f4a0f57698a7725dcbf1c3 not found: ID does not exist" containerID="abfbb9b102a06ae910e6ffb72024f12d80df6d7457f4a0f57698a7725dcbf1c3"
Sep 11 05:06:56.450040 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.449967    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abfbb9b102a06ae910e6ffb72024f12d80df6d7457f4a0f57698a7725dcbf1c3"} err="failed to get container status \"abfbb9b102a06ae910e6ffb72024f12d80df6d7457f4a0f57698a7725dcbf1c3\": rpc error: code = NotFound desc = could not find container \"abfbb9b102a06ae910e6ffb72024f12d80df6d7457f4a0f57698a7725dcbf1c3\": container with ID starting with abfbb9b102a06ae910e6ffb72024f12d80df6d7457f4a0f57698a7725dcbf1c3 not found: ID does not exist"
Sep 11 05:06:56.450040 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.449983    2554 scope.go:117] "RemoveContainer" containerID="74cb5f2da89a1ea15209d6255ec6bad7795d328571863082565df719c22368de"
Sep 11 05:06:56.458971 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.458954    2554 scope.go:117] "RemoveContainer" containerID="74cb5f2da89a1ea15209d6255ec6bad7795d328571863082565df719c22368de"
Sep 11 05:06:56.459259 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:06:56.459239    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74cb5f2da89a1ea15209d6255ec6bad7795d328571863082565df719c22368de\": container with ID starting with 74cb5f2da89a1ea15209d6255ec6bad7795d328571863082565df719c22368de not found: ID does not exist" containerID="74cb5f2da89a1ea15209d6255ec6bad7795d328571863082565df719c22368de"
Sep 11 05:06:56.459350 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.459270    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74cb5f2da89a1ea15209d6255ec6bad7795d328571863082565df719c22368de"} err="failed to get container status \"74cb5f2da89a1ea15209d6255ec6bad7795d328571863082565df719c22368de\": rpc error: code = NotFound desc = could not find container \"74cb5f2da89a1ea15209d6255ec6bad7795d328571863082565df719c22368de\": container with ID starting with 74cb5f2da89a1ea15209d6255ec6bad7795d328571863082565df719c22368de not found: ID does not exist"
Sep 11 05:06:56.464000 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.463976    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55"]
Sep 11 05:06:56.467789 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.467766    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-909c76-ffc8d4d4b-65d55"]
Sep 11 05:06:56.477382 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.477361    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4"]
Sep 11 05:06:56.483146 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.483126    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-909c76-665f6d9c89-gltl4"]
Sep 11 05:06:56.815023 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.814939    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bdff62b-2a84-48b9-b554-0242a39a9aa1" path="/var/lib/kubelet/pods/1bdff62b-2a84-48b9-b554-0242a39a9aa1/volumes"
Sep 11 05:06:56.815343 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:06:56.815313    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab1e6089-5963-43d1-8682-486fadbc1f42" path="/var/lib/kubelet/pods/ab1e6089-5963-43d1-8682-486fadbc1f42/volumes"
Sep 11 05:07:05.793108 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:05.793027    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:07:43.523987 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:43.523947    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"]
Sep 11 05:07:43.524636 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:43.524224    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx" podUID="8969a317-921b-498d-87eb-79b7a5bd22e1" containerName="istio-proxy" containerID="cri-o://cc30fc6fadf6d1fd2b2593451193975a8862407880cfa6dc8c14b3de406006fa" gracePeriod=30
Sep 11 05:07:47.867832 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:47.867789    2554 patch_prober.go:28] interesting pod/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 05:07:47.868234 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:47.867870    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx" podUID="8969a317-921b-498d-87eb-79b7a5bd22e1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 05:07:48.731762 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.731723    2554 generic.go:356] "Generic (PLEG): container finished" podID="8969a317-921b-498d-87eb-79b7a5bd22e1" containerID="cc30fc6fadf6d1fd2b2593451193975a8862407880cfa6dc8c14b3de406006fa" exitCode=0
Sep 11 05:07:48.731915 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.731790    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx" event={"ID":"8969a317-921b-498d-87eb-79b7a5bd22e1","Type":"ContainerDied","Data":"cc30fc6fadf6d1fd2b2593451193975a8862407880cfa6dc8c14b3de406006fa"}
Sep 11 05:07:48.731915 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.731856    2554 scope.go:117] "RemoveContainer" containerID="c1f1d7217d2ff6402efc9e18e7a6644757b894ae2f140942bd71d2ed51240a4f"
Sep 11 05:07:48.793953 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.793893    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:07:48.907605 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.907574    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8969a317-921b-498d-87eb-79b7a5bd22e1-istiod-ca-cert\") pod \"8969a317-921b-498d-87eb-79b7a5bd22e1\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") "
Sep 11 05:07:48.908207 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.907720    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-workload-socket\") pod \"8969a317-921b-498d-87eb-79b7a5bd22e1\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") "
Sep 11 05:07:48.908207 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.907775    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmtx8\" (UniqueName: \"kubernetes.io/projected/8969a317-921b-498d-87eb-79b7a5bd22e1-kube-api-access-vmtx8\") pod \"8969a317-921b-498d-87eb-79b7a5bd22e1\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") "
Sep 11 05:07:48.908207 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.907809    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-token\") pod \"8969a317-921b-498d-87eb-79b7a5bd22e1\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") "
Sep 11 05:07:48.908207 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.907847    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-podinfo\") pod \"8969a317-921b-498d-87eb-79b7a5bd22e1\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") "
Sep 11 05:07:48.908207 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.907885    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-credential-socket\") pod \"8969a317-921b-498d-87eb-79b7a5bd22e1\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") "
Sep 11 05:07:48.908207 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.907970    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-data\") pod \"8969a317-921b-498d-87eb-79b7a5bd22e1\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") "
Sep 11 05:07:48.908207 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.908020    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-workload-certs\") pod \"8969a317-921b-498d-87eb-79b7a5bd22e1\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") "
Sep 11 05:07:48.908207 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.908027    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8969a317-921b-498d-87eb-79b7a5bd22e1" (UID: "8969a317-921b-498d-87eb-79b7a5bd22e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:07:48.908207 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.908027    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8969a317-921b-498d-87eb-79b7a5bd22e1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8969a317-921b-498d-87eb-79b7a5bd22e1" (UID: "8969a317-921b-498d-87eb-79b7a5bd22e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 05:07:48.908207 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.908046    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-envoy\") pod \"8969a317-921b-498d-87eb-79b7a5bd22e1\" (UID: \"8969a317-921b-498d-87eb-79b7a5bd22e1\") "
Sep 11 05:07:48.908993 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.908263    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-data" (OuterVolumeSpecName: "istio-data") pod "8969a317-921b-498d-87eb-79b7a5bd22e1" (UID: "8969a317-921b-498d-87eb-79b7a5bd22e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:07:48.908993 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.908279    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8969a317-921b-498d-87eb-79b7a5bd22e1" (UID: "8969a317-921b-498d-87eb-79b7a5bd22e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:07:48.908993 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.908376    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8969a317-921b-498d-87eb-79b7a5bd22e1" (UID: "8969a317-921b-498d-87eb-79b7a5bd22e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:07:48.908993 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.908500    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-credential-socket\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:07:48.908993 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.908517    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-data\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:07:48.908993 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.908533    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-workload-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:07:48.908993 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.908546    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8969a317-921b-498d-87eb-79b7a5bd22e1-istiod-ca-cert\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:07:48.908993 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.908558    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-workload-socket\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:07:48.910289 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.910257    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8969a317-921b-498d-87eb-79b7a5bd22e1" (UID: "8969a317-921b-498d-87eb-79b7a5bd22e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 05:07:48.910552 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.910525    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8969a317-921b-498d-87eb-79b7a5bd22e1" (UID: "8969a317-921b-498d-87eb-79b7a5bd22e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:07:48.910788 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.910768    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "8969a317-921b-498d-87eb-79b7a5bd22e1" (UID: "8969a317-921b-498d-87eb-79b7a5bd22e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:07:48.910859 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:48.910795    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8969a317-921b-498d-87eb-79b7a5bd22e1-kube-api-access-vmtx8" (OuterVolumeSpecName: "kube-api-access-vmtx8") pod "8969a317-921b-498d-87eb-79b7a5bd22e1" (UID: "8969a317-921b-498d-87eb-79b7a5bd22e1"). InnerVolumeSpecName "kube-api-access-vmtx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:07:49.009735 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:49.009699    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmtx8\" (UniqueName: \"kubernetes.io/projected/8969a317-921b-498d-87eb-79b7a5bd22e1-kube-api-access-vmtx8\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:07:49.009735 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:49.009730    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-token\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:07:49.009735 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:49.009739    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-podinfo\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:07:49.009976 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:49.009747    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8969a317-921b-498d-87eb-79b7a5bd22e1-istio-envoy\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:07:49.739458 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:49.739423    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx" event={"ID":"8969a317-921b-498d-87eb-79b7a5bd22e1","Type":"ContainerDied","Data":"3a612486a4fb286e85844ef6292ca6b419704da83f5631a22621ad5951c0816b"}
Sep 11 05:07:49.739458 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:49.739453    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"
Sep 11 05:07:49.739685 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:49.739487    2554 scope.go:117] "RemoveContainer" containerID="cc30fc6fadf6d1fd2b2593451193975a8862407880cfa6dc8c14b3de406006fa"
Sep 11 05:07:49.762868 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:49.762817    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"]
Sep 11 05:07:49.765737 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:49.765712    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-909c76-openshift-default-74cd875b94-kkbpx"]
Sep 11 05:07:50.813760 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:50.813727    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8969a317-921b-498d-87eb-79b7a5bd22e1" path="/var/lib/kubelet/pods/8969a317-921b-498d-87eb-79b7a5bd22e1/volumes"
Sep 11 05:07:58.002810 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:07:58.002774    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:08:12.052908 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:12.052870    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt"]
Sep 11 05:08:12.053393 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:12.053118    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt" podUID="b91d50ba-50cc-4990-8409-c42bebd0d7ab" containerName="payload-pre-processing" containerID="cri-o://089ce7612009769ef5b90bf501ad1f28b11bbe33dd04191cbb806539df8b60fe" gracePeriod=30
Sep 11 05:08:12.334553 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:12.334521    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt"
Sep 11 05:08:12.446159 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:12.446125    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b91d50ba-50cc-4990-8409-c42bebd0d7ab-plugins-config-volume\") pod \"b91d50ba-50cc-4990-8409-c42bebd0d7ab\" (UID: \"b91d50ba-50cc-4990-8409-c42bebd0d7ab\") "
Sep 11 05:08:12.446385 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:12.446175    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll88n\" (UniqueName: \"kubernetes.io/projected/b91d50ba-50cc-4990-8409-c42bebd0d7ab-kube-api-access-ll88n\") pod \"b91d50ba-50cc-4990-8409-c42bebd0d7ab\" (UID: \"b91d50ba-50cc-4990-8409-c42bebd0d7ab\") "
Sep 11 05:08:12.446555 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:12.446533    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b91d50ba-50cc-4990-8409-c42bebd0d7ab-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b91d50ba-50cc-4990-8409-c42bebd0d7ab" (UID: "b91d50ba-50cc-4990-8409-c42bebd0d7ab"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 05:08:12.448543 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:12.448517    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b91d50ba-50cc-4990-8409-c42bebd0d7ab-kube-api-access-ll88n" (OuterVolumeSpecName: "kube-api-access-ll88n") pod "b91d50ba-50cc-4990-8409-c42bebd0d7ab" (UID: "b91d50ba-50cc-4990-8409-c42bebd0d7ab"). InnerVolumeSpecName "kube-api-access-ll88n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:08:12.547523 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:12.547484    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b91d50ba-50cc-4990-8409-c42bebd0d7ab-plugins-config-volume\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:08:12.547523 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:12.547517    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll88n\" (UniqueName: \"kubernetes.io/projected/b91d50ba-50cc-4990-8409-c42bebd0d7ab-kube-api-access-ll88n\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:08:12.868696 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:12.868662    2554 generic.go:356] "Generic (PLEG): container finished" podID="b91d50ba-50cc-4990-8409-c42bebd0d7ab" containerID="089ce7612009769ef5b90bf501ad1f28b11bbe33dd04191cbb806539df8b60fe" exitCode=0
Sep 11 05:08:12.868901 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:12.868720    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt"
Sep 11 05:08:12.868901 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:12.868761    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt" event={"ID":"b91d50ba-50cc-4990-8409-c42bebd0d7ab","Type":"ContainerDied","Data":"089ce7612009769ef5b90bf501ad1f28b11bbe33dd04191cbb806539df8b60fe"}
Sep 11 05:08:12.868901 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:12.868825    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt" event={"ID":"b91d50ba-50cc-4990-8409-c42bebd0d7ab","Type":"ContainerDied","Data":"acb5a0a62f39385d7814a4d143923992dcbadbcbd21a41cf8900a3716eae185e"}
Sep 11 05:08:12.868901 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:12.868856    2554 scope.go:117] "RemoveContainer" containerID="089ce7612009769ef5b90bf501ad1f28b11bbe33dd04191cbb806539df8b60fe"
Sep 11 05:08:12.877791 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:12.877771    2554 scope.go:117] "RemoveContainer" containerID="089ce7612009769ef5b90bf501ad1f28b11bbe33dd04191cbb806539df8b60fe"
Sep 11 05:08:12.878083 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:08:12.878062    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"089ce7612009769ef5b90bf501ad1f28b11bbe33dd04191cbb806539df8b60fe\": container with ID starting with 089ce7612009769ef5b90bf501ad1f28b11bbe33dd04191cbb806539df8b60fe not found: ID does not exist" containerID="089ce7612009769ef5b90bf501ad1f28b11bbe33dd04191cbb806539df8b60fe"
Sep 11 05:08:12.878153 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:12.878096    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"089ce7612009769ef5b90bf501ad1f28b11bbe33dd04191cbb806539df8b60fe"} err="failed to get container status \"089ce7612009769ef5b90bf501ad1f28b11bbe33dd04191cbb806539df8b60fe\": rpc error: code = NotFound desc = could not find container \"089ce7612009769ef5b90bf501ad1f28b11bbe33dd04191cbb806539df8b60fe\": container with ID starting with 089ce7612009769ef5b90bf501ad1f28b11bbe33dd04191cbb806539df8b60fe not found: ID does not exist"
Sep 11 05:08:12.884478 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:12.884451    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt"]
Sep 11 05:08:12.886484 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:12.886462    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-c1858a-6f776c5f86-vntxt"]
Sep 11 05:08:14.801112 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:14.801075    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:08:14.814140 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:14.814111    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b91d50ba-50cc-4990-8409-c42bebd0d7ab" path="/var/lib/kubelet/pods/b91d50ba-50cc-4990-8409-c42bebd0d7ab/volumes"
Sep 11 05:08:18.708185 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:18.708152    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"]
Sep 11 05:08:18.708702 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:18.708416    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6" podUID="789566f4-0b05-41ab-bfbc-e628b6c23f95" containerName="istio-proxy" containerID="cri-o://731a2d42e019d69c8db90f468364569f5df7dbe0c444cef6e679fca514c5f104" gracePeriod=30
Sep 11 05:08:19.297625 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:19.297590    2554 patch_prober.go:28] interesting pod/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 05:08:19.297789 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:19.297661    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6" podUID="789566f4-0b05-41ab-bfbc-e628b6c23f95" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 05:08:23.930581 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:23.930548    2554 generic.go:356] "Generic (PLEG): container finished" podID="789566f4-0b05-41ab-bfbc-e628b6c23f95" containerID="731a2d42e019d69c8db90f468364569f5df7dbe0c444cef6e679fca514c5f104" exitCode=0
Sep 11 05:08:23.930940 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:23.930613    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6" event={"ID":"789566f4-0b05-41ab-bfbc-e628b6c23f95","Type":"ContainerDied","Data":"731a2d42e019d69c8db90f468364569f5df7dbe0c444cef6e679fca514c5f104"}
Sep 11 05:08:23.930940 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:23.930677    2554 scope.go:117] "RemoveContainer" containerID="25ad39f526a401b7667539fe5229a01b91488328f7494d678d28c30feae38d33"
Sep 11 05:08:23.968094 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:23.968071    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 05:08:24.056936 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.056835    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-credential-socket\") pod \"789566f4-0b05-41ab-bfbc-e628b6c23f95\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") "
Sep 11 05:08:24.056936 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.056902    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-workload-socket\") pod \"789566f4-0b05-41ab-bfbc-e628b6c23f95\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") "
Sep 11 05:08:24.056936 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.056929    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-token\") pod \"789566f4-0b05-41ab-bfbc-e628b6c23f95\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") "
Sep 11 05:08:24.057233 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.056960    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/789566f4-0b05-41ab-bfbc-e628b6c23f95-istiod-ca-cert\") pod \"789566f4-0b05-41ab-bfbc-e628b6c23f95\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") "
Sep 11 05:08:24.057233 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.057010    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-podinfo\") pod \"789566f4-0b05-41ab-bfbc-e628b6c23f95\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") "
Sep 11 05:08:24.057233 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.057046    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-workload-certs\") pod \"789566f4-0b05-41ab-bfbc-e628b6c23f95\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") "
Sep 11 05:08:24.057233 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.057067    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-envoy\") pod \"789566f4-0b05-41ab-bfbc-e628b6c23f95\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") "
Sep 11 05:08:24.057233 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.057085    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-data\") pod \"789566f4-0b05-41ab-bfbc-e628b6c23f95\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") "
Sep 11 05:08:24.057233 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.057115    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvntb\" (UniqueName: \"kubernetes.io/projected/789566f4-0b05-41ab-bfbc-e628b6c23f95-kube-api-access-vvntb\") pod \"789566f4-0b05-41ab-bfbc-e628b6c23f95\" (UID: \"789566f4-0b05-41ab-bfbc-e628b6c23f95\") "
Sep 11 05:08:24.057233 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.057186    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "789566f4-0b05-41ab-bfbc-e628b6c23f95" (UID: "789566f4-0b05-41ab-bfbc-e628b6c23f95"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:08:24.057643 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.057314    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "789566f4-0b05-41ab-bfbc-e628b6c23f95" (UID: "789566f4-0b05-41ab-bfbc-e628b6c23f95"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:08:24.057643 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.057452    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "789566f4-0b05-41ab-bfbc-e628b6c23f95" (UID: "789566f4-0b05-41ab-bfbc-e628b6c23f95"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:08:24.057643 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.057577    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-data" (OuterVolumeSpecName: "istio-data") pod "789566f4-0b05-41ab-bfbc-e628b6c23f95" (UID: "789566f4-0b05-41ab-bfbc-e628b6c23f95"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:08:24.057643 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.057608    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-workload-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:08:24.057643 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.057632    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-credential-socket\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:08:24.058062 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.057648    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-workload-socket\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:08:24.058062 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.057728    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/789566f4-0b05-41ab-bfbc-e628b6c23f95-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "789566f4-0b05-41ab-bfbc-e628b6c23f95" (UID: "789566f4-0b05-41ab-bfbc-e628b6c23f95"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 05:08:24.059596 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.059560    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "789566f4-0b05-41ab-bfbc-e628b6c23f95" (UID: "789566f4-0b05-41ab-bfbc-e628b6c23f95"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 05:08:24.059596 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.059573    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-token" (OuterVolumeSpecName: "istio-token") pod "789566f4-0b05-41ab-bfbc-e628b6c23f95" (UID: "789566f4-0b05-41ab-bfbc-e628b6c23f95"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:08:24.059788 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.059608    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "789566f4-0b05-41ab-bfbc-e628b6c23f95" (UID: "789566f4-0b05-41ab-bfbc-e628b6c23f95"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 05:08:24.059788 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.059611    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/789566f4-0b05-41ab-bfbc-e628b6c23f95-kube-api-access-vvntb" (OuterVolumeSpecName: "kube-api-access-vvntb") pod "789566f4-0b05-41ab-bfbc-e628b6c23f95" (UID: "789566f4-0b05-41ab-bfbc-e628b6c23f95"). InnerVolumeSpecName "kube-api-access-vvntb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:08:24.158615 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.158574    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvntb\" (UniqueName: \"kubernetes.io/projected/789566f4-0b05-41ab-bfbc-e628b6c23f95-kube-api-access-vvntb\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:08:24.158615 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.158609    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-token\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:08:24.158615 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.158620    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/789566f4-0b05-41ab-bfbc-e628b6c23f95-istiod-ca-cert\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:08:24.158615 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.158628    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-podinfo\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:08:24.158883 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.158659    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-envoy\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:08:24.158883 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.158672    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/789566f4-0b05-41ab-bfbc-e628b6c23f95-istio-data\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:08:24.937037 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.937005    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6" event={"ID":"789566f4-0b05-41ab-bfbc-e628b6c23f95","Type":"ContainerDied","Data":"c20ddba1be565745caf58e6de73a1ce0580645495d129edfb1a539f223c8f441"}
Sep 11 05:08:24.937524 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.937068    2554 scope.go:117] "RemoveContainer" containerID="731a2d42e019d69c8db90f468364569f5df7dbe0c444cef6e679fca514c5f104"
Sep 11 05:08:24.937524 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.937019    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"
Sep 11 05:08:24.954285 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.954258    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"]
Sep 11 05:08:24.958519 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:24.958497    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-c1858a-openshift-default-dc4c7ffb8-72qj6"]
Sep 11 05:08:26.814036 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:26.814004    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="789566f4-0b05-41ab-bfbc-e628b6c23f95" path="/var/lib/kubelet/pods/789566f4-0b05-41ab-bfbc-e628b6c23f95/volumes"
Sep 11 05:08:29.443158 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.443120    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-16b799-29818380-l26xs"]
Sep 11 05:08:29.445169 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.445147    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-16b799-29818380-l26xs"]
Sep 11 05:08:29.467499 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.467464    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw"]
Sep 11 05:08:29.467738 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.467708    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw" podUID="148610a5-7f17-4ff2-a473-40fb4138e244" containerName="payload-processing" containerID="cri-o://2d98c6fda22ed1e0e989c05c4b015dfe735b60f7cae045816b1704d4176cb574" gracePeriod=30
Sep 11 05:08:29.474642 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.474069    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x"]
Sep 11 05:08:29.474642 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.474307    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x" podUID="c19bab4a-f4d5-4271-860f-c1a0858d49ac" containerName="payload-pre-processing" containerID="cri-o://63dd1ce02dbbf0e4516e7c6dbd2b62df1c634121afee69f65bb877e27e1d2558" gracePeriod=30
Sep 11 05:08:29.764676 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.764651    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw"
Sep 11 05:08:29.767952 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.767928    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x"
Sep 11 05:08:29.914430 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.914389    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qpcd\" (UniqueName: \"kubernetes.io/projected/c19bab4a-f4d5-4271-860f-c1a0858d49ac-kube-api-access-7qpcd\") pod \"c19bab4a-f4d5-4271-860f-c1a0858d49ac\" (UID: \"c19bab4a-f4d5-4271-860f-c1a0858d49ac\") "
Sep 11 05:08:29.914644 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.914441    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c19bab4a-f4d5-4271-860f-c1a0858d49ac-plugins-config-volume\") pod \"c19bab4a-f4d5-4271-860f-c1a0858d49ac\" (UID: \"c19bab4a-f4d5-4271-860f-c1a0858d49ac\") "
Sep 11 05:08:29.914644 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.914477    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8cvv\" (UniqueName: \"kubernetes.io/projected/148610a5-7f17-4ff2-a473-40fb4138e244-kube-api-access-x8cvv\") pod \"148610a5-7f17-4ff2-a473-40fb4138e244\" (UID: \"148610a5-7f17-4ff2-a473-40fb4138e244\") "
Sep 11 05:08:29.914644 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.914534    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/148610a5-7f17-4ff2-a473-40fb4138e244-plugins-config-volume\") pod \"148610a5-7f17-4ff2-a473-40fb4138e244\" (UID: \"148610a5-7f17-4ff2-a473-40fb4138e244\") "
Sep 11 05:08:29.914936 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.914902    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c19bab4a-f4d5-4271-860f-c1a0858d49ac-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c19bab4a-f4d5-4271-860f-c1a0858d49ac" (UID: "c19bab4a-f4d5-4271-860f-c1a0858d49ac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 05:08:29.914983 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.914930    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/148610a5-7f17-4ff2-a473-40fb4138e244-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "148610a5-7f17-4ff2-a473-40fb4138e244" (UID: "148610a5-7f17-4ff2-a473-40fb4138e244"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 05:08:29.917282 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.917255    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c19bab4a-f4d5-4271-860f-c1a0858d49ac-kube-api-access-7qpcd" (OuterVolumeSpecName: "kube-api-access-7qpcd") pod "c19bab4a-f4d5-4271-860f-c1a0858d49ac" (UID: "c19bab4a-f4d5-4271-860f-c1a0858d49ac"). InnerVolumeSpecName "kube-api-access-7qpcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:08:29.917282 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.917269    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/148610a5-7f17-4ff2-a473-40fb4138e244-kube-api-access-x8cvv" (OuterVolumeSpecName: "kube-api-access-x8cvv") pod "148610a5-7f17-4ff2-a473-40fb4138e244" (UID: "148610a5-7f17-4ff2-a473-40fb4138e244"). InnerVolumeSpecName "kube-api-access-x8cvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:08:29.964497 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.964462    2554 generic.go:356] "Generic (PLEG): container finished" podID="148610a5-7f17-4ff2-a473-40fb4138e244" containerID="2d98c6fda22ed1e0e989c05c4b015dfe735b60f7cae045816b1704d4176cb574" exitCode=0
Sep 11 05:08:29.964687 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.964506    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw"
Sep 11 05:08:29.964687 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.964548    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw" event={"ID":"148610a5-7f17-4ff2-a473-40fb4138e244","Type":"ContainerDied","Data":"2d98c6fda22ed1e0e989c05c4b015dfe735b60f7cae045816b1704d4176cb574"}
Sep 11 05:08:29.964687 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.964614    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw" event={"ID":"148610a5-7f17-4ff2-a473-40fb4138e244","Type":"ContainerDied","Data":"080b498fe0b96db60f6d638f8f61500f2feac17fce57c3fd3356496993430c60"}
Sep 11 05:08:29.964687 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.964647    2554 scope.go:117] "RemoveContainer" containerID="2d98c6fda22ed1e0e989c05c4b015dfe735b60f7cae045816b1704d4176cb574"
Sep 11 05:08:29.965979 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.965947    2554 generic.go:356] "Generic (PLEG): container finished" podID="c19bab4a-f4d5-4271-860f-c1a0858d49ac" containerID="63dd1ce02dbbf0e4516e7c6dbd2b62df1c634121afee69f65bb877e27e1d2558" exitCode=0
Sep 11 05:08:29.966101 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.965978    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x" event={"ID":"c19bab4a-f4d5-4271-860f-c1a0858d49ac","Type":"ContainerDied","Data":"63dd1ce02dbbf0e4516e7c6dbd2b62df1c634121afee69f65bb877e27e1d2558"}
Sep 11 05:08:29.966101 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.966031    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x" event={"ID":"c19bab4a-f4d5-4271-860f-c1a0858d49ac","Type":"ContainerDied","Data":"da15ec432c72285d060ae6131f82b183f7cd2ae6cbc9e825c0b7796a858881a8"}
Sep 11 05:08:29.966101 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.965987    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x"
Sep 11 05:08:29.974406 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.974386    2554 scope.go:117] "RemoveContainer" containerID="2d98c6fda22ed1e0e989c05c4b015dfe735b60f7cae045816b1704d4176cb574"
Sep 11 05:08:29.974741 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:08:29.974713    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d98c6fda22ed1e0e989c05c4b015dfe735b60f7cae045816b1704d4176cb574\": container with ID starting with 2d98c6fda22ed1e0e989c05c4b015dfe735b60f7cae045816b1704d4176cb574 not found: ID does not exist" containerID="2d98c6fda22ed1e0e989c05c4b015dfe735b60f7cae045816b1704d4176cb574"
Sep 11 05:08:29.974828 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.974753    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d98c6fda22ed1e0e989c05c4b015dfe735b60f7cae045816b1704d4176cb574"} err="failed to get container status \"2d98c6fda22ed1e0e989c05c4b015dfe735b60f7cae045816b1704d4176cb574\": rpc error: code = NotFound desc = could not find container \"2d98c6fda22ed1e0e989c05c4b015dfe735b60f7cae045816b1704d4176cb574\": container with ID starting with 2d98c6fda22ed1e0e989c05c4b015dfe735b60f7cae045816b1704d4176cb574 not found: ID does not exist"
Sep 11 05:08:29.974828 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.974769    2554 scope.go:117] "RemoveContainer" containerID="63dd1ce02dbbf0e4516e7c6dbd2b62df1c634121afee69f65bb877e27e1d2558"
Sep 11 05:08:29.984560 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.984527    2554 scope.go:117] "RemoveContainer" containerID="63dd1ce02dbbf0e4516e7c6dbd2b62df1c634121afee69f65bb877e27e1d2558"
Sep 11 05:08:29.984877 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:08:29.984856    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63dd1ce02dbbf0e4516e7c6dbd2b62df1c634121afee69f65bb877e27e1d2558\": container with ID starting with 63dd1ce02dbbf0e4516e7c6dbd2b62df1c634121afee69f65bb877e27e1d2558 not found: ID does not exist" containerID="63dd1ce02dbbf0e4516e7c6dbd2b62df1c634121afee69f65bb877e27e1d2558"
Sep 11 05:08:29.984946 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.984890    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63dd1ce02dbbf0e4516e7c6dbd2b62df1c634121afee69f65bb877e27e1d2558"} err="failed to get container status \"63dd1ce02dbbf0e4516e7c6dbd2b62df1c634121afee69f65bb877e27e1d2558\": rpc error: code = NotFound desc = could not find container \"63dd1ce02dbbf0e4516e7c6dbd2b62df1c634121afee69f65bb877e27e1d2558\": container with ID starting with 63dd1ce02dbbf0e4516e7c6dbd2b62df1c634121afee69f65bb877e27e1d2558 not found: ID does not exist"
Sep 11 05:08:29.987952 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.987890    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x"]
Sep 11 05:08:29.991051 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:29.991026    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-16b799-5867d8bddb-hqp5x"]
Sep 11 05:08:30.000803 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:30.000774    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw"]
Sep 11 05:08:30.006371 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:30.006343    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-16b799-57c8b86b9c-pctmw"]
Sep 11 05:08:30.015866 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:30.015840    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qpcd\" (UniqueName: \"kubernetes.io/projected/c19bab4a-f4d5-4271-860f-c1a0858d49ac-kube-api-access-7qpcd\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:08:30.015866 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:30.015868    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c19bab4a-f4d5-4271-860f-c1a0858d49ac-plugins-config-volume\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:08:30.016034 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:30.015881    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8cvv\" (UniqueName: \"kubernetes.io/projected/148610a5-7f17-4ff2-a473-40fb4138e244-kube-api-access-x8cvv\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:08:30.016034 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:30.015890    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/148610a5-7f17-4ff2-a473-40fb4138e244-plugins-config-volume\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:08:30.813595 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:30.813519    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="148610a5-7f17-4ff2-a473-40fb4138e244" path="/var/lib/kubelet/pods/148610a5-7f17-4ff2-a473-40fb4138e244/volumes"
Sep 11 05:08:30.813941 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:30.813810    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8819c073-a3a3-4ca0-977b-815a65159f52" path="/var/lib/kubelet/pods/8819c073-a3a3-4ca0-977b-815a65159f52/volumes"
Sep 11 05:08:30.814087 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:30.814075    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c19bab4a-f4d5-4271-860f-c1a0858d49ac" path="/var/lib/kubelet/pods/c19bab4a-f4d5-4271-860f-c1a0858d49ac/volumes"
Sep 11 05:08:32.098396 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:32.098294    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:08:38.510983 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:38.510942    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58cbd59f4-gtc2q"]
Sep 11 05:08:38.511470 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:38.511169    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-58cbd59f4-gtc2q" podUID="f3dff598-a783-4980-bafc-4ae841b4ccea" containerName="manager" containerID="cri-o://84416deb3e99107cc07b197223cd77a9e7c010a84de5dcfd4fba4762d23b6675" gracePeriod=30
Sep 11 05:08:38.760713 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:38.760689    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd59f4-gtc2q"
Sep 11 05:08:38.791516 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:38.791428    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3dff598-a783-4980-bafc-4ae841b4ccea-webhook-cert\") pod \"f3dff598-a783-4980-bafc-4ae841b4ccea\" (UID: \"f3dff598-a783-4980-bafc-4ae841b4ccea\") "
Sep 11 05:08:38.791516 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:38.791488    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3dff598-a783-4980-bafc-4ae841b4ccea-metrics-certs\") pod \"f3dff598-a783-4980-bafc-4ae841b4ccea\" (UID: \"f3dff598-a783-4980-bafc-4ae841b4ccea\") "
Sep 11 05:08:38.791700 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:38.791562    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwr5v\" (UniqueName: \"kubernetes.io/projected/f3dff598-a783-4980-bafc-4ae841b4ccea-kube-api-access-bwr5v\") pod \"f3dff598-a783-4980-bafc-4ae841b4ccea\" (UID: \"f3dff598-a783-4980-bafc-4ae841b4ccea\") "
Sep 11 05:08:38.794512 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:38.794475    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3dff598-a783-4980-bafc-4ae841b4ccea-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f3dff598-a783-4980-bafc-4ae841b4ccea" (UID: "f3dff598-a783-4980-bafc-4ae841b4ccea"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 05:08:38.794771 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:38.794741    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3dff598-a783-4980-bafc-4ae841b4ccea-kube-api-access-bwr5v" (OuterVolumeSpecName: "kube-api-access-bwr5v") pod "f3dff598-a783-4980-bafc-4ae841b4ccea" (UID: "f3dff598-a783-4980-bafc-4ae841b4ccea"). InnerVolumeSpecName "kube-api-access-bwr5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:08:38.794875 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:38.794780    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3dff598-a783-4980-bafc-4ae841b4ccea-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f3dff598-a783-4980-bafc-4ae841b4ccea" (UID: "f3dff598-a783-4980-bafc-4ae841b4ccea"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 05:08:38.892999 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:38.892968    2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f3dff598-a783-4980-bafc-4ae841b4ccea-webhook-cert\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:08:38.892999 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:38.892995    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3dff598-a783-4980-bafc-4ae841b4ccea-metrics-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:08:38.892999 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:38.893007    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwr5v\" (UniqueName: \"kubernetes.io/projected/f3dff598-a783-4980-bafc-4ae841b4ccea-kube-api-access-bwr5v\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:08:39.022379 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:39.022326    2554 generic.go:356] "Generic (PLEG): container finished" podID="f3dff598-a783-4980-bafc-4ae841b4ccea" containerID="84416deb3e99107cc07b197223cd77a9e7c010a84de5dcfd4fba4762d23b6675" exitCode=0
Sep 11 05:08:39.022539 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:39.022400    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd59f4-gtc2q"
Sep 11 05:08:39.022539 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:39.022436    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd59f4-gtc2q" event={"ID":"f3dff598-a783-4980-bafc-4ae841b4ccea","Type":"ContainerDied","Data":"84416deb3e99107cc07b197223cd77a9e7c010a84de5dcfd4fba4762d23b6675"}
Sep 11 05:08:39.022539 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:39.022492    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd59f4-gtc2q" event={"ID":"f3dff598-a783-4980-bafc-4ae841b4ccea","Type":"ContainerDied","Data":"7c54aa80613a8cc311c5c2468fb2f0986d31a52f56b580557fb84f8d8655cbd0"}
Sep 11 05:08:39.022539 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:39.022520    2554 scope.go:117] "RemoveContainer" containerID="84416deb3e99107cc07b197223cd77a9e7c010a84de5dcfd4fba4762d23b6675"
Sep 11 05:08:39.032057 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:39.032036    2554 scope.go:117] "RemoveContainer" containerID="84416deb3e99107cc07b197223cd77a9e7c010a84de5dcfd4fba4762d23b6675"
Sep 11 05:08:39.032369 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:08:39.032348    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84416deb3e99107cc07b197223cd77a9e7c010a84de5dcfd4fba4762d23b6675\": container with ID starting with 84416deb3e99107cc07b197223cd77a9e7c010a84de5dcfd4fba4762d23b6675 not found: ID does not exist" containerID="84416deb3e99107cc07b197223cd77a9e7c010a84de5dcfd4fba4762d23b6675"
Sep 11 05:08:39.032427 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:39.032378    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84416deb3e99107cc07b197223cd77a9e7c010a84de5dcfd4fba4762d23b6675"} err="failed to get container status \"84416deb3e99107cc07b197223cd77a9e7c010a84de5dcfd4fba4762d23b6675\": rpc error: code = NotFound desc = could not find container \"84416deb3e99107cc07b197223cd77a9e7c010a84de5dcfd4fba4762d23b6675\": container with ID starting with 84416deb3e99107cc07b197223cd77a9e7c010a84de5dcfd4fba4762d23b6675 not found: ID does not exist"
Sep 11 05:08:39.038190 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:39.038163    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58cbd59f4-gtc2q"]
Sep 11 05:08:39.041872 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:39.041809    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58cbd59f4-gtc2q"]
Sep 11 05:08:40.813307 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:40.813267    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3dff598-a783-4980-bafc-4ae841b4ccea" path="/var/lib/kubelet/pods/f3dff598-a783-4980-bafc-4ae841b4ccea/volumes"
Sep 11 05:08:40.898142 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:08:40.898104    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:09:11.073483 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:11.073453    2554 scope.go:117] "RemoveContainer" containerID="f18ab919ffa046ba7e41e1de30e9dc959dd60812d1f2d44ebf7ce43892dd441d"
Sep 11 05:09:39.813891 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.813856    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58cbd59f4-c86m9"]
Sep 11 05:09:39.814383 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814266    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab1e6089-5963-43d1-8682-486fadbc1f42" containerName="payload-pre-processing"
Sep 11 05:09:39.814383 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814277    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab1e6089-5963-43d1-8682-486fadbc1f42" containerName="payload-pre-processing"
Sep 11 05:09:39.814383 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814286    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8969a317-921b-498d-87eb-79b7a5bd22e1" containerName="istio-proxy"
Sep 11 05:09:39.814383 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814291    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8969a317-921b-498d-87eb-79b7a5bd22e1" containerName="istio-proxy"
Sep 11 05:09:39.814383 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814300    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bdff62b-2a84-48b9-b554-0242a39a9aa1" containerName="payload-processing"
Sep 11 05:09:39.814383 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814308    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bdff62b-2a84-48b9-b554-0242a39a9aa1" containerName="payload-processing"
Sep 11 05:09:39.814383 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814315    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="789566f4-0b05-41ab-bfbc-e628b6c23f95" containerName="istio-proxy"
Sep 11 05:09:39.814383 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814321    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="789566f4-0b05-41ab-bfbc-e628b6c23f95" containerName="istio-proxy"
Sep 11 05:09:39.814383 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814349    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3dff598-a783-4980-bafc-4ae841b4ccea" containerName="manager"
Sep 11 05:09:39.814383 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814356    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3dff598-a783-4980-bafc-4ae841b4ccea" containerName="manager"
Sep 11 05:09:39.814383 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814362    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b91d50ba-50cc-4990-8409-c42bebd0d7ab" containerName="payload-pre-processing"
Sep 11 05:09:39.814383 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814367    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b91d50ba-50cc-4990-8409-c42bebd0d7ab" containerName="payload-pre-processing"
Sep 11 05:09:39.814383 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814374    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="789566f4-0b05-41ab-bfbc-e628b6c23f95" containerName="istio-proxy"
Sep 11 05:09:39.814383 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814379    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="789566f4-0b05-41ab-bfbc-e628b6c23f95" containerName="istio-proxy"
Sep 11 05:09:39.814383 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814383    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c19bab4a-f4d5-4271-860f-c1a0858d49ac" containerName="payload-pre-processing"
Sep 11 05:09:39.814383 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814389    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c19bab4a-f4d5-4271-860f-c1a0858d49ac" containerName="payload-pre-processing"
Sep 11 05:09:39.815180 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814402    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="148610a5-7f17-4ff2-a473-40fb4138e244" containerName="payload-processing"
Sep 11 05:09:39.815180 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814407    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="148610a5-7f17-4ff2-a473-40fb4138e244" containerName="payload-processing"
Sep 11 05:09:39.815180 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814415    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0210828-30e6-4c21-af57-fd4846a09a64" containerName="maas-api"
Sep 11 05:09:39.815180 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814419    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0210828-30e6-4c21-af57-fd4846a09a64" containerName="maas-api"
Sep 11 05:09:39.815180 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814470    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8969a317-921b-498d-87eb-79b7a5bd22e1" containerName="istio-proxy"
Sep 11 05:09:39.815180 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814477    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c19bab4a-f4d5-4271-860f-c1a0858d49ac" containerName="payload-pre-processing"
Sep 11 05:09:39.815180 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814496    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b91d50ba-50cc-4990-8409-c42bebd0d7ab" containerName="payload-pre-processing"
Sep 11 05:09:39.815180 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814505    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0210828-30e6-4c21-af57-fd4846a09a64" containerName="maas-api"
Sep 11 05:09:39.815180 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814513    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bdff62b-2a84-48b9-b554-0242a39a9aa1" containerName="payload-processing"
Sep 11 05:09:39.815180 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814521    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="789566f4-0b05-41ab-bfbc-e628b6c23f95" containerName="istio-proxy"
Sep 11 05:09:39.815180 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814539    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="148610a5-7f17-4ff2-a473-40fb4138e244" containerName="payload-processing"
Sep 11 05:09:39.815180 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814548    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="789566f4-0b05-41ab-bfbc-e628b6c23f95" containerName="istio-proxy"
Sep 11 05:09:39.815180 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814560    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3dff598-a783-4980-bafc-4ae841b4ccea" containerName="manager"
Sep 11 05:09:39.815180 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.814567    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab1e6089-5963-43d1-8682-486fadbc1f42" containerName="payload-pre-processing"
Sep 11 05:09:39.817860 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.817844    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd59f4-c86m9"
Sep 11 05:09:39.820837 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.820805    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 05:09:39.820975 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.820807    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jxbq2\""
Sep 11 05:09:39.820975 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.820807    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 05:09:39.820975 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.820815    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 05:09:39.827167 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.827146    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58cbd59f4-c86m9"]
Sep 11 05:09:39.876273 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.871049    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk6bq\" (UniqueName: \"kubernetes.io/projected/5ee2ae95-c0cb-424c-8be7-7f4f764e60eb-kube-api-access-xk6bq\") pod \"maas-controller-58cbd59f4-c86m9\" (UID: \"5ee2ae95-c0cb-424c-8be7-7f4f764e60eb\") " pod="opendatahub/maas-controller-58cbd59f4-c86m9"
Sep 11 05:09:39.876273 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.871130    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ee2ae95-c0cb-424c-8be7-7f4f764e60eb-webhook-cert\") pod \"maas-controller-58cbd59f4-c86m9\" (UID: \"5ee2ae95-c0cb-424c-8be7-7f4f764e60eb\") " pod="opendatahub/maas-controller-58cbd59f4-c86m9"
Sep 11 05:09:39.876273 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.871180    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ee2ae95-c0cb-424c-8be7-7f4f764e60eb-metrics-certs\") pod \"maas-controller-58cbd59f4-c86m9\" (UID: \"5ee2ae95-c0cb-424c-8be7-7f4f764e60eb\") " pod="opendatahub/maas-controller-58cbd59f4-c86m9"
Sep 11 05:09:39.971912 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.971870    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk6bq\" (UniqueName: \"kubernetes.io/projected/5ee2ae95-c0cb-424c-8be7-7f4f764e60eb-kube-api-access-xk6bq\") pod \"maas-controller-58cbd59f4-c86m9\" (UID: \"5ee2ae95-c0cb-424c-8be7-7f4f764e60eb\") " pod="opendatahub/maas-controller-58cbd59f4-c86m9"
Sep 11 05:09:39.972112 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.971927    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ee2ae95-c0cb-424c-8be7-7f4f764e60eb-webhook-cert\") pod \"maas-controller-58cbd59f4-c86m9\" (UID: \"5ee2ae95-c0cb-424c-8be7-7f4f764e60eb\") " pod="opendatahub/maas-controller-58cbd59f4-c86m9"
Sep 11 05:09:39.972112 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.971964    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ee2ae95-c0cb-424c-8be7-7f4f764e60eb-metrics-certs\") pod \"maas-controller-58cbd59f4-c86m9\" (UID: \"5ee2ae95-c0cb-424c-8be7-7f4f764e60eb\") " pod="opendatahub/maas-controller-58cbd59f4-c86m9"
Sep 11 05:09:39.974702 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.974672    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ee2ae95-c0cb-424c-8be7-7f4f764e60eb-metrics-certs\") pod \"maas-controller-58cbd59f4-c86m9\" (UID: \"5ee2ae95-c0cb-424c-8be7-7f4f764e60eb\") " pod="opendatahub/maas-controller-58cbd59f4-c86m9"
Sep 11 05:09:39.974812 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.974672    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ee2ae95-c0cb-424c-8be7-7f4f764e60eb-webhook-cert\") pod \"maas-controller-58cbd59f4-c86m9\" (UID: \"5ee2ae95-c0cb-424c-8be7-7f4f764e60eb\") " pod="opendatahub/maas-controller-58cbd59f4-c86m9"
Sep 11 05:09:39.980001 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:39.979971    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk6bq\" (UniqueName: \"kubernetes.io/projected/5ee2ae95-c0cb-424c-8be7-7f4f764e60eb-kube-api-access-xk6bq\") pod \"maas-controller-58cbd59f4-c86m9\" (UID: \"5ee2ae95-c0cb-424c-8be7-7f4f764e60eb\") " pod="opendatahub/maas-controller-58cbd59f4-c86m9"
Sep 11 05:09:40.129217 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:40.129127    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd59f4-c86m9"
Sep 11 05:09:40.400270 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:40.400237    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58cbd59f4-c86m9"]
Sep 11 05:09:40.403265 ip-10-0-143-244 kubenswrapper[2554]: W0911 05:09:40.403239    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee2ae95_c0cb_424c_8be7_7f4f764e60eb.slice/crio-b28fc0c5a5bda595d4aa1e83bbd8ab26c9c81ebf4e4cacd542a35963a9481ffe WatchSource:0}: Error finding container b28fc0c5a5bda595d4aa1e83bbd8ab26c9c81ebf4e4cacd542a35963a9481ffe: Status 404 returned error can't find the container with id b28fc0c5a5bda595d4aa1e83bbd8ab26c9c81ebf4e4cacd542a35963a9481ffe
Sep 11 05:09:41.332110 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:41.332021    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd59f4-c86m9" event={"ID":"5ee2ae95-c0cb-424c-8be7-7f4f764e60eb","Type":"ContainerStarted","Data":"7eae15eebd34c6b062a75a3b67cd72a6d526d44f72392496ee8335dc851d516c"}
Sep 11 05:09:41.332110 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:41.332076    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd59f4-c86m9" event={"ID":"5ee2ae95-c0cb-424c-8be7-7f4f764e60eb","Type":"ContainerStarted","Data":"b28fc0c5a5bda595d4aa1e83bbd8ab26c9c81ebf4e4cacd542a35963a9481ffe"}
Sep 11 05:09:41.332577 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:41.332169    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58cbd59f4-c86m9"
Sep 11 05:09:41.350052 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:41.349995    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58cbd59f4-c86m9" podStartSLOduration=1.7777603100000001 podStartE2EDuration="2.349979712s" totalImagesPullingTime="572.219402ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:09:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:09:41.347121373 +0000 UTC m=+1771.000381079" watchObservedRunningTime="2026-09-11 05:09:41.349979712 +0000 UTC m=+1771.003239391"
Sep 11 05:09:52.339646 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:52.339612    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58cbd59f4-c86m9"
Sep 11 05:09:59.547032 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:59.546996    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58cbd59f4-c86m9"]
Sep 11 05:09:59.547540 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:59.547245    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-58cbd59f4-c86m9" podUID="5ee2ae95-c0cb-424c-8be7-7f4f764e60eb" containerName="manager" containerID="cri-o://7eae15eebd34c6b062a75a3b67cd72a6d526d44f72392496ee8335dc851d516c" gracePeriod=30
Sep 11 05:09:59.803323 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:59.803260    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd59f4-c86m9"
Sep 11 05:09:59.861256 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:59.861226    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xk6bq\" (UniqueName: \"kubernetes.io/projected/5ee2ae95-c0cb-424c-8be7-7f4f764e60eb-kube-api-access-xk6bq\") pod \"5ee2ae95-c0cb-424c-8be7-7f4f764e60eb\" (UID: \"5ee2ae95-c0cb-424c-8be7-7f4f764e60eb\") "
Sep 11 05:09:59.861438 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:59.861278    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ee2ae95-c0cb-424c-8be7-7f4f764e60eb-webhook-cert\") pod \"5ee2ae95-c0cb-424c-8be7-7f4f764e60eb\" (UID: \"5ee2ae95-c0cb-424c-8be7-7f4f764e60eb\") "
Sep 11 05:09:59.861438 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:59.861313    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ee2ae95-c0cb-424c-8be7-7f4f764e60eb-metrics-certs\") pod \"5ee2ae95-c0cb-424c-8be7-7f4f764e60eb\" (UID: \"5ee2ae95-c0cb-424c-8be7-7f4f764e60eb\") "
Sep 11 05:09:59.863672 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:59.863629    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ee2ae95-c0cb-424c-8be7-7f4f764e60eb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5ee2ae95-c0cb-424c-8be7-7f4f764e60eb" (UID: "5ee2ae95-c0cb-424c-8be7-7f4f764e60eb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 05:09:59.863813 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:59.863701    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ee2ae95-c0cb-424c-8be7-7f4f764e60eb-kube-api-access-xk6bq" (OuterVolumeSpecName: "kube-api-access-xk6bq") pod "5ee2ae95-c0cb-424c-8be7-7f4f764e60eb" (UID: "5ee2ae95-c0cb-424c-8be7-7f4f764e60eb"). InnerVolumeSpecName "kube-api-access-xk6bq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:09:59.863813 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:59.863734    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ee2ae95-c0cb-424c-8be7-7f4f764e60eb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5ee2ae95-c0cb-424c-8be7-7f4f764e60eb" (UID: "5ee2ae95-c0cb-424c-8be7-7f4f764e60eb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 05:09:59.962148 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:59.962101    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xk6bq\" (UniqueName: \"kubernetes.io/projected/5ee2ae95-c0cb-424c-8be7-7f4f764e60eb-kube-api-access-xk6bq\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:09:59.962148 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:59.962138    2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ee2ae95-c0cb-424c-8be7-7f4f764e60eb-webhook-cert\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:09:59.962148 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:09:59.962148    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5ee2ae95-c0cb-424c-8be7-7f4f764e60eb-metrics-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:10:00.298545 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:00.298511    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:10:00.431952 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:00.431916    2554 generic.go:356] "Generic (PLEG): container finished" podID="5ee2ae95-c0cb-424c-8be7-7f4f764e60eb" containerID="7eae15eebd34c6b062a75a3b67cd72a6d526d44f72392496ee8335dc851d516c" exitCode=0
Sep 11 05:10:00.432142 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:00.431963    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd59f4-c86m9"
Sep 11 05:10:00.432142 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:00.431959    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd59f4-c86m9" event={"ID":"5ee2ae95-c0cb-424c-8be7-7f4f764e60eb","Type":"ContainerDied","Data":"7eae15eebd34c6b062a75a3b67cd72a6d526d44f72392496ee8335dc851d516c"}
Sep 11 05:10:00.432142 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:00.432026    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd59f4-c86m9" event={"ID":"5ee2ae95-c0cb-424c-8be7-7f4f764e60eb","Type":"ContainerDied","Data":"b28fc0c5a5bda595d4aa1e83bbd8ab26c9c81ebf4e4cacd542a35963a9481ffe"}
Sep 11 05:10:00.432142 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:00.432048    2554 scope.go:117] "RemoveContainer" containerID="7eae15eebd34c6b062a75a3b67cd72a6d526d44f72392496ee8335dc851d516c"
Sep 11 05:10:00.441697 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:00.441671    2554 scope.go:117] "RemoveContainer" containerID="7eae15eebd34c6b062a75a3b67cd72a6d526d44f72392496ee8335dc851d516c"
Sep 11 05:10:00.441980 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:10:00.441959    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eae15eebd34c6b062a75a3b67cd72a6d526d44f72392496ee8335dc851d516c\": container with ID starting with 7eae15eebd34c6b062a75a3b67cd72a6d526d44f72392496ee8335dc851d516c not found: ID does not exist" containerID="7eae15eebd34c6b062a75a3b67cd72a6d526d44f72392496ee8335dc851d516c"
Sep 11 05:10:00.442043 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:00.441990    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eae15eebd34c6b062a75a3b67cd72a6d526d44f72392496ee8335dc851d516c"} err="failed to get container status \"7eae15eebd34c6b062a75a3b67cd72a6d526d44f72392496ee8335dc851d516c\": rpc error: code = NotFound desc = could not find container \"7eae15eebd34c6b062a75a3b67cd72a6d526d44f72392496ee8335dc851d516c\": container with ID starting with 7eae15eebd34c6b062a75a3b67cd72a6d526d44f72392496ee8335dc851d516c not found: ID does not exist"
Sep 11 05:10:00.453755 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:00.453726    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58cbd59f4-c86m9"]
Sep 11 05:10:00.455369 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:00.455348    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58cbd59f4-c86m9"]
Sep 11 05:10:00.813727 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:00.813696    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ee2ae95-c0cb-424c-8be7-7f4f764e60eb" path="/var/lib/kubelet/pods/5ee2ae95-c0cb-424c-8be7-7f4f764e60eb/volumes"
Sep 11 05:10:01.211901 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.211859    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58cbd59f4-9wfkd"]
Sep 11 05:10:01.212503 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.212483    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8969a317-921b-498d-87eb-79b7a5bd22e1" containerName="istio-proxy"
Sep 11 05:10:01.212570 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.212508    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8969a317-921b-498d-87eb-79b7a5bd22e1" containerName="istio-proxy"
Sep 11 05:10:01.212570 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.212549    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ee2ae95-c0cb-424c-8be7-7f4f764e60eb" containerName="manager"
Sep 11 05:10:01.212570 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.212558    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ee2ae95-c0cb-424c-8be7-7f4f764e60eb" containerName="manager"
Sep 11 05:10:01.212670 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.212657    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8969a317-921b-498d-87eb-79b7a5bd22e1" containerName="istio-proxy"
Sep 11 05:10:01.212705 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.212673    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ee2ae95-c0cb-424c-8be7-7f4f764e60eb" containerName="manager"
Sep 11 05:10:01.217548 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.217524    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd59f4-9wfkd"
Sep 11 05:10:01.220825 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.220793    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jxbq2\""
Sep 11 05:10:01.221070 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.221051    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 05:10:01.221286 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.221265    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 05:10:01.221516 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.221496    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 05:10:01.223071 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.223044    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58cbd59f4-9wfkd"]
Sep 11 05:10:01.270080 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.270046    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06d6ebc5-74f1-4061-8e9e-6355d7681a9c-webhook-cert\") pod \"maas-controller-58cbd59f4-9wfkd\" (UID: \"06d6ebc5-74f1-4061-8e9e-6355d7681a9c\") " pod="opendatahub/maas-controller-58cbd59f4-9wfkd"
Sep 11 05:10:01.270264 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.270102    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4gf5\" (UniqueName: \"kubernetes.io/projected/06d6ebc5-74f1-4061-8e9e-6355d7681a9c-kube-api-access-l4gf5\") pod \"maas-controller-58cbd59f4-9wfkd\" (UID: \"06d6ebc5-74f1-4061-8e9e-6355d7681a9c\") " pod="opendatahub/maas-controller-58cbd59f4-9wfkd"
Sep 11 05:10:01.270264 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.270121    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06d6ebc5-74f1-4061-8e9e-6355d7681a9c-metrics-certs\") pod \"maas-controller-58cbd59f4-9wfkd\" (UID: \"06d6ebc5-74f1-4061-8e9e-6355d7681a9c\") " pod="opendatahub/maas-controller-58cbd59f4-9wfkd"
Sep 11 05:10:01.370983 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.370953    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06d6ebc5-74f1-4061-8e9e-6355d7681a9c-webhook-cert\") pod \"maas-controller-58cbd59f4-9wfkd\" (UID: \"06d6ebc5-74f1-4061-8e9e-6355d7681a9c\") " pod="opendatahub/maas-controller-58cbd59f4-9wfkd"
Sep 11 05:10:01.371186 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.371026    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4gf5\" (UniqueName: \"kubernetes.io/projected/06d6ebc5-74f1-4061-8e9e-6355d7681a9c-kube-api-access-l4gf5\") pod \"maas-controller-58cbd59f4-9wfkd\" (UID: \"06d6ebc5-74f1-4061-8e9e-6355d7681a9c\") " pod="opendatahub/maas-controller-58cbd59f4-9wfkd"
Sep 11 05:10:01.371186 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.371046    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06d6ebc5-74f1-4061-8e9e-6355d7681a9c-metrics-certs\") pod \"maas-controller-58cbd59f4-9wfkd\" (UID: \"06d6ebc5-74f1-4061-8e9e-6355d7681a9c\") " pod="opendatahub/maas-controller-58cbd59f4-9wfkd"
Sep 11 05:10:01.373758 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.373729    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06d6ebc5-74f1-4061-8e9e-6355d7681a9c-webhook-cert\") pod \"maas-controller-58cbd59f4-9wfkd\" (UID: \"06d6ebc5-74f1-4061-8e9e-6355d7681a9c\") " pod="opendatahub/maas-controller-58cbd59f4-9wfkd"
Sep 11 05:10:01.373883 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.373738    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06d6ebc5-74f1-4061-8e9e-6355d7681a9c-metrics-certs\") pod \"maas-controller-58cbd59f4-9wfkd\" (UID: \"06d6ebc5-74f1-4061-8e9e-6355d7681a9c\") " pod="opendatahub/maas-controller-58cbd59f4-9wfkd"
Sep 11 05:10:01.378244 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.378221    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4gf5\" (UniqueName: \"kubernetes.io/projected/06d6ebc5-74f1-4061-8e9e-6355d7681a9c-kube-api-access-l4gf5\") pod \"maas-controller-58cbd59f4-9wfkd\" (UID: \"06d6ebc5-74f1-4061-8e9e-6355d7681a9c\") " pod="opendatahub/maas-controller-58cbd59f4-9wfkd"
Sep 11 05:10:01.535453 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.535360    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58cbd59f4-9wfkd"
Sep 11 05:10:01.804379 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:01.804355    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58cbd59f4-9wfkd"]
Sep 11 05:10:01.806229 ip-10-0-143-244 kubenswrapper[2554]: W0911 05:10:01.806200    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d6ebc5_74f1_4061_8e9e_6355d7681a9c.slice/crio-9059cd52c3f528e6cc9ada7d62573d9d9cf03d7737120a2bd3dc20411351691e WatchSource:0}: Error finding container 9059cd52c3f528e6cc9ada7d62573d9d9cf03d7737120a2bd3dc20411351691e: Status 404 returned error can't find the container with id 9059cd52c3f528e6cc9ada7d62573d9d9cf03d7737120a2bd3dc20411351691e
Sep 11 05:10:02.447044 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:02.447007    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd59f4-9wfkd" event={"ID":"06d6ebc5-74f1-4061-8e9e-6355d7681a9c","Type":"ContainerStarted","Data":"28cf82879094d1c79ea0b2b6cf6bc2fbd11dca6ec705dc112832a2c804064f3a"}
Sep 11 05:10:02.447467 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:02.447057    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58cbd59f4-9wfkd" event={"ID":"06d6ebc5-74f1-4061-8e9e-6355d7681a9c","Type":"ContainerStarted","Data":"9059cd52c3f528e6cc9ada7d62573d9d9cf03d7737120a2bd3dc20411351691e"}
Sep 11 05:10:02.447467 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:02.447109    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58cbd59f4-9wfkd"
Sep 11 05:10:02.463986 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:02.463925    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-58cbd59f4-9wfkd" podStartSLOduration=1.055359787 podStartE2EDuration="1.463907931s" totalImagesPullingTime="408.548144ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:10:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:10:02.461745934 +0000 UTC m=+1792.115005615" watchObservedRunningTime="2026-09-11 05:10:02.463907931 +0000 UTC m=+1792.117167610"
Sep 11 05:10:13.454669 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:13.454640    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58cbd59f4-9wfkd"
Sep 11 05:10:23.199604 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:23.199570    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:10:30.698280 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:30.698244    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:10:38.391911 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:38.391875    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:10:45.398926 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:45.398885    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:10:54.093613 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:10:54.093581    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:11:01.191677 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:11:01.191642    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:11:08.899422 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:11:08.899392    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:11:16.899471 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:11:16.899433    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:12:44.104792 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:12:44.104758    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:12:50.500958 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:12:50.500920    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:12:59.199751 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:12:59.199708    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:13:07.108789 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:13:07.108707    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:13:21.113553 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:13:21.113515    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:13:50.407497 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:13:50.407463    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:13:58.010843 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:13:58.010808    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:14:05.625820 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:05.625781    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:14:05.895090 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:05.895002    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-55659b49bd-b85zk"]
Sep 11 05:14:05.907130 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:05.907088    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55659b49bd-b85zk"
Sep 11 05:14:05.909588 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:05.909558    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-74gzc\""
Sep 11 05:14:05.913486 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:05.913449    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-55659b49bd-b85zk"]
Sep 11 05:14:05.932888 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:05.932831    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs26v\" (UniqueName: \"kubernetes.io/projected/4c858e7c-18a0-4fc8-9c89-c39fa687f472-kube-api-access-gs26v\") pod \"maas-api-55659b49bd-b85zk\" (UID: \"4c858e7c-18a0-4fc8-9c89-c39fa687f472\") " pod="odh-ai-gateway-infra/maas-api-55659b49bd-b85zk"
Sep 11 05:14:05.933119 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:05.933044    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c858e7c-18a0-4fc8-9c89-c39fa687f472-openshift-service-ca\") pod \"maas-api-55659b49bd-b85zk\" (UID: \"4c858e7c-18a0-4fc8-9c89-c39fa687f472\") " pod="odh-ai-gateway-infra/maas-api-55659b49bd-b85zk"
Sep 11 05:14:05.933190 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:05.933142    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c858e7c-18a0-4fc8-9c89-c39fa687f472-maas-api-tls\") pod \"maas-api-55659b49bd-b85zk\" (UID: \"4c858e7c-18a0-4fc8-9c89-c39fa687f472\") " pod="odh-ai-gateway-infra/maas-api-55659b49bd-b85zk"
Sep 11 05:14:05.933243 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:05.933204    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c858e7c-18a0-4fc8-9c89-c39fa687f472-metrics-certs\") pod \"maas-api-55659b49bd-b85zk\" (UID: \"4c858e7c-18a0-4fc8-9c89-c39fa687f472\") " pod="odh-ai-gateway-infra/maas-api-55659b49bd-b85zk"
Sep 11 05:14:06.034214 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:06.034167    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs26v\" (UniqueName: \"kubernetes.io/projected/4c858e7c-18a0-4fc8-9c89-c39fa687f472-kube-api-access-gs26v\") pod \"maas-api-55659b49bd-b85zk\" (UID: \"4c858e7c-18a0-4fc8-9c89-c39fa687f472\") " pod="odh-ai-gateway-infra/maas-api-55659b49bd-b85zk"
Sep 11 05:14:06.034464 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:06.034235    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c858e7c-18a0-4fc8-9c89-c39fa687f472-openshift-service-ca\") pod \"maas-api-55659b49bd-b85zk\" (UID: \"4c858e7c-18a0-4fc8-9c89-c39fa687f472\") " pod="odh-ai-gateway-infra/maas-api-55659b49bd-b85zk"
Sep 11 05:14:06.034464 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:06.034273    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c858e7c-18a0-4fc8-9c89-c39fa687f472-maas-api-tls\") pod \"maas-api-55659b49bd-b85zk\" (UID: \"4c858e7c-18a0-4fc8-9c89-c39fa687f472\") " pod="odh-ai-gateway-infra/maas-api-55659b49bd-b85zk"
Sep 11 05:14:06.034464 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:06.034300    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c858e7c-18a0-4fc8-9c89-c39fa687f472-metrics-certs\") pod \"maas-api-55659b49bd-b85zk\" (UID: \"4c858e7c-18a0-4fc8-9c89-c39fa687f472\") " pod="odh-ai-gateway-infra/maas-api-55659b49bd-b85zk"
Sep 11 05:14:06.035146 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:06.035051    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c858e7c-18a0-4fc8-9c89-c39fa687f472-openshift-service-ca\") pod \"maas-api-55659b49bd-b85zk\" (UID: \"4c858e7c-18a0-4fc8-9c89-c39fa687f472\") " pod="odh-ai-gateway-infra/maas-api-55659b49bd-b85zk"
Sep 11 05:14:06.037002 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:06.036983    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4c858e7c-18a0-4fc8-9c89-c39fa687f472-metrics-certs\") pod \"maas-api-55659b49bd-b85zk\" (UID: \"4c858e7c-18a0-4fc8-9c89-c39fa687f472\") " pod="odh-ai-gateway-infra/maas-api-55659b49bd-b85zk"
Sep 11 05:14:06.037148 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:06.037125    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4c858e7c-18a0-4fc8-9c89-c39fa687f472-maas-api-tls\") pod \"maas-api-55659b49bd-b85zk\" (UID: \"4c858e7c-18a0-4fc8-9c89-c39fa687f472\") " pod="odh-ai-gateway-infra/maas-api-55659b49bd-b85zk"
Sep 11 05:14:06.045150 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:06.045122    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs26v\" (UniqueName: \"kubernetes.io/projected/4c858e7c-18a0-4fc8-9c89-c39fa687f472-kube-api-access-gs26v\") pod \"maas-api-55659b49bd-b85zk\" (UID: \"4c858e7c-18a0-4fc8-9c89-c39fa687f472\") " pod="odh-ai-gateway-infra/maas-api-55659b49bd-b85zk"
Sep 11 05:14:06.220951 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:06.220907    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-55659b49bd-b85zk"
Sep 11 05:14:06.508048 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:06.507901    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-55659b49bd-b85zk"]
Sep 11 05:14:06.513116 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:06.513090    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 05:14:06.667655 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:06.667621    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55659b49bd-b85zk" event={"ID":"4c858e7c-18a0-4fc8-9c89-c39fa687f472","Type":"ContainerStarted","Data":"bf134d0b9f277c0fe0184b1c29913a3f3d998d50487580ca6f1bbe47938cc288"}
Sep 11 05:14:07.674184 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:07.674144    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-55659b49bd-b85zk" event={"ID":"4c858e7c-18a0-4fc8-9c89-c39fa687f472","Type":"ContainerStarted","Data":"ed0334c19c378a84b36ac4673bd3f2d00eac0061cb2fb56571ce86e2fe9490b2"}
Sep 11 05:14:07.674612 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:07.674252    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-55659b49bd-b85zk"
Sep 11 05:14:07.695874 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:07.695820    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-55659b49bd-b85zk" podStartSLOduration=2.283020645 podStartE2EDuration="2.695802818s" totalImagesPullingTime="412.782173ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:14:07.695153841 +0000 UTC m=+2037.348413564" watchObservedRunningTime="2026-09-11 05:14:07.695802818 +0000 UTC m=+2037.349062497"
Sep 11 05:14:13.213587 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:13.213544    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:14:13.685365 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:13.685319    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-55659b49bd-b85zk"
Sep 11 05:14:13.752389 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:13.752354    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"]
Sep 11 05:14:13.752645 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:13.752616    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph" podUID="a36dc1ac-fd77-4a02-b76b-a219e3c0edc7" containerName="maas-api" containerID="cri-o://e45337da7a508edf4821460f008f98ac8760ade0d0405d4eb70c55b48640888b" gracePeriod=30
Sep 11 05:14:14.999014 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:14.998988    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"
Sep 11 05:14:15.119961 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.119499    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-maas-api-tls\") pod \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\" (UID: \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\") "
Sep 11 05:14:15.119961 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.119618    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6r4zg\" (UniqueName: \"kubernetes.io/projected/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-kube-api-access-6r4zg\") pod \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\" (UID: \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\") "
Sep 11 05:14:15.119961 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.119654    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-openshift-service-ca\") pod \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\" (UID: \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\") "
Sep 11 05:14:15.120738 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.120425    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a36dc1ac-fd77-4a02-b76b-a219e3c0edc7" (UID: "a36dc1ac-fd77-4a02-b76b-a219e3c0edc7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 05:14:15.127040 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.120989    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-metrics-certs\") pod \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\" (UID: \"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7\") "
Sep 11 05:14:15.127040 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.121511    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-openshift-service-ca\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:14:15.127040 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.123379    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-kube-api-access-6r4zg" (OuterVolumeSpecName: "kube-api-access-6r4zg") pod "a36dc1ac-fd77-4a02-b76b-a219e3c0edc7" (UID: "a36dc1ac-fd77-4a02-b76b-a219e3c0edc7"). InnerVolumeSpecName "kube-api-access-6r4zg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 05:14:15.128396 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.128363    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a36dc1ac-fd77-4a02-b76b-a219e3c0edc7" (UID: "a36dc1ac-fd77-4a02-b76b-a219e3c0edc7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 05:14:15.129010 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.128980    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a36dc1ac-fd77-4a02-b76b-a219e3c0edc7" (UID: "a36dc1ac-fd77-4a02-b76b-a219e3c0edc7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 05:14:15.222052 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.222014    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-maas-api-tls\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:14:15.222052 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.222048    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r4zg\" (UniqueName: \"kubernetes.io/projected/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-kube-api-access-6r4zg\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:14:15.222052 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.222059    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7-metrics-certs\") on node \"ip-10-0-143-244.ec2.internal\" DevicePath \"\""
Sep 11 05:14:15.716649 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.716615    2554 generic.go:356] "Generic (PLEG): container finished" podID="a36dc1ac-fd77-4a02-b76b-a219e3c0edc7" containerID="e45337da7a508edf4821460f008f98ac8760ade0d0405d4eb70c55b48640888b" exitCode=0
Sep 11 05:14:15.716852 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.716678    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"
Sep 11 05:14:15.716852 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.716696    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph" event={"ID":"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7","Type":"ContainerDied","Data":"e45337da7a508edf4821460f008f98ac8760ade0d0405d4eb70c55b48640888b"}
Sep 11 05:14:15.716852 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.716766    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph" event={"ID":"a36dc1ac-fd77-4a02-b76b-a219e3c0edc7","Type":"ContainerDied","Data":"06014bc4210738ec78b97415fa53530b4a7391e9541ec64c7364a4c2eb35fe6e"}
Sep 11 05:14:15.716852 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.716788    2554 scope.go:117] "RemoveContainer" containerID="e45337da7a508edf4821460f008f98ac8760ade0d0405d4eb70c55b48640888b"
Sep 11 05:14:15.726311 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.726293    2554 scope.go:117] "RemoveContainer" containerID="e45337da7a508edf4821460f008f98ac8760ade0d0405d4eb70c55b48640888b"
Sep 11 05:14:15.726686 ip-10-0-143-244 kubenswrapper[2554]: E0911 05:14:15.726665    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e45337da7a508edf4821460f008f98ac8760ade0d0405d4eb70c55b48640888b\": container with ID starting with e45337da7a508edf4821460f008f98ac8760ade0d0405d4eb70c55b48640888b not found: ID does not exist" containerID="e45337da7a508edf4821460f008f98ac8760ade0d0405d4eb70c55b48640888b"
Sep 11 05:14:15.726762 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.726698    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e45337da7a508edf4821460f008f98ac8760ade0d0405d4eb70c55b48640888b"} err="failed to get container status \"e45337da7a508edf4821460f008f98ac8760ade0d0405d4eb70c55b48640888b\": rpc error: code = NotFound desc = could not find container \"e45337da7a508edf4821460f008f98ac8760ade0d0405d4eb70c55b48640888b\": container with ID starting with e45337da7a508edf4821460f008f98ac8760ade0d0405d4eb70c55b48640888b not found: ID does not exist"
Sep 11 05:14:15.739317 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.739283    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"]
Sep 11 05:14:15.744854 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:15.744820    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-646f6bcd4d-vcnph"]
Sep 11 05:14:16.813595 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:16.813553    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a36dc1ac-fd77-4a02-b76b-a219e3c0edc7" path="/var/lib/kubelet/pods/a36dc1ac-fd77-4a02-b76b-a219e3c0edc7/volumes"
Sep 11 05:14:20.221624 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:20.221589    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:14:25.148607 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:25.148571    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:14:32.231826 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:32.231741    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-6mjjj"]
Sep 11 05:14:35.715544 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:35.715510    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-869cf59fcc-rm4pc_b5a91749-199b-4e9b-b86d-43bbf6626c30/authorino/0.log"
Sep 11 05:14:41.169513 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:41.169485    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fpb28_50fa7de3-d758-40aa-909f-d025d698aea9/manager/0.log"
Sep 11 05:14:41.306401 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:41.306371    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6n5lv_8a12362a-dc5b-4e4e-8551-37108f2e0fb6/manager/0.log"
Sep 11 05:14:41.457011 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:41.456941    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58cbd59f4-9wfkd_06d6ebc5-74f1-4061-8e9e-6355d7681a9c/manager/0.log"
Sep 11 05:14:42.012465 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:42.012433    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh_89fc663f-2cbc-427a-9fd0-1cc0d52eef3f/copy-manifests/0.log"
Sep 11 05:14:42.020819 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:42.020788    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh_89fc663f-2cbc-427a-9fd0-1cc0d52eef3f/manager/0.log"
Sep 11 05:14:42.499495 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:42.499455    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-55659b49bd-b85zk_4c858e7c-18a0-4fc8-9c89-c39fa687f472/maas-api/0.log"
Sep 11 05:14:43.592941 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:43.592910    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-869cf59fcc-rm4pc_b5a91749-199b-4e9b-b86d-43bbf6626c30/authorino/0.log"
Sep 11 05:14:43.717967 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:43.717931    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-bwgqb_86f6964a-d794-4ad9-815b-b17d7c2ad9f1/manager/0.log"
Sep 11 05:14:43.836161 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:43.836128    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-x57zt_04a7f9d0-06d0-44c5-85bb-fca2ce26bdb1/manager/0.log"
Sep 11 05:14:43.943260 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:43.943238    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-5p8n7_c80e2628-6b41-45bd-b0e8-4db1c92d1ee1/kuadrant-console-plugin/0.log"
Sep 11 05:14:44.179876 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:44.179847    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-6mjjj_71951837-9654-487e-b4d2-b8b32a42b60b/limitador/0.log"
Sep 11 05:14:44.303860 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:44.303772    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-j7pdj_c1dd2489-53df-469c-80ea-6a6a295e80a3/manager/0.log"
Sep 11 05:14:45.025047 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:45.025018    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fcb5f7d79-gdwv2_dd7c1a0b-849c-4966-95ce-ea9f77b86406/kube-auth-proxy/0.log"
Sep 11 05:14:45.152538 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:45.152507    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hnzbr_21933563-dab2-4f0b-88f2-c34a1d828d43/istio-proxy/1.log"
Sep 11 05:14:45.281284 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:45.281199    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-rqdkj_48a3ebbb-93b6-4063-918f-d26c32611df7/payload-pre-processing/0.log"
Sep 11 05:14:45.517138 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:45.517102    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55cd4498b4-c6wv9_8ddc8e86-ba33-4a96-80b5-c05cc07cd824/router/0.log"
Sep 11 05:14:45.861132 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:45.861101    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-9qgng_b9c00915-1c4d-47c9-ab12-df2f0baa1c4b/main/0.log"
Sep 11 05:14:46.200595 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:46.200561    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-b2pt8_3d2b2e55-39c6-4eef-9ca6-94067c3bc13e/main/0.log"
Sep 11 05:14:55.720856 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:55.720822    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-d66qg_216c51f9-f976-4b58-a9ab-96bef1bf776c/global-pull-secret-syncer/0.log"
Sep 11 05:14:55.804984 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:55.804952    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ghlxt_f87de3b3-7604-4f7a-8c87-c5fabe66555b/konnectivity-agent/0.log"
Sep 11 05:14:55.905221 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:14:55.905195    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-244.ec2.internal_1dc5f07142ffec6eb419ac61ce92a9d5/haproxy/0.log"
Sep 11 05:15:00.310540 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:00.310501    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-869cf59fcc-rm4pc_b5a91749-199b-4e9b-b86d-43bbf6626c30/authorino/0.log"
Sep 11 05:15:00.352352 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:00.352291    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-bwgqb_86f6964a-d794-4ad9-815b-b17d7c2ad9f1/manager/0.log"
Sep 11 05:15:00.392419 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:00.392387    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-x57zt_04a7f9d0-06d0-44c5-85bb-fca2ce26bdb1/manager/0.log"
Sep 11 05:15:00.421436 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:00.421407    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-5p8n7_c80e2628-6b41-45bd-b0e8-4db1c92d1ee1/kuadrant-console-plugin/0.log"
Sep 11 05:15:00.512935 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:00.512902    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-6mjjj_71951837-9654-487e-b4d2-b8b32a42b60b/limitador/0.log"
Sep 11 05:15:00.618289 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:00.618201    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-j7pdj_c1dd2489-53df-469c-80ea-6a6a295e80a3/manager/0.log"
Sep 11 05:15:02.355801 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:02.355763    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-rpz4w_78245237-7e15-4ec3-8954-4d51dca681e3/kube-state-metrics/0.log"
Sep 11 05:15:02.378747 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:02.378715    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-rpz4w_78245237-7e15-4ec3-8954-4d51dca681e3/kube-rbac-proxy-main/0.log"
Sep 11 05:15:02.400076 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:02.400039    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-rpz4w_78245237-7e15-4ec3-8954-4d51dca681e3/kube-rbac-proxy-self/0.log"
Sep 11 05:15:02.513233 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:02.513205    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9hjhv_83032487-731e-4348-aff3-97c6064398f6/node-exporter/0.log"
Sep 11 05:15:02.555788 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:02.555759    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9hjhv_83032487-731e-4348-aff3-97c6064398f6/kube-rbac-proxy/0.log"
Sep 11 05:15:02.588035 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:02.588013    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9hjhv_83032487-731e-4348-aff3-97c6064398f6/init-textfile/0.log"
Sep 11 05:15:03.273844 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:03.273812    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-jhp2h_d16c317f-48cb-443a-a681-600640b0f4d4/prometheus-operator/0.log"
Sep 11 05:15:03.302660 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:03.302631    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-jhp2h_d16c317f-48cb-443a-a681-600640b0f4d4/kube-rbac-proxy/0.log"
Sep 11 05:15:05.046032 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:05.046003    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-4zdjm_ce86f3ad-0822-47e8-bdbf-6a5a308dfa4a/networking-console-plugin/0.log"
Sep 11 05:15:05.904860 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:05.904824    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"]
Sep 11 05:15:05.905446 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:05.905422    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a36dc1ac-fd77-4a02-b76b-a219e3c0edc7" containerName="maas-api"
Sep 11 05:15:05.905446 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:05.905445    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a36dc1ac-fd77-4a02-b76b-a219e3c0edc7" containerName="maas-api"
Sep 11 05:15:05.905601 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:05.905540    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a36dc1ac-fd77-4a02-b76b-a219e3c0edc7" containerName="maas-api"
Sep 11 05:15:05.908918 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:05.908903    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"
Sep 11 05:15:05.912429 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:05.912397    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hb6n7\"/\"default-dockercfg-vqpj6\""
Sep 11 05:15:05.912567 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:05.912519    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hb6n7\"/\"kube-root-ca.crt\""
Sep 11 05:15:05.912567 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:05.912540    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hb6n7\"/\"openshift-service-ca.crt\""
Sep 11 05:15:05.929740 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:05.929710    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"]
Sep 11 05:15:05.972953 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:05.972925    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3265a2d5-8833-4a32-905d-9276f268d7f6-sys\") pod \"perf-node-gather-daemonset-qb9dq\" (UID: \"3265a2d5-8833-4a32-905d-9276f268d7f6\") " pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"
Sep 11 05:15:05.976364 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:05.973471    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgrbp\" (UniqueName: \"kubernetes.io/projected/3265a2d5-8833-4a32-905d-9276f268d7f6-kube-api-access-fgrbp\") pod \"perf-node-gather-daemonset-qb9dq\" (UID: \"3265a2d5-8833-4a32-905d-9276f268d7f6\") " pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"
Sep 11 05:15:05.976364 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:05.973645    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3265a2d5-8833-4a32-905d-9276f268d7f6-lib-modules\") pod \"perf-node-gather-daemonset-qb9dq\" (UID: \"3265a2d5-8833-4a32-905d-9276f268d7f6\") " pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"
Sep 11 05:15:05.976364 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:05.973711    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3265a2d5-8833-4a32-905d-9276f268d7f6-podres\") pod \"perf-node-gather-daemonset-qb9dq\" (UID: \"3265a2d5-8833-4a32-905d-9276f268d7f6\") " pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"
Sep 11 05:15:05.976364 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:05.973756    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3265a2d5-8833-4a32-905d-9276f268d7f6-proc\") pod \"perf-node-gather-daemonset-qb9dq\" (UID: \"3265a2d5-8833-4a32-905d-9276f268d7f6\") " pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"
Sep 11 05:15:06.074715 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:06.074669    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3265a2d5-8833-4a32-905d-9276f268d7f6-proc\") pod \"perf-node-gather-daemonset-qb9dq\" (UID: \"3265a2d5-8833-4a32-905d-9276f268d7f6\") " pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"
Sep 11 05:15:06.075162 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:06.074749    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3265a2d5-8833-4a32-905d-9276f268d7f6-sys\") pod \"perf-node-gather-daemonset-qb9dq\" (UID: \"3265a2d5-8833-4a32-905d-9276f268d7f6\") " pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"
Sep 11 05:15:06.075162 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:06.074772    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgrbp\" (UniqueName: \"kubernetes.io/projected/3265a2d5-8833-4a32-905d-9276f268d7f6-kube-api-access-fgrbp\") pod \"perf-node-gather-daemonset-qb9dq\" (UID: \"3265a2d5-8833-4a32-905d-9276f268d7f6\") " pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"
Sep 11 05:15:06.075162 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:06.074814    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3265a2d5-8833-4a32-905d-9276f268d7f6-proc\") pod \"perf-node-gather-daemonset-qb9dq\" (UID: \"3265a2d5-8833-4a32-905d-9276f268d7f6\") " pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"
Sep 11 05:15:06.075162 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:06.074857    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3265a2d5-8833-4a32-905d-9276f268d7f6-lib-modules\") pod \"perf-node-gather-daemonset-qb9dq\" (UID: \"3265a2d5-8833-4a32-905d-9276f268d7f6\") " pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"
Sep 11 05:15:06.075162 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:06.074883    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3265a2d5-8833-4a32-905d-9276f268d7f6-sys\") pod \"perf-node-gather-daemonset-qb9dq\" (UID: \"3265a2d5-8833-4a32-905d-9276f268d7f6\") " pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"
Sep 11 05:15:06.075162 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:06.074900    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3265a2d5-8833-4a32-905d-9276f268d7f6-podres\") pod \"perf-node-gather-daemonset-qb9dq\" (UID: \"3265a2d5-8833-4a32-905d-9276f268d7f6\") " pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"
Sep 11 05:15:06.075162 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:06.074998    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3265a2d5-8833-4a32-905d-9276f268d7f6-podres\") pod \"perf-node-gather-daemonset-qb9dq\" (UID: \"3265a2d5-8833-4a32-905d-9276f268d7f6\") " pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"
Sep 11 05:15:06.075162 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:06.075040    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3265a2d5-8833-4a32-905d-9276f268d7f6-lib-modules\") pod \"perf-node-gather-daemonset-qb9dq\" (UID: \"3265a2d5-8833-4a32-905d-9276f268d7f6\") " pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"
Sep 11 05:15:06.087645 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:06.087609    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgrbp\" (UniqueName: \"kubernetes.io/projected/3265a2d5-8833-4a32-905d-9276f268d7f6-kube-api-access-fgrbp\") pod \"perf-node-gather-daemonset-qb9dq\" (UID: \"3265a2d5-8833-4a32-905d-9276f268d7f6\") " pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"
Sep 11 05:15:06.219063 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:06.219026    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"
Sep 11 05:15:06.468744 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:06.468712    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7f94454b9d-kmvmj_c6fc2935-4bb8-48d8-90c9-590a78745582/console/0.log"
Sep 11 05:15:06.541224 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:06.541194    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"]
Sep 11 05:15:06.543546 ip-10-0-143-244 kubenswrapper[2554]: W0911 05:15:06.543509    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3265a2d5_8833_4a32_905d_9276f268d7f6.slice/crio-96bb086f4fc9e8d570de8d6ae728ceadd9f66dd51fa9743e4228416841a94e92 WatchSource:0}: Error finding container 96bb086f4fc9e8d570de8d6ae728ceadd9f66dd51fa9743e4228416841a94e92: Status 404 returned error can't find the container with id 96bb086f4fc9e8d570de8d6ae728ceadd9f66dd51fa9743e4228416841a94e92
Sep 11 05:15:06.574169 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:06.574136    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-hwpst_eeec2d7a-a6bd-4972-932d-6f4c218bace2/download-server/0.log"
Sep 11 05:15:06.984863 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:06.984827    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq" event={"ID":"3265a2d5-8833-4a32-905d-9276f268d7f6","Type":"ContainerStarted","Data":"0581d8647380cbeb0448b7db8893664815538e5fce87b06d0683fe8a9a2d9448"}
Sep 11 05:15:06.985048 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:06.984888    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq" event={"ID":"3265a2d5-8833-4a32-905d-9276f268d7f6","Type":"ContainerStarted","Data":"96bb086f4fc9e8d570de8d6ae728ceadd9f66dd51fa9743e4228416841a94e92"}
Sep 11 05:15:06.985048 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:06.984949    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"
Sep 11 05:15:08.684829 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:08.684798    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tgr28_23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca/dns/0.log"
Sep 11 05:15:08.734869 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:08.734841    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tgr28_23ecb1e0-fa96-4cf1-8c0b-8ccd2e0d4aca/kube-rbac-proxy/0.log"
Sep 11 05:15:08.881181 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:08.881149    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zmltd_4c9e693e-282c-44df-9ecd-485c40bc15a0/dns-node-resolver/0.log"
Sep 11 05:15:09.540799 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:09.540762    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-576d49cb45-z98tv_97f4da98-983c-4308-b836-f1c557dbc28b/registry/0.log"
Sep 11 05:15:09.679313 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:09.679282    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ddk77_b096f3e4-4f74-419a-b6ff-c7d246dfa1d1/node-ca/0.log"
Sep 11 05:15:11.037325 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:11.037294    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fcb5f7d79-gdwv2_dd7c1a0b-849c-4966-95ce-ea9f77b86406/kube-auth-proxy/0.log"
Sep 11 05:15:11.073348 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:11.073304    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hnzbr_21933563-dab2-4f0b-88f2-c34a1d828d43/istio-proxy/0.log"
Sep 11 05:15:11.088888 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:11.088856    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hnzbr_21933563-dab2-4f0b-88f2-c34a1d828d43/istio-proxy/1.log"
Sep 11 05:15:11.139693 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:11.139654    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-rqdkj_48a3ebbb-93b6-4063-918f-d26c32611df7/payload-pre-processing/0.log"
Sep 11 05:15:11.230155 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:11.230124    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55cd4498b4-c6wv9_8ddc8e86-ba33-4a96-80b5-c05cc07cd824/router/0.log"
Sep 11 05:15:12.163388 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:12.163366    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rn87x_292a0e4d-f68d-4043-9b6c-9467330e9aa6/serve-healthcheck-canary/0.log"
Sep 11 05:15:12.826550 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:12.826524    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-txlgl_4932d639-195a-476e-9814-49bc2c1a19d7/kube-rbac-proxy/0.log"
Sep 11 05:15:12.848979 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:12.848955    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-txlgl_4932d639-195a-476e-9814-49bc2c1a19d7/exporter/0.log"
Sep 11 05:15:12.877133 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:12.877104    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-txlgl_4932d639-195a-476e-9814-49bc2c1a19d7/extractor/0.log"
Sep 11 05:15:13.000727 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:13.000699    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq"
Sep 11 05:15:13.016230 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:13.016179    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hb6n7/perf-node-gather-daemonset-qb9dq" podStartSLOduration=8.016160261 podStartE2EDuration="8.016160261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 05:15:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:15:07.007528595 +0000 UTC m=+2096.660788277" watchObservedRunningTime="2026-09-11 05:15:13.016160261 +0000 UTC m=+2102.669419943"
Sep 11 05:15:15.220748 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:15.220721    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fpb28_50fa7de3-d758-40aa-909f-d025d698aea9/manager/0.log"
Sep 11 05:15:15.527479 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:15.527451    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6n5lv_8a12362a-dc5b-4e4e-8551-37108f2e0fb6/manager/0.log"
Sep 11 05:15:15.605368 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:15.605315    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-58cbd59f4-9wfkd_06d6ebc5-74f1-4061-8e9e-6355d7681a9c/manager/0.log"
Sep 11 05:15:15.770191 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:15.770162    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fcb5f7d79-gdwv2_dd7c1a0b-849c-4966-95ce-ea9f77b86406/kube-auth-proxy/0.log"
Sep 11 05:15:15.793409 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:15.793368    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hnzbr_21933563-dab2-4f0b-88f2-c34a1d828d43/istio-proxy/0.log"
Sep 11 05:15:15.809531 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:15.809506    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hnzbr_21933563-dab2-4f0b-88f2-c34a1d828d43/istio-proxy/1.log"
Sep 11 05:15:15.817174 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:15.817149    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh_89fc663f-2cbc-427a-9fd0-1cc0d52eef3f/manager/0.log"
Sep 11 05:15:15.843633 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:15.843605    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fbc9b44c4-ggnkh_89fc663f-2cbc-427a-9fd0-1cc0d52eef3f/copy-manifests/0.log"
Sep 11 05:15:15.848344 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:15.848298    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-rqdkj_48a3ebbb-93b6-4063-918f-d26c32611df7/payload-pre-processing/0.log"
Sep 11 05:15:15.898231 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:15.898195    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55cd4498b4-c6wv9_8ddc8e86-ba33-4a96-80b5-c05cc07cd824/router/0.log"
Sep 11 05:15:17.631694 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:17.631615    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-fcb5f7d79-gdwv2_dd7c1a0b-849c-4966-95ce-ea9f77b86406/kube-auth-proxy/0.log"
Sep 11 05:15:17.658171 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:17.658127    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hnzbr_21933563-dab2-4f0b-88f2-c34a1d828d43/istio-proxy/0.log"
Sep 11 05:15:17.672622 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:17.672585    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-hnzbr_21933563-dab2-4f0b-88f2-c34a1d828d43/istio-proxy/1.log"
Sep 11 05:15:17.711671 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:17.711640    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-rqdkj_48a3ebbb-93b6-4063-918f-d26c32611df7/payload-pre-processing/0.log"
Sep 11 05:15:17.758461 ip-10-0-143-244 kubenswrapper[2554]: I0911 05:15:17.758433    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-55cd4498b4-c6wv9_8ddc8e86-ba33-4a96-80b5-c05cc07cd824/router/0.log"