Sep 11 16:27:49.746052 ip-10-0-134-196 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 16:27:49.746065 ip-10-0-134-196 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 16:27:49.746074 ip-10-0-134-196 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 16:27:49.746428 ip-10-0-134-196 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 16:27:59.919351 ip-10-0-134-196 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 11 16:27:59.919366 ip-10-0-134-196 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 54eb077ee9b9492a968d5dbb44c8a211 --
Sep 11 16:29:40.288931 ip-10-0-134-196 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 16:29:40.692482 ip-10-0-134-196 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 16:29:40.692482 ip-10-0-134-196 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 16:29:40.692482 ip-10-0-134-196 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 16:29:40.692482 ip-10-0-134-196 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 16:29:40.692482 ip-10-0-134-196 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 16:29:40.695346 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.695254    2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 16:29:40.699759 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699742    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:29:40.699759 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699760    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699764    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699768    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699771    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699774    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699777    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699780    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699783    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699786    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699789    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699791    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699794    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699797    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699800    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699805    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699809    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699812    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699816    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699820    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699823    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:29:40.699827 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699826    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699829    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699832    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699835    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699838    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699841    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699844    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699846    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699849    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699851    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699854    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699857    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699859    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699862    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699864    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699867    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699869    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699874    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699876    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699879    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:29:40.700312 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699881    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:29:40.700803 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699885    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:29:40.700803 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699887    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:29:40.700803 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699890    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:29:40.700803 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699892    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:29:40.700803 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699895    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:29:40.700803 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699898    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:29:40.700803 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699901    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:29:40.700803 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699903    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:29:40.700803 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699906    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:29:40.700803 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699909    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:29:40.700803 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699911    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:29:40.700803 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699914    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:29:40.700803 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699917    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:29:40.700803 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699920    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:29:40.700803 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699922    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:29:40.700803 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699926    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:29:40.700803 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699928    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:29:40.700803 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699931    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:29:40.700803 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699935    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699939    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699942    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699944    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699947    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699950    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699953    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699956    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699960    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699962    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699965    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699973    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699976    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699979    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699982    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699985    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699987    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699990    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699992    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699996    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:29:40.701275 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.699999    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:29:40.701777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700001    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:29:40.701777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700004    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:29:40.701777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700006    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:29:40.701777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700009    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:29:40.701777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700012    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:29:40.701777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700015    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:29:40.701777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700018    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:29:40.701777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700020    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:29:40.701777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700023    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:29:40.701777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700026    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:29:40.701777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700028    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:29:40.701777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700031    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:29:40.701777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700034    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:29:40.701777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700036    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:29:40.701777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700038    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:29:40.701777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700041    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:29:40.701777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700043    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:29:40.701777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700046    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:29:40.701777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700797    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700804    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700807    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700810    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700813    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700817    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700821    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700824    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700827    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700831    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700835    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700838    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700842    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700845    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700848    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700851    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700853    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700857    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700860    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700863    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:29:40.702248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700866    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:29:40.702802 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700869    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:29:40.702802 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700871    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:29:40.702802 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700874    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:29:40.702802 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700877    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:29:40.702802 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700880    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:29:40.702802 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700882    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:29:40.702802 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700885    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:29:40.702802 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700887    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:29:40.702802 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700889    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:29:40.702802 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700892    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:29:40.702802 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700896    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:29:40.702802 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700900    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:29:40.702802 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700902    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:29:40.702802 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700905    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:29:40.702802 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700908    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:29:40.702802 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700911    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:29:40.702802 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700913    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:29:40.702802 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700916    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:29:40.702802 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700919    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700922    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700925    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700928    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700930    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700933    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700935    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700938    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700941    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700944    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700947    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700950    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700953    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700955    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700957    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700961    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700963    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700966    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700969    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700972    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:29:40.703278 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700975    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:29:40.703786 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700977    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:29:40.703786 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700980    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:29:40.703786 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700983    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:29:40.703786 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700985    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:29:40.703786 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700988    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:29:40.703786 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700991    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:29:40.703786 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700993    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:29:40.703786 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700996    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:29:40.703786 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.700998    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:29:40.703786 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701001    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:29:40.703786 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701003    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:29:40.703786 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701009    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:29:40.703786 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701013    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:29:40.703786 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701016    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:29:40.703786 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701019    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:29:40.703786 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701022    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:29:40.703786 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701025    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:29:40.703786 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701028    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:29:40.703786 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701031    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:29:40.704277 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701033    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:29:40.704277 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701036    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:29:40.704277 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701038    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:29:40.704277 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701041    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:29:40.704277 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701044    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:29:40.704277 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701046    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:29:40.704277 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701049    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:29:40.704277 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701052    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:29:40.704277 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701055    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:29:40.704277 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701057    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:29:40.704277 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701060    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:29:40.704277 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701062    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:29:40.704277 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701065    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:29:40.704277 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701067    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:29:40.704277 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701070    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:29:40.704277 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701072    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:29:40.704277 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701075    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:29:40.704277 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701077    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:29:40.704277 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701079    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.701082    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702165    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702171    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702175    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702178    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702194    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702200    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702203    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702206    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702209    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702212    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702215    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702218    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702220    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702223    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702225    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702228    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702231    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702234    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:29:40.704760 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702236    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702239    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702241    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702244    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702247    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702251    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702253    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702256    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702259    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702262    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702265    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702267    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702269    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702272    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702274    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702277    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702280    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702282    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702285    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702288    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:29:40.705331 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702291    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:29:40.705869 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702293    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:29:40.705869 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702296    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:29:40.705869 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702299    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:29:40.705869 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702301    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:29:40.705869 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702304    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:29:40.705869 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702306    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:29:40.705869 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702308    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:29:40.705869 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702313    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:29:40.705869 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702316    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:29:40.705869 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702319    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:29:40.705869 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702322    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:29:40.705869 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702325    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:29:40.705869 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702328    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:29:40.705869 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702330    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:29:40.705869 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702333    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:29:40.705869 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702337    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:29:40.705869 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702340    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:29:40.705869 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702342    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:29:40.705869 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702345    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:29:40.706486 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702347    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:29:40.706486 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702349    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:29:40.706486 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702352    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:29:40.706486 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702354    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:29:40.706486 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702357    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:29:40.706486 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702359    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:29:40.706486 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702363    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:29:40.706486 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702367    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:29:40.706486 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702370    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:29:40.706486 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702372    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:29:40.706486 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702375    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:29:40.706486 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702378    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:29:40.706486 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702381    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:29:40.706486 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702385    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:29:40.706486 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702389    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:29:40.706486 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702391    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:29:40.706486 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702394    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:29:40.706486 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702397    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:29:40.706486 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702399    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702402    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702404    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702407    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702409    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702412    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702414    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702417    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702419    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702422    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702426    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702428    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702431    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702433    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702436    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702438    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702441    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702444    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702446    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702449    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:29:40.707209 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702451    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702454    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.702457    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702536    2557 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702575    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702582    2557 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702587    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702592    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702596    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702600    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702617    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702621    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702624    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702630    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702634    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702637    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702640    2557 flags.go:64] FLAG: --cgroup-root=""
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702643    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702646    2557 flags.go:64] FLAG: --client-ca-file=""
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702649    2557 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702652    2557 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702656    2557 flags.go:64] FLAG: --cluster-domain=""
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702659    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702662    2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 16:29:40.707750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702665    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702669    2557 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702672    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702675    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702678    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702682    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702685    2557 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702688    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702691    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702694    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702698    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702702    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702705    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702708    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702711    2557 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702714    2557 flags.go:64] FLAG: --enable-server="true"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702717    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702721    2557 flags.go:64] FLAG: --event-burst="100"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702724    2557 flags.go:64] FLAG: --event-qps="50"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702728    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702731    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702736    2557 flags.go:64] FLAG: --eviction-hard=""
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702739    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702742    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702745    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 16:29:40.708336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702748    2557 flags.go:64] FLAG: --eviction-soft=""
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702751    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702754    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702757    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702760    2557 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702763    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702766    2557 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702769    2557 flags.go:64] FLAG: --feature-gates=""
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702773    2557 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702776    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702779    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702783    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702786    2557 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702789    2557 flags.go:64] FLAG: --help="false"
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702792    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-134-196.ec2.internal"
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702795    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702798    2557 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702801    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702805    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702809    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702812    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702816    2557 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702818    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 16:29:40.708951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702822    2557 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702825    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702828    2557 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702831    2557 flags.go:64] FLAG: --kube-reserved=""
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702835    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702840    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702843    2557 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702846    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702849    2557 flags.go:64] FLAG: --lock-file=""
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702852    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702855    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702857    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702863    2557 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702866    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702869    2557 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702872    2557 flags.go:64] FLAG: --logging-format="text"
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702876    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702881    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702884    2557 flags.go:64] FLAG: --manifest-url=""
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702894    2557 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702899    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702902    2557 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702906    2557 flags.go:64] FLAG: --max-pods="110"
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702909    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702912    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 16:29:40.709574 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702915    2557 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702919    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702922    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702925    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702928    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702935    2557 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702938    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702941    2557 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702945    2557 flags.go:64] FLAG: --pod-cidr=""
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702948    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702954    2557 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702957    2557 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702962    2557 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702965    2557 flags.go:64] FLAG: --port="10250"
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702968    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702972    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-062dc6991019ee5ed"
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702975    2557 flags.go:64] FLAG: --qos-reserved=""
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702978    2557 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702981    2557 flags.go:64] FLAG: --register-node="true"
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702984    2557 flags.go:64] FLAG: --register-with-taints=""
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702987    2557 flags.go:64] FLAG: --registry-burst="10"
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702990    2557 flags.go:64] FLAG: --registry-qps="5"
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702993    2557 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.702996    2557 flags.go:64] FLAG: --reserved-memory=""
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703000    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 16:29:40.710207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703004    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703007    2557 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703010    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703013    2557 flags.go:64] FLAG: --runonce="false"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703016    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703019    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703022    2557 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703025    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703028    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703031    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703034    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703037    2557 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703040    2557 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703044    2557 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703046    2557 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703049    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703052    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703056    2557 flags.go:64] FLAG: --system-cgroups=""
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703059    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703066    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703069    2557 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703072    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703076    2557 flags.go:64] FLAG: --tls-min-version=""
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703078    2557 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703081    2557 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 16:29:40.710873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703085    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703087    2557 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703091    2557 flags.go:64] FLAG: --v="2"
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703095    2557 flags.go:64] FLAG: --version="false"
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703099    2557 flags.go:64] FLAG: --vmodule=""
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703102    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.703106    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703229    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703233    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703236    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703239    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703242    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703245    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703247    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703250    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703253    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703256    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703258    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703261    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703264    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703266    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:29:40.711526 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703269    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703272    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703274    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703277    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703280    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703284    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703288    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703290    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703293    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703295    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703298    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703301    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703303    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703306    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703309    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703311    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703314    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703316    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703321    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703323    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:29:40.712064 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703326    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703328    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703331    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703334    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703336    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703339    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703341    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703344    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703346    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703349    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703352    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703355    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703358    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703360    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703363    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703365    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703368    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703372    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703375    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703378    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:29:40.712542 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703380    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:29:40.713053 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703383    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:29:40.713053 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703385    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:29:40.713053 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703388    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:29:40.713053 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703390    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:29:40.713053 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703393    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:29:40.713053 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703396    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:29:40.713053 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703398    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:29:40.713053 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703401    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:29:40.713053 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703403    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:29:40.713053 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703407    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:29:40.713053 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703411    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:29:40.713053 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703414    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:29:40.713053 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703418    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:29:40.713053 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703421    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:29:40.713053 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703423    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:29:40.713053 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703426    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:29:40.713053 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703434    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:29:40.713053 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703437    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:29:40.713053 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703440    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:29:40.713528 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703443    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:29:40.713528 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703446    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:29:40.713528 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703448    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:29:40.713528 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703451    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:29:40.713528 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703455    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:29:40.713528 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703458    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:29:40.713528 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703461    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:29:40.713528 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703464    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:29:40.713528 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703467    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:29:40.713528 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703472    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:29:40.713528 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703475    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:29:40.713528 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703478    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:29:40.713528 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703481    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:29:40.713528 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703484    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:29:40.713528 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703487    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:29:40.713528 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703489    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:29:40.713528 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703492    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:29:40.713528 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703494    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:29:40.713528 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703497    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:29:40.714031 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703500    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:29:40.714031 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703502    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:29:40.714031 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703505    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:29:40.714031 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703509    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:29:40.714031 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703512    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:29:40.714031 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.703515    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:29:40.714031 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.704261    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 16:29:40.715681 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.715660    2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 16:29:40.715723 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.715682    2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 16:29:40.715723 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.715702    2557 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 16:29:40.715723 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.715709    2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 16:29:40.715808 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715768    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:29:40.715808 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715773    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:29:40.715808 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715777    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:29:40.715808 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715780    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:29:40.715808 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715783    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:29:40.715808 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715786    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:29:40.715808 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715789    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:29:40.715808 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715792    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:29:40.715808 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715795    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:29:40.715808 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715798    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:29:40.715808 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715801    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:29:40.715808 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715803    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:29:40.715808 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715807    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:29:40.715808 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715809    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:29:40.715808 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715813    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:29:40.715808 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715815    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715818    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715821    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715824    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715827    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715829    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715832    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715835    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715838    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715841    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715844    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715846    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715850    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715852    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715855    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715857    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715860    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715863    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715865    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715867    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:29:40.716240 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715870    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:29:40.716812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715873    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:29:40.716812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715875    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:29:40.716812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715878    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:29:40.716812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715881    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:29:40.716812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715883    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:29:40.716812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715886    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:29:40.716812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715889    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:29:40.716812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715891    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:29:40.716812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715894    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:29:40.716812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715897    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:29:40.716812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715899    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:29:40.716812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715902    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:29:40.716812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715904    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:29:40.716812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715908    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:29:40.716812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715910    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:29:40.716812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715915    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:29:40.716812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715919    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:29:40.716812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715922    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:29:40.716812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715926    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715930    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715933    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715936    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715939    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715941    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715944    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715946    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715949    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715952    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715955    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715957    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715959    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715962    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715965    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715968    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715970    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715973    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715976    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715978    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:29:40.717281 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715981    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:29:40.717789 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715983    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:29:40.717789 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715987    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:29:40.717789 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715990    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:29:40.717789 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715993    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:29:40.717789 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.715998    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:29:40.717789 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716001    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:29:40.717789 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716004    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:29:40.717789 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716007    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:29:40.717789 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716009    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:29:40.717789 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716012    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:29:40.717789 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716015    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:29:40.717789 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716018    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:29:40.717789 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716020    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:29:40.717789 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716023    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:29:40.717789 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716025    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:29:40.717789 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716028    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:29:40.717789 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716030    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:29:40.717789 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716032    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:29:40.717789 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716035    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:29:40.718248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716038    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:29:40.718248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716040    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:29:40.718248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716043    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:29:40.718248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716046    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:29:40.718248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716048    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:29:40.718248 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.716053    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 16:29:40.718248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716189    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:29:40.718248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716195    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:29:40.718248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716198    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:29:40.718248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716201    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:29:40.718248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716204    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:29:40.718248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716207    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:29:40.718248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716210    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:29:40.718248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716214    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:29:40.718248 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716217    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716220    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716222    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716226    2557 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716229    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716232    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716235    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716240    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716243    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716245    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716248    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716251    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716254    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716256    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716259    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716262    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716264    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716267    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716269    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716272    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:29:40.718639 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716274    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:29:40.719137 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716277    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:29:40.719137 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716280    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:29:40.719137 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716282    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:29:40.719137 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716285    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:29:40.719137 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716287    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:29:40.719137 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716290    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:29:40.719137 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716293    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:29:40.719137 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716295    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:29:40.719137 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716298    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:29:40.719137 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716301    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:29:40.719137 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716304    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:29:40.719137 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716306    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:29:40.719137 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716309    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:29:40.719137 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716312    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:29:40.719137 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716314    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:29:40.719137 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716317    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:29:40.719137 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716320    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:29:40.719137 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716323    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:29:40.719137 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716326    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716328    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716332    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716336    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716339    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716341    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716344    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716346    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716349    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716352    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716354    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716357    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716359    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716362    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716364    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716367    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716370    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716372    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716375    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716377    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:29:40.719665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716380    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716382    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716385    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716387    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716391    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716393    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716396    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716398    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716401    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716404    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716407    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716415    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716418    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716420    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716423    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716425    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716428    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716431    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716433    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716436    2557 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:29:40.720147 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716438    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:29:40.720761 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716442    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:29:40.720761 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716445    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:29:40.720761 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716448    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:29:40.720761 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716451    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:29:40.720761 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716454    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:29:40.720761 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716457    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:29:40.720761 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716460    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:29:40.720761 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716463    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:29:40.720761 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716466    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:29:40.720761 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716469    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:29:40.720761 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:40.716472    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:29:40.720761 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.716476    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 16:29:40.720761 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.716598    2557 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 16:29:40.720761 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.719114    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 16:29:40.721110 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.720256    2557 server.go:1019] "Starting client certificate rotation"
Sep 11 16:29:40.721110 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.720375    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 16:29:40.721110 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.720433    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 16:29:40.723245 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.723228    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 16:29:40.724625 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.724592    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 16:29:40.736177 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.736161    2557 log.go:25] "Validated CRI v1 runtime API"
Sep 11 16:29:40.741200 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.741179    2557 log.go:25] "Validated CRI v1 image API"
Sep 11 16:29:40.742113 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.742095    2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 16:29:40.745772 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.745750    2557 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 99c6631a-0eb5-4ac2-858c-1deb16ec44fe:/dev/nvme0n1p3 9eb74415-02e3-4a4f-8c71-f1184fdc3778:/dev/nvme0n1p4]
Sep 11 16:29:40.745852 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.745771    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 16:29:40.752532 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.752409    2557 manager.go:216] Machine: {Timestamp:2026-09-11 16:29:40.750976371 +0000 UTC m=+0.369250536 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099195 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29cf5a5ecdeb8ef080ab71360cdeee SystemUUID:ec29cf5a-5ecd-eb8e-f080-ab71360cdeee BootID:54eb077e-e9b9-492a-968d-5dbb44c8a211 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:04:6c:4c:73:af Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:04:6c:4c:73:af Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:bb:70:7c:3b:9b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 16:29:40.752532 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.752520    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 16:29:40.752686 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.752673    2557 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 16:29:40.755936 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.755916    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 16:29:40.756474 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.756440    2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 16:29:40.756642 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.756478    2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-196.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 16:29:40.757362 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.757352    2557 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 16:29:40.757401 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.757365    2557 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 16:29:40.757401 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.757373    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 16:29:40.758199 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.758187    2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 16:29:40.759466 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.759456    2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 16:29:40.765129 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.765117    2557 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 16:29:40.765257 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.765248    2557 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 16:29:40.765294 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.765278    2557 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 16:29:40.765294 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.765289    2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 16:29:40.765351 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.765302    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 16:29:40.765351 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.765312    2557 kubelet.go:398] "Adding apiserver pod source"
Sep 11 16:29:40.765351 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.765322    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 16:29:40.765788 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.765773    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 16:29:40.765868 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.765805    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 16:29:40.768444 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.768415    2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 16:29:40.771488 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.771470    2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 16:29:40.771555 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.771504    2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 16:29:40.773704 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.773687    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 16:29:40.773704 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.773704    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 16:29:40.773860 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.773710    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 16:29:40.773860 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.773716    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 16:29:40.773860 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.773725    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 16:29:40.773860 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.773742    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 16:29:40.773860 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.773761    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 16:29:40.773860 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.773767    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 16:29:40.773860 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.773774    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 16:29:40.773860 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.773780    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 16:29:40.773860 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.773790    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 16:29:40.773860 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.773796    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 16:29:40.775475 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.775457    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 16:29:40.775536 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.775478    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 16:29:40.777349 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.777328    2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-196.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 16:29:40.777424 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:40.777354    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 16:29:40.777424 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:40.777368    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-196.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 16:29:40.780094 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.780078    2557 server.go:1268] "Started kubelet"
Sep 11 16:29:40.780176 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.780103    2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 16:29:40.780221 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.780206    2557 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 16:29:40.780370 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.780329    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 16:29:40.783442 ip-10-0-134-196 systemd[1]: Started Kubernetes Kubelet.
Sep 11 16:29:40.787677 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.787642    2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 16:29:40.789125 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.789108    2557 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 16:29:40.789125 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:40.789122    2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 16:29:40.794146 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.794126    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 16:29:40.794852 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.794837    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 16:29:40.794987 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:40.794966    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-196.ec2.internal\" not found"
Sep 11 16:29:40.795665 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.795625    2557 factory.go:55] Registering systemd factory
Sep 11 16:29:40.795665 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.795645    2557 factory.go:223] Registration of the systemd container factory successfully
Sep 11 16:29:40.795825 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.795679    2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 16:29:40.795825 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.795696    2557 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 16:29:40.795825 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.795710    2557 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 16:29:40.795825 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.795813    2557 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 16:29:40.795825 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.795821    2557 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 16:29:40.796047 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.795943    2557 factory.go:153] Registering CRI-O factory
Sep 11 16:29:40.796047 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.795959    2557 factory.go:223] Registration of the crio container factory successfully
Sep 11 16:29:40.796047 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.796007    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 16:29:40.796047 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.796030    2557 factory.go:103] Registering Raw factory
Sep 11 16:29:40.796047 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.796045    2557 manager.go:1196] Started watching for new ooms in manager
Sep 11 16:29:40.796410 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.796397    2557 manager.go:349] Starting recovery of all containers
Sep 11 16:29:40.804343 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:40.804301    2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-196.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 16:29:40.804343 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:40.804323    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 16:29:40.805594 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:40.804410    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-196.ec2.internal.18d451273359ee99  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-196.ec2.internal,UID:ip-10-0-134-196.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-196.ec2.internal,},FirstTimestamp:2026-09-11 16:29:40.780035737 +0000 UTC m=+0.398309900,LastTimestamp:2026-09-11 16:29:40.780035737 +0000 UTC m=+0.398309900,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-196.ec2.internal,}"
Sep 11 16:29:40.806350 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.806335    2557 manager.go:354] Recovery completed
Sep 11 16:29:40.810870 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.810856    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:29:40.813011 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.812983    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:29:40.813079 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.813025    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:29:40.813079 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.813039    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:29:40.813677 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.813662    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 16:29:40.813677 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.813677    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 16:29:40.813875 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.813696    2557 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 16:29:40.813875 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.813666    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:29:40.814453 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.814437    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:29:40.814544 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.814458    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:29:40.814544 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.814468    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:29:40.814666 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.814465    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l8v5w"
Sep 11 16:29:40.814958 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:40.814876    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-196.ec2.internal.18d451273551133c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-196.ec2.internal,UID:ip-10-0-134-196.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-196.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-196.ec2.internal,},FirstTimestamp:2026-09-11 16:29:40.813009724 +0000 UTC m=+0.431283884,LastTimestamp:2026-09-11 16:29:40.813009724 +0000 UTC m=+0.431283884,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-196.ec2.internal,}"
Sep 11 16:29:40.815974 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.815958    2557 policy_none.go:49] "None policy: Start"
Sep 11 16:29:40.815974 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.815976    2557 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 16:29:40.816062 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.815986    2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 16:29:40.817998 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.817983    2557 policy_none.go:47] "Start"
Sep 11 16:29:40.822764 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.822747    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l8v5w"
Sep 11 16:29:40.823889 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:40.823797    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-196.ec2.internal.18d45127355169ce  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-196.ec2.internal,UID:ip-10-0-134-196.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-196.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-196.ec2.internal,},FirstTimestamp:2026-09-11 16:29:40.813031886 +0000 UTC m=+0.431306047,LastTimestamp:2026-09-11 16:29:40.813031886 +0000 UTC m=+0.431306047,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-196.ec2.internal,}"
Sep 11 16:29:40.827183 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:40.827117    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-196.ec2.internal.18d4512735519846  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-196.ec2.internal,UID:ip-10-0-134-196.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-196.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-196.ec2.internal,},FirstTimestamp:2026-09-11 16:29:40.813043782 +0000 UTC m=+0.431317943,LastTimestamp:2026-09-11 16:29:40.813043782 +0000 UTC m=+0.431317943,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-196.ec2.internal,}"
Sep 11 16:29:40.862322 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.862305    2557 manager.go:337] "Starting Device Plugin manager"
Sep 11 16:29:40.878348 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:40.862343    2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 16:29:40.878348 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.862358    2557 server.go:87] "Starting device plugin registration server"
Sep 11 16:29:40.878348 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.862656    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 16:29:40.878348 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.862673    2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 16:29:40.878348 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.862753    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 16:29:40.878348 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.862828    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 16:29:40.878348 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.862837    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 16:29:40.878348 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:40.863413    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 16:29:40.878348 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:40.863481    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-196.ec2.internal\" not found"
Sep 11 16:29:40.938214 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.938171    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 16:29:40.939402 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.939375    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 16:29:40.939524 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.939448    2557 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 16:29:40.939524 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.939484    2557 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 16:29:40.939637 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:40.939532    2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 16:29:40.942311 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.942294    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:29:40.963738 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.963642    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:29:40.967151 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.967134    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:29:40.967249 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.967165    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:29:40.967249 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.967176    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:29:40.967249 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.967198    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-196.ec2.internal"
Sep 11 16:29:40.977769 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:40.977749    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-196.ec2.internal"
Sep 11 16:29:40.977822 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:40.977776    2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-196.ec2.internal\": node \"ip-10-0-134-196.ec2.internal\" not found"
Sep 11 16:29:41.017588 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:41.017562    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-196.ec2.internal\" not found"
Sep 11 16:29:41.040218 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.040191    2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-196.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal"]
Sep 11 16:29:41.040327 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.040265    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:29:41.041284 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.041261    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:29:41.041370 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.041299    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:29:41.041370 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.041322    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:29:41.043768 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.043755    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:29:41.043870 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.043855    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-196.ec2.internal"
Sep 11 16:29:41.043909 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.043891    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:29:41.044592 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.044575    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:29:41.044680 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.044621    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:29:41.044680 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.044641    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:29:41.044680 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.044651    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:29:41.044790 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.044623    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:29:41.044790 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.044711    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:29:41.046999 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.046985    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal"
Sep 11 16:29:41.047049 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.047012    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:29:41.047769 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.047750    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:29:41.047866 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.047779    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:29:41.047866 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.047793    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:29:41.066414 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:41.066392    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-196.ec2.internal\" not found" node="ip-10-0-134-196.ec2.internal"
Sep 11 16:29:41.070953 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:41.070937    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-196.ec2.internal\" not found" node="ip-10-0-134-196.ec2.internal"
Sep 11 16:29:41.096862 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.096826    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/860d5eb6cfec03b3afce795bf172f3a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal\" (UID: \"860d5eb6cfec03b3afce795bf172f3a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal"
Sep 11 16:29:41.096862 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.096863    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/860d5eb6cfec03b3afce795bf172f3a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal\" (UID: \"860d5eb6cfec03b3afce795bf172f3a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal"
Sep 11 16:29:41.097045 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.096880    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/390ec4ba6e0c3aa7c2a9e1ee487282c4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-196.ec2.internal\" (UID: \"390ec4ba6e0c3aa7c2a9e1ee487282c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-196.ec2.internal"
Sep 11 16:29:41.117956 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:41.117928    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-196.ec2.internal\" not found"
Sep 11 16:29:41.197341 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.197303    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/860d5eb6cfec03b3afce795bf172f3a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal\" (UID: \"860d5eb6cfec03b3afce795bf172f3a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal"
Sep 11 16:29:41.197341 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.197339    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/860d5eb6cfec03b3afce795bf172f3a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal\" (UID: \"860d5eb6cfec03b3afce795bf172f3a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal"
Sep 11 16:29:41.197546 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.197362    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/390ec4ba6e0c3aa7c2a9e1ee487282c4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-196.ec2.internal\" (UID: \"390ec4ba6e0c3aa7c2a9e1ee487282c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-196.ec2.internal"
Sep 11 16:29:41.197546 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.197417    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/860d5eb6cfec03b3afce795bf172f3a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal\" (UID: \"860d5eb6cfec03b3afce795bf172f3a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal"
Sep 11 16:29:41.197546 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.197435    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/390ec4ba6e0c3aa7c2a9e1ee487282c4-config\") pod \"kube-apiserver-proxy-ip-10-0-134-196.ec2.internal\" (UID: \"390ec4ba6e0c3aa7c2a9e1ee487282c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-196.ec2.internal"
Sep 11 16:29:41.197546 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.197441    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/860d5eb6cfec03b3afce795bf172f3a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal\" (UID: \"860d5eb6cfec03b3afce795bf172f3a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal"
Sep 11 16:29:41.218321 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:41.218249    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-196.ec2.internal\" not found"
Sep 11 16:29:41.319548 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:41.319505    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-196.ec2.internal\" not found"
Sep 11 16:29:41.371409 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.371373    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-196.ec2.internal"
Sep 11 16:29:41.373674 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.373656    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal"
Sep 11 16:29:41.419840 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:41.419649    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-196.ec2.internal\" not found"
Sep 11 16:29:41.521056 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:41.520965    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-196.ec2.internal\" not found"
Sep 11 16:29:41.622534 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:41.622474    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-196.ec2.internal\" not found"
Sep 11 16:29:41.720245 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.720216    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 16:29:41.720748 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.720371    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 16:29:41.723673 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:41.723637    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-196.ec2.internal\" not found"
Sep 11 16:29:41.824352 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:41.824260    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-196.ec2.internal\" not found"
Sep 11 16:29:41.829643 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.829600    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 16:24:41 +0000 UTC" deadline="2028-03-06 02:11:34.387303634 +0000 UTC"
Sep 11 16:29:41.829643 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.829642    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12993h41m52.557665377s"
Sep 11 16:29:41.851618 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.851580    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:29:41.855319 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.855303    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:29:41.856394 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.856375    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:29:41.856493 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.856412    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:29:41.856493 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:41.856424    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:29:41.924922 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:41.924882    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-196.ec2.internal\" not found"
Sep 11 16:29:42.025920 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:42.025884    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-196.ec2.internal\" not found"
Sep 11 16:29:42.030946 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.030916    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:29:42.097487 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.097398    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-196.ec2.internal"
Sep 11 16:29:42.099971 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.099953    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:29:42.105689 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.105667    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 16:29:42.106423 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.106401    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal"
Sep 11 16:29:42.120377 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:42.120346    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod860d5eb6cfec03b3afce795bf172f3a0.slice/crio-a1ed3a14614a1ecb6b721c40a9e7fc32f5e3ef7e9f54eba41469c90f7ace5582 WatchSource:0}: Error finding container a1ed3a14614a1ecb6b721c40a9e7fc32f5e3ef7e9f54eba41469c90f7ace5582: Status 404 returned error can't find the container with id a1ed3a14614a1ecb6b721c40a9e7fc32f5e3ef7e9f54eba41469c90f7ace5582
Sep 11 16:29:42.122822 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.122792    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 16:29:42.124672 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.124654    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:29:42.163655 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:42.163626    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod390ec4ba6e0c3aa7c2a9e1ee487282c4.slice/crio-23d8fe651fa1f1d47925d284864a0e33366073ae448e6c6232dde16d0c1896c6 WatchSource:0}: Error finding container 23d8fe651fa1f1d47925d284864a0e33366073ae448e6c6232dde16d0c1896c6: Status 404 returned error can't find the container with id 23d8fe651fa1f1d47925d284864a0e33366073ae448e6c6232dde16d0c1896c6
Sep 11 16:29:42.768684 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.768646    2557 apiserver.go:52] "Watching apiserver"
Sep 11 16:29:42.771408 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.771379    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:29:42.781226 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.781193    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 16:29:42.781732 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.781697    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-ptdtw","openshift-image-registry/node-ca-f9nlm","openshift-network-diagnostics/network-check-target-2wxbp","openshift-network-operator/iptables-alerter-q6wwm","openshift-ovn-kubernetes/ovnkube-node-h666m","kube-system/global-pull-secret-syncer-4qbz6","kube-system/kube-apiserver-proxy-ip-10-0-134-196.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh","openshift-cluster-node-tuning-operator/tuned-tjrdf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal","openshift-multus/multus-additional-cni-plugins-mjzkx","openshift-multus/multus-scmbh","openshift-multus/network-metrics-daemon-tv8zk","kube-system/konnectivity-agent-7f9zb"]
Sep 11 16:29:42.784595 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.784574    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:29:42.784713 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:42.784679    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wxbp" podUID="29971043-47bb-4a97-8e4c-696ff995faf7"
Sep 11 16:29:42.787749 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.787322    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.789528 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.789485    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:29:42.789645 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:42.789573    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv8zk" podUID="9868a0a5-34ec-40ba-8178-c0a1bd64a921"
Sep 11 16:29:42.790180 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.789978    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g98cr\""
Sep 11 16:29:42.790180 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.790053    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 16:29:42.790421 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.790401    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 16:29:42.790551 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.790531    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 16:29:42.790678 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.790618    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 16:29:42.790786 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.790758    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 16:29:42.791992 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.791968    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f9nlm"
Sep 11 16:29:42.794433 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.794411    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 16:29:42.794968 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.794700    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 16:29:42.794968 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.794714    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q6wwm"
Sep 11 16:29:42.794968 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.794743    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f8jpd\""
Sep 11 16:29:42.794968 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.794755    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 16:29:42.795242 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.794978    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 16:29:42.797176 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.797158    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.798409 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.798196    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dq98t\""
Sep 11 16:29:42.798409 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.798251    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 16:29:42.798409 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.798328    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 16:29:42.798409 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.798367    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 16:29:42.800110 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.800076    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 16:29:42.800243 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.800232    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-224kn\""
Sep 11 16:29:42.800493 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.800472    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:42.800590 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:42.800565    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qbz6" podUID="35e7cb6b-bc4e-456f-94af-d0bf29f87e76"
Sep 11 16:29:42.800975 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.800953    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 16:29:42.801100 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.800994    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 16:29:42.801296 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.801277    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 16:29:42.801296 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.801288    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 16:29:42.801445 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.801315    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 16:29:42.803121 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.803102    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ptdtw"
Sep 11 16:29:42.806087 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.806065    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9cddb\""
Sep 11 16:29:42.806356 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.806232    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 16:29:42.806356 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.806312    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:42.806840 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.806786    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 16:29:42.808995 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.808919    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-run-netns\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.808995 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.808958    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc30a043-24a9-456a-94a2-a47fd49e9475-cni-binary-copy\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.808995 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.808988    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc30a043-24a9-456a-94a2-a47fd49e9475-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.809224 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809016    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc30a043-24a9-456a-94a2-a47fd49e9475-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.809224 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809045    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5da99747-5918-4454-b404-349af508e59b-serviceca\") pod \"node-ca-f9nlm\" (UID: \"5da99747-5918-4454-b404-349af508e59b\") " pod="openshift-image-registry/node-ca-f9nlm"
Sep 11 16:29:42.809224 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809069    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-cni-bin\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.809224 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809093    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5mnb\" (UniqueName: \"kubernetes.io/projected/9868a0a5-34ec-40ba-8178-c0a1bd64a921-kube-api-access-s5mnb\") pod \"network-metrics-daemon-tv8zk\" (UID: \"9868a0a5-34ec-40ba-8178-c0a1bd64a921\") " pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:29:42.809224 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809118    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d72bc55-1cd2-492c-b327-98c0048d53ca-host-slash\") pod \"iptables-alerter-q6wwm\" (UID: \"6d72bc55-1cd2-492c-b327-98c0048d53ca\") " pod="openshift-network-operator/iptables-alerter-q6wwm"
Sep 11 16:29:42.809224 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809142    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-systemd-units\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.809224 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809166    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-run-systemd\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.809224 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809190    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-var-lib-openvswitch\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.809224 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809214    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-etc-openvswitch\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.809704 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809239    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-run-openvswitch\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.809704 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809265    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/82cd4407-5809-4cad-b2c5-6da954810415-ovnkube-config\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.809704 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809290    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xszps\" (UniqueName: \"kubernetes.io/projected/82cd4407-5809-4cad-b2c5-6da954810415-kube-api-access-xszps\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.809704 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809316    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5da99747-5918-4454-b404-349af508e59b-host\") pod \"node-ca-f9nlm\" (UID: \"5da99747-5918-4454-b404-349af508e59b\") " pod="openshift-image-registry/node-ca-f9nlm"
Sep 11 16:29:42.809704 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809340    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc30a043-24a9-456a-94a2-a47fd49e9475-cnibin\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.809704 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809367    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-node-log\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.809704 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809405    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-log-socket\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.809704 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809435    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-run-ovn-kubernetes\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.809704 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809459    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-cni-netd\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.809704 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809493    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.809704 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809526    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc30a043-24a9-456a-94a2-a47fd49e9475-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.809704 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809550    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-slash\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.809704 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809574    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/82cd4407-5809-4cad-b2c5-6da954810415-env-overrides\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.809704 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809600    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8qw9\" (UniqueName: \"kubernetes.io/projected/bc30a043-24a9-456a-94a2-a47fd49e9475-kube-api-access-v8qw9\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.809704 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809645    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4rht\" (UniqueName: \"kubernetes.io/projected/5da99747-5918-4454-b404-349af508e59b-kube-api-access-h4rht\") pod \"node-ca-f9nlm\" (UID: \"5da99747-5918-4454-b404-349af508e59b\") " pod="openshift-image-registry/node-ca-f9nlm"
Sep 11 16:29:42.809704 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809674    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-kubelet\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.810498 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809716    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-run-ovn\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.810498 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809754    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d72bc55-1cd2-492c-b327-98c0048d53ca-iptables-alerter-script\") pod \"iptables-alerter-q6wwm\" (UID: \"6d72bc55-1cd2-492c-b327-98c0048d53ca\") " pod="openshift-network-operator/iptables-alerter-q6wwm"
Sep 11 16:29:42.810498 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809781    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrwwt\" (UniqueName: \"kubernetes.io/projected/6d72bc55-1cd2-492c-b327-98c0048d53ca-kube-api-access-rrwwt\") pod \"iptables-alerter-q6wwm\" (UID: \"6d72bc55-1cd2-492c-b327-98c0048d53ca\") " pod="openshift-network-operator/iptables-alerter-q6wwm"
Sep 11 16:29:42.810498 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809806    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc30a043-24a9-456a-94a2-a47fd49e9475-system-cni-dir\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.810498 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809833    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bgcc\" (UniqueName: \"kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc\") pod \"network-check-target-2wxbp\" (UID: \"29971043-47bb-4a97-8e4c-696ff995faf7\") " pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:29:42.810498 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809859    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/82cd4407-5809-4cad-b2c5-6da954810415-ovn-node-metrics-cert\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.810498 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809887    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/82cd4407-5809-4cad-b2c5-6da954810415-ovnkube-script-lib\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.810498 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.809913    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs\") pod \"network-metrics-daemon-tv8zk\" (UID: \"9868a0a5-34ec-40ba-8178-c0a1bd64a921\") " pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:29:42.811733 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.811047    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 16:29:42.811733 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.811080    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hvqvj\""
Sep 11 16:29:42.811733 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.811232    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 16:29:42.811733 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.811243    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 16:29:42.811733 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.811407    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:42.814420 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.814398    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-97wtp\""
Sep 11 16:29:42.814632 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.814614    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 16:29:42.814734 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.814672    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 16:29:42.814926 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.814906    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 16:29:42.815137 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.815119    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7f9zb"
Sep 11 16:29:42.817822 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.817802    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-scmbh"
Sep 11 16:29:42.818032 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.818006    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 16:29:42.818170 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.818072    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lzvtt\""
Sep 11 16:29:42.818351 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.818330    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 16:29:42.820416 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.820396    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 16:29:42.820928 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.820910    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5h4lq\""
Sep 11 16:29:42.839123 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.839067    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g484q"
Sep 11 16:29:42.848048 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.848018    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g484q"
Sep 11 16:29:42.897177 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.897133    2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 16:29:42.910140 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910097    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc30a043-24a9-456a-94a2-a47fd49e9475-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.910304 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910156    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret\") pod \"global-pull-secret-syncer-4qbz6\" (UID: \"35e7cb6b-bc4e-456f-94af-d0bf29f87e76\") " pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:42.910304 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910187    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-multus-cni-dir\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:42.910304 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910216    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-host-var-lib-kubelet\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:42.910304 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910242    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-etc-modprobe-d\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:42.910304 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910266    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-var-lib-kubelet\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:42.910304 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910290    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-host\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:42.910635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910318    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-cni-bin\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.910635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910347    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5mnb\" (UniqueName: \"kubernetes.io/projected/9868a0a5-34ec-40ba-8178-c0a1bd64a921-kube-api-access-s5mnb\") pod \"network-metrics-daemon-tv8zk\" (UID: \"9868a0a5-34ec-40ba-8178-c0a1bd64a921\") " pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:29:42.910635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910371    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-system-cni-dir\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:42.910635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910395    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-etc-kubernetes\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:42.910635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910422    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-run-systemd\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.910635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910448    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-etc-openvswitch\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.910635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910473    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-run-openvswitch\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.910635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910498    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xszps\" (UniqueName: \"kubernetes.io/projected/82cd4407-5809-4cad-b2c5-6da954810415-kube-api-access-xszps\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.910635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910527    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-etc-kubernetes\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:42.910635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910551    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fz8v\" (UniqueName: \"kubernetes.io/projected/46ac947a-de40-4a38-b72e-f3baac35980d-kube-api-access-4fz8v\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:42.910635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910576    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/626143a7-d803-4b33-ae26-1cd1802b8cf0-konnectivity-ca\") pod \"konnectivity-agent-7f9zb\" (UID: \"626143a7-d803-4b33-ae26-1cd1802b8cf0\") " pod="kube-system/konnectivity-agent-7f9zb"
Sep 11 16:29:42.910635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910601    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-node-log\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.910635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910629    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.911336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910657    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc30a043-24a9-456a-94a2-a47fd49e9475-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.911336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910700    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f2239-9a00-42fb-97bf-9359a3366f95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:42.911336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910729    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-slash\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.911336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910756    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/82cd4407-5809-4cad-b2c5-6da954810415-env-overrides\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.911336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910784    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4rht\" (UniqueName: \"kubernetes.io/projected/5da99747-5918-4454-b404-349af508e59b-kube-api-access-h4rht\") pod \"node-ca-f9nlm\" (UID: \"5da99747-5918-4454-b404-349af508e59b\") " pod="openshift-image-registry/node-ca-f9nlm"
Sep 11 16:29:42.911336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910810    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-host-run-netns\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:42.911336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910835    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01d4b389-7479-4f04-bc20-adb48efdddcd-multus-daemon-config\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:42.911336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910872    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-lib-modules\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:42.911336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910897    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/46ac947a-de40-4a38-b72e-f3baac35980d-etc-tuned\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:42.911336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910921    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-run-ovn\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.911336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910959    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-run-openvswitch\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.911336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910967    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fac41999-310c-4cbe-aa82-073191607d1d-hosts-file\") pod \"node-resolver-ptdtw\" (UID: \"fac41999-310c-4cbe-aa82-073191607d1d\") " pod="openshift-dns/node-resolver-ptdtw"
Sep 11 16:29:42.911336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.910989    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fac41999-310c-4cbe-aa82-073191607d1d-tmp-dir\") pod \"node-resolver-ptdtw\" (UID: \"fac41999-310c-4cbe-aa82-073191607d1d\") " pod="openshift-dns/node-resolver-ptdtw"
Sep 11 16:29:42.911336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911013    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f2239-9a00-42fb-97bf-9359a3366f95-socket-dir\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:42.911336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911036    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6cz7\" (UniqueName: \"kubernetes.io/projected/2f7f2239-9a00-42fb-97bf-9359a3366f95-kube-api-access-h6cz7\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:42.911336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911059    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-run\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:42.911336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46ac947a-de40-4a38-b72e-f3baac35980d-tmp\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:42.912161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911115    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc30a043-24a9-456a-94a2-a47fd49e9475-system-cni-dir\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.912161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911139    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-multus-socket-dir-parent\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:42.912161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911165    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-host-run-multus-certs\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:42.912161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911190    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/626143a7-d803-4b33-ae26-1cd1802b8cf0-agent-certs\") pod \"konnectivity-agent-7f9zb\" (UID: \"626143a7-d803-4b33-ae26-1cd1802b8cf0\") " pod="kube-system/konnectivity-agent-7f9zb"
Sep 11 16:29:42.912161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911219    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bgcc\" (UniqueName: \"kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc\") pod \"network-check-target-2wxbp\" (UID: \"29971043-47bb-4a97-8e4c-696ff995faf7\") " pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:29:42.912161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911259    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/82cd4407-5809-4cad-b2c5-6da954810415-ovn-node-metrics-cert\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.912161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911286    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/82cd4407-5809-4cad-b2c5-6da954810415-ovnkube-script-lib\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.912161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911313    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-hostroot\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:42.912161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911339    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-etc-sysctl-conf\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:42.912161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911370    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-sys\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:42.912161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911400    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-run-netns\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.912161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911438    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc30a043-24a9-456a-94a2-a47fd49e9475-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.912161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911466    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5da99747-5918-4454-b404-349af508e59b-serviceca\") pod \"node-ca-f9nlm\" (UID: \"5da99747-5918-4454-b404-349af508e59b\") " pod="openshift-image-registry/node-ca-f9nlm"
Sep 11 16:29:42.912161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911493    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-host-var-lib-cni-multus\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:42.912161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911520    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f7f2239-9a00-42fb-97bf-9359a3366f95-sys-fs\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:42.912161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911548    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d72bc55-1cd2-492c-b327-98c0048d53ca-host-slash\") pod \"iptables-alerter-q6wwm\" (UID: \"6d72bc55-1cd2-492c-b327-98c0048d53ca\") " pod="openshift-network-operator/iptables-alerter-q6wwm"
Sep 11 16:29:42.912161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911577    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-kubelet-config\") pod \"global-pull-secret-syncer-4qbz6\" (UID: \"35e7cb6b-bc4e-456f-94af-d0bf29f87e76\") " pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:42.913029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911605    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-cnibin\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:42.913029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911633    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-etc-sysconfig\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:42.913029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911651    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bc30a043-24a9-456a-94a2-a47fd49e9475-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.913029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911664    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d72bc55-1cd2-492c-b327-98c0048d53ca-iptables-alerter-script\") pod \"iptables-alerter-q6wwm\" (UID: \"6d72bc55-1cd2-492c-b327-98c0048d53ca\") " pod="openshift-network-operator/iptables-alerter-q6wwm"
Sep 11 16:29:42.913029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911717    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrwwt\" (UniqueName: \"kubernetes.io/projected/6d72bc55-1cd2-492c-b327-98c0048d53ca-kube-api-access-rrwwt\") pod \"iptables-alerter-q6wwm\" (UID: \"6d72bc55-1cd2-492c-b327-98c0048d53ca\") " pod="openshift-network-operator/iptables-alerter-q6wwm"
Sep 11 16:29:42.913029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911865    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-cni-bin\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.913029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911865    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-run-ovn\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.913029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911923    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2f7v\" (UniqueName: \"kubernetes.io/projected/fac41999-310c-4cbe-aa82-073191607d1d-kube-api-access-q2f7v\") pod \"node-resolver-ptdtw\" (UID: \"fac41999-310c-4cbe-aa82-073191607d1d\") " pod="openshift-dns/node-resolver-ptdtw"
Sep 11 16:29:42.913029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911969    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-systemd-units\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.913029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.911998    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-var-lib-openvswitch\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.913029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912025    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/82cd4407-5809-4cad-b2c5-6da954810415-ovnkube-config\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.913029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912055    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5da99747-5918-4454-b404-349af508e59b-host\") pod \"node-ca-f9nlm\" (UID: \"5da99747-5918-4454-b404-349af508e59b\") " pod="openshift-image-registry/node-ca-f9nlm"
Sep 11 16:29:42.913029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912081    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-etc-systemd\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:42.913029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912110    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8qw9\" (UniqueName: \"kubernetes.io/projected/bc30a043-24a9-456a-94a2-a47fd49e9475-kube-api-access-v8qw9\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.913029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912138    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-host-var-lib-cni-bin\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:42.913029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912167    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc30a043-24a9-456a-94a2-a47fd49e9475-cnibin\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.913029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912200    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-log-socket\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.913955 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912229    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-run-ovn-kubernetes\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.913955 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912270    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-cni-netd\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.913955 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912299    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f7f2239-9a00-42fb-97bf-9359a3366f95-etc-selinux\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:42.913955 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912328    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-dbus\") pod \"global-pull-secret-syncer-4qbz6\" (UID: \"35e7cb6b-bc4e-456f-94af-d0bf29f87e76\") " pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:42.913955 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912358    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-host-run-k8s-cni-cncf-io\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:42.913955 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912430    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-kubelet\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.913955 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912444    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc30a043-24a9-456a-94a2-a47fd49e9475-system-cni-dir\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.913955 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912460    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-multus-conf-dir\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:42.913955 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912490    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01d4b389-7479-4f04-bc20-adb48efdddcd-cni-binary-copy\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:42.913955 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912492    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-run-systemd\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.913955 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912525    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-etc-sysctl-d\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:42.913955 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912541    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-node-log\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.913955 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912556    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs\") pod \"network-metrics-daemon-tv8zk\" (UID: \"9868a0a5-34ec-40ba-8178-c0a1bd64a921\") " pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:29:42.913955 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912583    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssk4c\" (UniqueName: \"kubernetes.io/projected/01d4b389-7479-4f04-bc20-adb48efdddcd-kube-api-access-ssk4c\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:42.913955 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912583    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.913955 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912611    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f2239-9a00-42fb-97bf-9359a3366f95-registration-dir\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:42.913955 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912630    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-etc-openvswitch\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.914779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912643    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f2239-9a00-42fb-97bf-9359a3366f95-device-dir\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:42.914779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912642    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-run-netns\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.914779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912711    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5da99747-5918-4454-b404-349af508e59b-host\") pod \"node-ca-f9nlm\" (UID: \"5da99747-5918-4454-b404-349af508e59b\") " pod="openshift-image-registry/node-ca-f9nlm"
Sep 11 16:29:42.914779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912745    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc30a043-24a9-456a-94a2-a47fd49e9475-cni-binary-copy\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.914779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912811    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc30a043-24a9-456a-94a2-a47fd49e9475-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.914779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912357    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/82cd4407-5809-4cad-b2c5-6da954810415-ovnkube-script-lib\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.914779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.912971    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc30a043-24a9-456a-94a2-a47fd49e9475-cnibin\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.914779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.913010    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-log-socket\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.914779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.913042    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-run-ovn-kubernetes\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.914779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.913079    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-cni-netd\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.914779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.913307    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc30a043-24a9-456a-94a2-a47fd49e9475-cni-binary-copy\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.914779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.913423    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/82cd4407-5809-4cad-b2c5-6da954810415-ovnkube-config\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.914779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.913532    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bc30a043-24a9-456a-94a2-a47fd49e9475-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.914779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.913587    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-var-lib-openvswitch\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.914779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.913629    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-systemd-units\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.914779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.914001    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5da99747-5918-4454-b404-349af508e59b-serviceca\") pod \"node-ca-f9nlm\" (UID: \"5da99747-5918-4454-b404-349af508e59b\") " pod="openshift-image-registry/node-ca-f9nlm"
Sep 11 16:29:42.914779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.914053    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6d72bc55-1cd2-492c-b327-98c0048d53ca-iptables-alerter-script\") pod \"iptables-alerter-q6wwm\" (UID: \"6d72bc55-1cd2-492c-b327-98c0048d53ca\") " pod="openshift-network-operator/iptables-alerter-q6wwm"
Sep 11 16:29:42.915747 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.914058    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d72bc55-1cd2-492c-b327-98c0048d53ca-host-slash\") pod \"iptables-alerter-q6wwm\" (UID: \"6d72bc55-1cd2-492c-b327-98c0048d53ca\") " pod="openshift-network-operator/iptables-alerter-q6wwm"
Sep 11 16:29:42.915747 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.914399    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 16:29:42.915747 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.914521    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-kubelet\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.915747 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:42.914615    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:29:42.915747 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:42.914714    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs podName:9868a0a5-34ec-40ba-8178-c0a1bd64a921 nodeName:}" failed. No retries permitted until 2026-09-11 16:29:43.414665219 +0000 UTC m=+3.032939387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs") pod "network-metrics-daemon-tv8zk" (UID: "9868a0a5-34ec-40ba-8178-c0a1bd64a921") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:29:42.915747 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.914775    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/82cd4407-5809-4cad-b2c5-6da954810415-host-slash\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.915747 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.915184    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/82cd4407-5809-4cad-b2c5-6da954810415-env-overrides\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.919560 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.919532    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/82cd4407-5809-4cad-b2c5-6da954810415-ovn-node-metrics-cert\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.921810 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:42.921558    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:29:42.921810 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:42.921578    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:29:42.921810 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:42.921589    2557 projected.go:196] Error preparing data for projected volume kube-api-access-9bgcc for pod openshift-network-diagnostics/network-check-target-2wxbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:29:42.921810 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:42.921651    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc podName:29971043-47bb-4a97-8e4c-696ff995faf7 nodeName:}" failed. No retries permitted until 2026-09-11 16:29:43.42163438 +0000 UTC m=+3.039908550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9bgcc" (UniqueName: "kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc") pod "network-check-target-2wxbp" (UID: "29971043-47bb-4a97-8e4c-696ff995faf7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:29:42.923502 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.923473    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5mnb\" (UniqueName: \"kubernetes.io/projected/9868a0a5-34ec-40ba-8178-c0a1bd64a921-kube-api-access-s5mnb\") pod \"network-metrics-daemon-tv8zk\" (UID: \"9868a0a5-34ec-40ba-8178-c0a1bd64a921\") " pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:29:42.923620 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.923530    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrwwt\" (UniqueName: \"kubernetes.io/projected/6d72bc55-1cd2-492c-b327-98c0048d53ca-kube-api-access-rrwwt\") pod \"iptables-alerter-q6wwm\" (UID: \"6d72bc55-1cd2-492c-b327-98c0048d53ca\") " pod="openshift-network-operator/iptables-alerter-q6wwm"
Sep 11 16:29:42.925125 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.925077    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xszps\" (UniqueName: \"kubernetes.io/projected/82cd4407-5809-4cad-b2c5-6da954810415-kube-api-access-xszps\") pod \"ovnkube-node-h666m\" (UID: \"82cd4407-5809-4cad-b2c5-6da954810415\") " pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:42.925698 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.925639    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8qw9\" (UniqueName: \"kubernetes.io/projected/bc30a043-24a9-456a-94a2-a47fd49e9475-kube-api-access-v8qw9\") pod \"multus-additional-cni-plugins-mjzkx\" (UID: \"bc30a043-24a9-456a-94a2-a47fd49e9475\") " pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:42.926654 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.926484    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4rht\" (UniqueName: \"kubernetes.io/projected/5da99747-5918-4454-b404-349af508e59b-kube-api-access-h4rht\") pod \"node-ca-f9nlm\" (UID: \"5da99747-5918-4454-b404-349af508e59b\") " pod="openshift-image-registry/node-ca-f9nlm"
Sep 11 16:29:42.948778 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.947280    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-196.ec2.internal" event={"ID":"390ec4ba6e0c3aa7c2a9e1ee487282c4","Type":"ContainerStarted","Data":"23d8fe651fa1f1d47925d284864a0e33366073ae448e6c6232dde16d0c1896c6"}
Sep 11 16:29:42.950063 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:42.950032    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal" event={"ID":"860d5eb6cfec03b3afce795bf172f3a0","Type":"ContainerStarted","Data":"a1ed3a14614a1ecb6b721c40a9e7fc32f5e3ef7e9f54eba41469c90f7ace5582"}
Sep 11 16:29:43.014030 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.013988    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f7f2239-9a00-42fb-97bf-9359a3366f95-etc-selinux\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:43.014207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014039    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-dbus\") pod \"global-pull-secret-syncer-4qbz6\" (UID: \"35e7cb6b-bc4e-456f-94af-d0bf29f87e76\") " pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:43.014207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014066    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-host-run-k8s-cni-cncf-io\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.014207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014093    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-multus-conf-dir\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.014207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014115    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01d4b389-7479-4f04-bc20-adb48efdddcd-cni-binary-copy\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.014207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014139    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-etc-sysctl-d\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.014207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014174    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssk4c\" (UniqueName: \"kubernetes.io/projected/01d4b389-7479-4f04-bc20-adb48efdddcd-kube-api-access-ssk4c\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.014207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014197    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f2239-9a00-42fb-97bf-9359a3366f95-registration-dir\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:43.014584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014211    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f7f2239-9a00-42fb-97bf-9359a3366f95-etc-selinux\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:43.014584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014224    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-dbus\") pod \"global-pull-secret-syncer-4qbz6\" (UID: \"35e7cb6b-bc4e-456f-94af-d0bf29f87e76\") " pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:43.014584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014216    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-multus-conf-dir\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.014584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014221    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f2239-9a00-42fb-97bf-9359a3366f95-device-dir\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:43.014584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014226    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-host-run-k8s-cni-cncf-io\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.014584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014270    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f2239-9a00-42fb-97bf-9359a3366f95-device-dir\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:43.014584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014290    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret\") pod \"global-pull-secret-syncer-4qbz6\" (UID: \"35e7cb6b-bc4e-456f-94af-d0bf29f87e76\") " pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:43.014584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014321    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-multus-cni-dir\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.014584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014334    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f2239-9a00-42fb-97bf-9359a3366f95-registration-dir\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:43.014584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014347    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-host-var-lib-kubelet\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.014584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014375    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-etc-modprobe-d\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.014584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014402    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-var-lib-kubelet\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.014584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014405    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-multus-cni-dir\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.014584 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:43.014428    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:29:43.014584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014480    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-host\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.014584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014500    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-etc-modprobe-d\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.014584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014536    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-var-lib-kubelet\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.015507 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:43.014549    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret podName:35e7cb6b-bc4e-456f-94af-d0bf29f87e76 nodeName:}" failed. No retries permitted until 2026-09-11 16:29:43.514526792 +0000 UTC m=+3.132800943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret") pod "global-pull-secret-syncer-4qbz6" (UID: "35e7cb6b-bc4e-456f-94af-d0bf29f87e76") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:29:43.015507 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014429    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-host\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.015507 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014546    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-host-var-lib-kubelet\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.015507 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014592    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-system-cni-dir\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.015507 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014616    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-etc-kubernetes\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.015507 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014658    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-etc-kubernetes\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.015507 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014645    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-etc-sysctl-d\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.015507 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014685    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fz8v\" (UniqueName: \"kubernetes.io/projected/46ac947a-de40-4a38-b72e-f3baac35980d-kube-api-access-4fz8v\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.015507 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014711    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/626143a7-d803-4b33-ae26-1cd1802b8cf0-konnectivity-ca\") pod \"konnectivity-agent-7f9zb\" (UID: \"626143a7-d803-4b33-ae26-1cd1802b8cf0\") " pod="kube-system/konnectivity-agent-7f9zb"
Sep 11 16:29:43.015507 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014718    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-system-cni-dir\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.015507 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014739    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f2239-9a00-42fb-97bf-9359a3366f95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:43.015507 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014751    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-etc-kubernetes\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.015507 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014767    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-host-run-netns\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.015507 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014793    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01d4b389-7479-4f04-bc20-adb48efdddcd-multus-daemon-config\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.015507 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014807    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-host-run-netns\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.015507 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014713    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-etc-kubernetes\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.015507 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014824    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/01d4b389-7479-4f04-bc20-adb48efdddcd-cni-binary-copy\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.016344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014835    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f2239-9a00-42fb-97bf-9359a3366f95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:43.016344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014820    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-lib-modules\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.016344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014880    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/46ac947a-de40-4a38-b72e-f3baac35980d-etc-tuned\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.016344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014901    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fac41999-310c-4cbe-aa82-073191607d1d-hosts-file\") pod \"node-resolver-ptdtw\" (UID: \"fac41999-310c-4cbe-aa82-073191607d1d\") " pod="openshift-dns/node-resolver-ptdtw"
Sep 11 16:29:43.016344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014913    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-lib-modules\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.016344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014916    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fac41999-310c-4cbe-aa82-073191607d1d-tmp-dir\") pod \"node-resolver-ptdtw\" (UID: \"fac41999-310c-4cbe-aa82-073191607d1d\") " pod="openshift-dns/node-resolver-ptdtw"
Sep 11 16:29:43.016344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014955    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f2239-9a00-42fb-97bf-9359a3366f95-socket-dir\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:43.016344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.014986    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6cz7\" (UniqueName: \"kubernetes.io/projected/2f7f2239-9a00-42fb-97bf-9359a3366f95-kube-api-access-h6cz7\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:43.016344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015013    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-run\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.016344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015037    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46ac947a-de40-4a38-b72e-f3baac35980d-tmp\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.016344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015043    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fac41999-310c-4cbe-aa82-073191607d1d-hosts-file\") pod \"node-resolver-ptdtw\" (UID: \"fac41999-310c-4cbe-aa82-073191607d1d\") " pod="openshift-dns/node-resolver-ptdtw"
Sep 11 16:29:43.016344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015064    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-multus-socket-dir-parent\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.016344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015090    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-host-run-multus-certs\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.016344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015116    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/626143a7-d803-4b33-ae26-1cd1802b8cf0-agent-certs\") pod \"konnectivity-agent-7f9zb\" (UID: \"626143a7-d803-4b33-ae26-1cd1802b8cf0\") " pod="kube-system/konnectivity-agent-7f9zb"
Sep 11 16:29:43.016344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015160    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-hostroot\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.016344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015173    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f7f2239-9a00-42fb-97bf-9359a3366f95-socket-dir\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:43.016344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015206    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-etc-sysctl-conf\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.016344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015231    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-sys\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.017112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015247    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fac41999-310c-4cbe-aa82-073191607d1d-tmp-dir\") pod \"node-resolver-ptdtw\" (UID: \"fac41999-310c-4cbe-aa82-073191607d1d\") " pod="openshift-dns/node-resolver-ptdtw"
Sep 11 16:29:43.017112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015274    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-host-var-lib-cni-multus\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.017112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015329    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-host-var-lib-cni-multus\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.017112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015335    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-hostroot\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.017112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015387    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f7f2239-9a00-42fb-97bf-9359a3366f95-sys-fs\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:43.017112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015431    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/01d4b389-7479-4f04-bc20-adb48efdddcd-multus-daemon-config\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.017112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015453    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-multus-socket-dir-parent\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.017112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015459    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-etc-sysctl-conf\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.017112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015435    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-kubelet-config\") pod \"global-pull-secret-syncer-4qbz6\" (UID: \"35e7cb6b-bc4e-456f-94af-d0bf29f87e76\") " pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:43.017112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015482    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-kubelet-config\") pod \"global-pull-secret-syncer-4qbz6\" (UID: \"35e7cb6b-bc4e-456f-94af-d0bf29f87e76\") " pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:43.017112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015498    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-cnibin\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.017112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015510    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-sys\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.017112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015514    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f7f2239-9a00-42fb-97bf-9359a3366f95-sys-fs\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:43.017112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015525    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-etc-sysconfig\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.017112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015541    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-host-run-multus-certs\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.017112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015563    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2f7v\" (UniqueName: \"kubernetes.io/projected/fac41999-310c-4cbe-aa82-073191607d1d-kube-api-access-q2f7v\") pod \"node-resolver-ptdtw\" (UID: \"fac41999-310c-4cbe-aa82-073191607d1d\") " pod="openshift-dns/node-resolver-ptdtw"
Sep 11 16:29:43.017112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015571    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/626143a7-d803-4b33-ae26-1cd1802b8cf0-konnectivity-ca\") pod \"konnectivity-agent-7f9zb\" (UID: \"626143a7-d803-4b33-ae26-1cd1802b8cf0\") " pod="kube-system/konnectivity-agent-7f9zb"
Sep 11 16:29:43.017112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015566    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-etc-sysconfig\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.017914 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015596    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-cnibin\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.017914 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015599    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-run\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.017914 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015610    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-etc-systemd\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.017914 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015644    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-host-var-lib-cni-bin\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.017914 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015718    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/46ac947a-de40-4a38-b72e-f3baac35980d-etc-systemd\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.017914 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.015724    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/01d4b389-7479-4f04-bc20-adb48efdddcd-host-var-lib-cni-bin\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.018649 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.018620    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/626143a7-d803-4b33-ae26-1cd1802b8cf0-agent-certs\") pod \"konnectivity-agent-7f9zb\" (UID: \"626143a7-d803-4b33-ae26-1cd1802b8cf0\") " pod="kube-system/konnectivity-agent-7f9zb"
Sep 11 16:29:43.018871 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.018822    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/46ac947a-de40-4a38-b72e-f3baac35980d-etc-tuned\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.020824 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.020779    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46ac947a-de40-4a38-b72e-f3baac35980d-tmp\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.029025 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.028996    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fz8v\" (UniqueName: \"kubernetes.io/projected/46ac947a-de40-4a38-b72e-f3baac35980d-kube-api-access-4fz8v\") pod \"tuned-tjrdf\" (UID: \"46ac947a-de40-4a38-b72e-f3baac35980d\") " pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.030207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.030183    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2f7v\" (UniqueName: \"kubernetes.io/projected/fac41999-310c-4cbe-aa82-073191607d1d-kube-api-access-q2f7v\") pod \"node-resolver-ptdtw\" (UID: \"fac41999-310c-4cbe-aa82-073191607d1d\") " pod="openshift-dns/node-resolver-ptdtw"
Sep 11 16:29:43.031174 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.031148    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6cz7\" (UniqueName: \"kubernetes.io/projected/2f7f2239-9a00-42fb-97bf-9359a3366f95-kube-api-access-h6cz7\") pod \"aws-ebs-csi-driver-node-4r7zh\" (UID: \"2f7f2239-9a00-42fb-97bf-9359a3366f95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:43.032532 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.032489    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssk4c\" (UniqueName: \"kubernetes.io/projected/01d4b389-7479-4f04-bc20-adb48efdddcd-kube-api-access-ssk4c\") pod \"multus-scmbh\" (UID: \"01d4b389-7479-4f04-bc20-adb48efdddcd\") " pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.101673 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.101628    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mjzkx"
Sep 11 16:29:43.112844 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.112790    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-f9nlm"
Sep 11 16:29:43.113777 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:43.113741    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc30a043_24a9_456a_94a2_a47fd49e9475.slice/crio-f8008a5ec6037c09306ae99ae8d4ab323ab5839fa1a1fce78701495c61df7b31 WatchSource:0}: Error finding container f8008a5ec6037c09306ae99ae8d4ab323ab5839fa1a1fce78701495c61df7b31: Status 404 returned error can't find the container with id f8008a5ec6037c09306ae99ae8d4ab323ab5839fa1a1fce78701495c61df7b31
Sep 11 16:29:43.125536 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:43.125506    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5da99747_5918_4454_b404_349af508e59b.slice/crio-8ec5bf61735d2ade2b4cc1646c5190c6f75cd0c8f6003963065f88483e9182bd WatchSource:0}: Error finding container 8ec5bf61735d2ade2b4cc1646c5190c6f75cd0c8f6003963065f88483e9182bd: Status 404 returned error can't find the container with id 8ec5bf61735d2ade2b4cc1646c5190c6f75cd0c8f6003963065f88483e9182bd
Sep 11 16:29:43.129595 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.129567    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q6wwm"
Sep 11 16:29:43.137754 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.137726    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:29:43.141761 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:43.141719    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d72bc55_1cd2_492c_b327_98c0048d53ca.slice/crio-845605b5f02026bc7a21b0b7ba19e038b186eff6335cb005da2740a184715a78 WatchSource:0}: Error finding container 845605b5f02026bc7a21b0b7ba19e038b186eff6335cb005da2740a184715a78: Status 404 returned error can't find the container with id 845605b5f02026bc7a21b0b7ba19e038b186eff6335cb005da2740a184715a78
Sep 11 16:29:43.147566 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.147537    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ptdtw"
Sep 11 16:29:43.148069 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:43.148031    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82cd4407_5809_4cad_b2c5_6da954810415.slice/crio-68d3967732ceaeda2f73a4cf782d27ef9b96faef226b1a809c6504a72b8e9c82 WatchSource:0}: Error finding container 68d3967732ceaeda2f73a4cf782d27ef9b96faef226b1a809c6504a72b8e9c82: Status 404 returned error can't find the container with id 68d3967732ceaeda2f73a4cf782d27ef9b96faef226b1a809c6504a72b8e9c82
Sep 11 16:29:43.157288 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.157252    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh"
Sep 11 16:29:43.159242 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:43.159213    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac41999_310c_4cbe_aa82_073191607d1d.slice/crio-18af2f1a5728af11bbf5382006296a837e8ff27d55c5cff573ca27975f6e46d1 WatchSource:0}: Error finding container 18af2f1a5728af11bbf5382006296a837e8ff27d55c5cff573ca27975f6e46d1: Status 404 returned error can't find the container with id 18af2f1a5728af11bbf5382006296a837e8ff27d55c5cff573ca27975f6e46d1
Sep 11 16:29:43.165727 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.165705    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tjrdf"
Sep 11 16:29:43.169341 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:43.169309    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f7f2239_9a00_42fb_97bf_9359a3366f95.slice/crio-9e8c6dcbdf6fff23e6ccdb1586c9c8e4e163354ecfee167ff884aebb265fc5fc WatchSource:0}: Error finding container 9e8c6dcbdf6fff23e6ccdb1586c9c8e4e163354ecfee167ff884aebb265fc5fc: Status 404 returned error can't find the container with id 9e8c6dcbdf6fff23e6ccdb1586c9c8e4e163354ecfee167ff884aebb265fc5fc
Sep 11 16:29:43.174443 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.174417    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7f9zb"
Sep 11 16:29:43.175270 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:43.175242    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ac947a_de40_4a38_b72e_f3baac35980d.slice/crio-5e4ee3de5e6ddb4ca38cd76348778105243a9a86caaf3a97263718d9c4633fbd WatchSource:0}: Error finding container 5e4ee3de5e6ddb4ca38cd76348778105243a9a86caaf3a97263718d9c4633fbd: Status 404 returned error can't find the container with id 5e4ee3de5e6ddb4ca38cd76348778105243a9a86caaf3a97263718d9c4633fbd
Sep 11 16:29:43.181675 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.181650    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-scmbh"
Sep 11 16:29:43.185297 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:43.185257    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod626143a7_d803_4b33_ae26_1cd1802b8cf0.slice/crio-ef82cac466e59fb55672ff21191de4de66c51a401855c29fbed0294271c0202c WatchSource:0}: Error finding container ef82cac466e59fb55672ff21191de4de66c51a401855c29fbed0294271c0202c: Status 404 returned error can't find the container with id ef82cac466e59fb55672ff21191de4de66c51a401855c29fbed0294271c0202c
Sep 11 16:29:43.194321 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:29:43.194297    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d4b389_7479_4f04_bc20_adb48efdddcd.slice/crio-1fea72f7e42bf3878907bd8c38059664c2f07a5dfeb6edad3432b4a5a6ff5278 WatchSource:0}: Error finding container 1fea72f7e42bf3878907bd8c38059664c2f07a5dfeb6edad3432b4a5a6ff5278: Status 404 returned error can't find the container with id 1fea72f7e42bf3878907bd8c38059664c2f07a5dfeb6edad3432b4a5a6ff5278
Sep 11 16:29:43.418958 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.418859    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs\") pod \"network-metrics-daemon-tv8zk\" (UID: \"9868a0a5-34ec-40ba-8178-c0a1bd64a921\") " pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:29:43.419144 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:43.419023    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:29:43.419144 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:43.419099    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs podName:9868a0a5-34ec-40ba-8178-c0a1bd64a921 nodeName:}" failed. No retries permitted until 2026-09-11 16:29:44.419079577 +0000 UTC m=+4.037353741 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs") pod "network-metrics-daemon-tv8zk" (UID: "9868a0a5-34ec-40ba-8178-c0a1bd64a921") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:29:43.519230 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.519192    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret\") pod \"global-pull-secret-syncer-4qbz6\" (UID: \"35e7cb6b-bc4e-456f-94af-d0bf29f87e76\") " pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:43.519448 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.519263    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bgcc\" (UniqueName: \"kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc\") pod \"network-check-target-2wxbp\" (UID: \"29971043-47bb-4a97-8e4c-696ff995faf7\") " pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:29:43.519448 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:43.519377    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:29:43.519448 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:43.519409    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:29:43.519448 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:43.519429    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:29:43.519448 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:43.519444    2557 projected.go:196] Error preparing data for projected volume kube-api-access-9bgcc for pod openshift-network-diagnostics/network-check-target-2wxbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:29:43.519718 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:43.519470    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret podName:35e7cb6b-bc4e-456f-94af-d0bf29f87e76 nodeName:}" failed. No retries permitted until 2026-09-11 16:29:44.519443693 +0000 UTC m=+4.137717864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret") pod "global-pull-secret-syncer-4qbz6" (UID: "35e7cb6b-bc4e-456f-94af-d0bf29f87e76") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:29:43.519718 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:43.519500    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc podName:29971043-47bb-4a97-8e4c-696ff995faf7 nodeName:}" failed. No retries permitted until 2026-09-11 16:29:44.51948324 +0000 UTC m=+4.137757391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bgcc" (UniqueName: "kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc") pod "network-check-target-2wxbp" (UID: "29971043-47bb-4a97-8e4c-696ff995faf7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:29:43.852111 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.852011    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 16:24:43 +0000 UTC" deadline="2028-06-12 06:16:27.420395796 +0000 UTC"
Sep 11 16:29:43.852111 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.852058    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15349h46m43.568343214s"
Sep 11 16:29:43.940309 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.940275    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:43.940477 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:43.940395    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qbz6" podUID="35e7cb6b-bc4e-456f-94af-d0bf29f87e76"
Sep 11 16:29:43.953578 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.953537    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ptdtw" event={"ID":"fac41999-310c-4cbe-aa82-073191607d1d","Type":"ContainerStarted","Data":"18af2f1a5728af11bbf5382006296a837e8ff27d55c5cff573ca27975f6e46d1"}
Sep 11 16:29:43.954815 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.954777    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h666m" event={"ID":"82cd4407-5809-4cad-b2c5-6da954810415","Type":"ContainerStarted","Data":"68d3967732ceaeda2f73a4cf782d27ef9b96faef226b1a809c6504a72b8e9c82"}
Sep 11 16:29:43.956097 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.956065    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjzkx" event={"ID":"bc30a043-24a9-456a-94a2-a47fd49e9475","Type":"ContainerStarted","Data":"f8008a5ec6037c09306ae99ae8d4ab323ab5839fa1a1fce78701495c61df7b31"}
Sep 11 16:29:43.957674 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.957639    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q6wwm" event={"ID":"6d72bc55-1cd2-492c-b327-98c0048d53ca","Type":"ContainerStarted","Data":"845605b5f02026bc7a21b0b7ba19e038b186eff6335cb005da2740a184715a78"}
Sep 11 16:29:43.959121 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.959086    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f9nlm" event={"ID":"5da99747-5918-4454-b404-349af508e59b","Type":"ContainerStarted","Data":"8ec5bf61735d2ade2b4cc1646c5190c6f75cd0c8f6003963065f88483e9182bd"}
Sep 11 16:29:43.960487 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.960456    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-scmbh" event={"ID":"01d4b389-7479-4f04-bc20-adb48efdddcd","Type":"ContainerStarted","Data":"1fea72f7e42bf3878907bd8c38059664c2f07a5dfeb6edad3432b4a5a6ff5278"}
Sep 11 16:29:43.961898 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.961871    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7f9zb" event={"ID":"626143a7-d803-4b33-ae26-1cd1802b8cf0","Type":"ContainerStarted","Data":"ef82cac466e59fb55672ff21191de4de66c51a401855c29fbed0294271c0202c"}
Sep 11 16:29:43.963301 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.963272    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tjrdf" event={"ID":"46ac947a-de40-4a38-b72e-f3baac35980d","Type":"ContainerStarted","Data":"5e4ee3de5e6ddb4ca38cd76348778105243a9a86caaf3a97263718d9c4633fbd"}
Sep 11 16:29:43.964668 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:43.964644    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh" event={"ID":"2f7f2239-9a00-42fb-97bf-9359a3366f95","Type":"ContainerStarted","Data":"9e8c6dcbdf6fff23e6ccdb1586c9c8e4e163354ecfee167ff884aebb265fc5fc"}
Sep 11 16:29:44.428201 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:44.428155    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs\") pod \"network-metrics-daemon-tv8zk\" (UID: \"9868a0a5-34ec-40ba-8178-c0a1bd64a921\") " pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:29:44.428420 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:44.428296    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:29:44.428420 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:44.428381    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs podName:9868a0a5-34ec-40ba-8178-c0a1bd64a921 nodeName:}" failed. No retries permitted until 2026-09-11 16:29:46.428360738 +0000 UTC m=+6.046634889 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs") pod "network-metrics-daemon-tv8zk" (UID: "9868a0a5-34ec-40ba-8178-c0a1bd64a921") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:29:44.529119 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:44.529074    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret\") pod \"global-pull-secret-syncer-4qbz6\" (UID: \"35e7cb6b-bc4e-456f-94af-d0bf29f87e76\") " pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:44.529317 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:44.529155    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bgcc\" (UniqueName: \"kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc\") pod \"network-check-target-2wxbp\" (UID: \"29971043-47bb-4a97-8e4c-696ff995faf7\") " pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:29:44.529317 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:44.529333    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:29:44.529558 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:44.529420    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret podName:35e7cb6b-bc4e-456f-94af-d0bf29f87e76 nodeName:}" failed. No retries permitted until 2026-09-11 16:29:46.52939638 +0000 UTC m=+6.147670531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret") pod "global-pull-secret-syncer-4qbz6" (UID: "35e7cb6b-bc4e-456f-94af-d0bf29f87e76") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:29:44.530083 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:44.529932    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:29:44.530083 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:44.529964    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:29:44.530083 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:44.529979    2557 projected.go:196] Error preparing data for projected volume kube-api-access-9bgcc for pod openshift-network-diagnostics/network-check-target-2wxbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:29:44.530083 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:44.530049    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc podName:29971043-47bb-4a97-8e4c-696ff995faf7 nodeName:}" failed. No retries permitted until 2026-09-11 16:29:46.530032471 +0000 UTC m=+6.148306635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bgcc" (UniqueName: "kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc") pod "network-check-target-2wxbp" (UID: "29971043-47bb-4a97-8e4c-696ff995faf7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:29:44.853524 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:44.853444    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 16:24:43 +0000 UTC" deadline="2028-03-08 17:04:32.015238719 +0000 UTC"
Sep 11 16:29:44.853524 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:44.853521    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13056h34m47.161722318s"
Sep 11 16:29:44.947784 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:44.947523    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:29:44.948624 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:44.947675    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv8zk" podUID="9868a0a5-34ec-40ba-8178-c0a1bd64a921"
Sep 11 16:29:44.948624 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:44.948426    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:29:44.948624 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:44.948525    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wxbp" podUID="29971043-47bb-4a97-8e4c-696ff995faf7"
Sep 11 16:29:44.980349 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:44.979483    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-196.ec2.internal" event={"ID":"390ec4ba6e0c3aa7c2a9e1ee487282c4","Type":"ContainerStarted","Data":"a72ff1d9d4062a9fe2ce1783172fe3c32eecdb8e1c14412b44182f9aa92cf895"}
Sep 11 16:29:45.941352 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:45.940397    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:45.941352 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:45.940842    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qbz6" podUID="35e7cb6b-bc4e-456f-94af-d0bf29f87e76"
Sep 11 16:29:46.001838 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:46.001652    2557 generic.go:356] "Generic (PLEG): container finished" podID="860d5eb6cfec03b3afce795bf172f3a0" containerID="cf426f2a65e7f7db9844931b7dd0a8a9e753dc6fccf1ebdf98cde7c6dd5e4945" exitCode=0
Sep 11 16:29:46.002910 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:46.001751    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal" event={"ID":"860d5eb6cfec03b3afce795bf172f3a0","Type":"ContainerDied","Data":"cf426f2a65e7f7db9844931b7dd0a8a9e753dc6fccf1ebdf98cde7c6dd5e4945"}
Sep 11 16:29:46.025863 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:46.024108    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-196.ec2.internal" podStartSLOduration=3.024081544 podStartE2EDuration="3.024081544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:29:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:29:44.999307664 +0000 UTC m=+4.617581835" watchObservedRunningTime="2026-09-11 16:29:46.024081544 +0000 UTC m=+5.642355723"
Sep 11 16:29:46.449050 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:46.448998    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs\") pod \"network-metrics-daemon-tv8zk\" (UID: \"9868a0a5-34ec-40ba-8178-c0a1bd64a921\") " pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:29:46.449248 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:46.449199    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:29:46.449333 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:46.449271    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs podName:9868a0a5-34ec-40ba-8178-c0a1bd64a921 nodeName:}" failed. No retries permitted until 2026-09-11 16:29:50.4492518 +0000 UTC m=+10.067525964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs") pod "network-metrics-daemon-tv8zk" (UID: "9868a0a5-34ec-40ba-8178-c0a1bd64a921") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:29:46.550403 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:46.550299    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bgcc\" (UniqueName: \"kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc\") pod \"network-check-target-2wxbp\" (UID: \"29971043-47bb-4a97-8e4c-696ff995faf7\") " pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:29:46.550403 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:46.550398    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret\") pod \"global-pull-secret-syncer-4qbz6\" (UID: \"35e7cb6b-bc4e-456f-94af-d0bf29f87e76\") " pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:46.550680 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:46.550567    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:29:46.551204 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:46.550644    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret podName:35e7cb6b-bc4e-456f-94af-d0bf29f87e76 nodeName:}" failed. No retries permitted until 2026-09-11 16:29:50.550621291 +0000 UTC m=+10.168895458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret") pod "global-pull-secret-syncer-4qbz6" (UID: "35e7cb6b-bc4e-456f-94af-d0bf29f87e76") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:29:46.551332 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:46.550796    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:29:46.551332 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:46.551236    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:29:46.551332 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:46.551253    2557 projected.go:196] Error preparing data for projected volume kube-api-access-9bgcc for pod openshift-network-diagnostics/network-check-target-2wxbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:29:46.551332 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:46.551314    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc podName:29971043-47bb-4a97-8e4c-696ff995faf7 nodeName:}" failed. No retries permitted until 2026-09-11 16:29:50.551289493 +0000 UTC m=+10.169563657 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bgcc" (UniqueName: "kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc") pod "network-check-target-2wxbp" (UID: "29971043-47bb-4a97-8e4c-696ff995faf7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:29:46.949324 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:46.949238    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:29:46.949858 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:46.949390    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv8zk" podUID="9868a0a5-34ec-40ba-8178-c0a1bd64a921"
Sep 11 16:29:46.949858 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:46.949820    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:29:46.949975 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:46.949927    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wxbp" podUID="29971043-47bb-4a97-8e4c-696ff995faf7"
Sep 11 16:29:47.022200 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:47.021362    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal" event={"ID":"860d5eb6cfec03b3afce795bf172f3a0","Type":"ContainerStarted","Data":"127169d51f4ccf2f9e5f174a49a33faf4bdb15e69eae92d92e21a1f43e26bcb9"}
Sep 11 16:29:47.940176 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:47.940135    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:47.940397 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:47.940301    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qbz6" podUID="35e7cb6b-bc4e-456f-94af-d0bf29f87e76"
Sep 11 16:29:48.947473 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:48.947425    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:29:48.948013 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:48.947551    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wxbp" podUID="29971043-47bb-4a97-8e4c-696ff995faf7"
Sep 11 16:29:48.948013 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:48.948002    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:29:48.948230 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:48.948114    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv8zk" podUID="9868a0a5-34ec-40ba-8178-c0a1bd64a921"
Sep 11 16:29:49.940456 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:49.940415    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:49.940691 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:49.940578    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qbz6" podUID="35e7cb6b-bc4e-456f-94af-d0bf29f87e76"
Sep 11 16:29:50.488530 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:50.488479    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs\") pod \"network-metrics-daemon-tv8zk\" (UID: \"9868a0a5-34ec-40ba-8178-c0a1bd64a921\") " pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:29:50.489057 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:50.488685    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:29:50.489057 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:50.488760    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs podName:9868a0a5-34ec-40ba-8178-c0a1bd64a921 nodeName:}" failed. No retries permitted until 2026-09-11 16:29:58.488741477 +0000 UTC m=+18.107015650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs") pod "network-metrics-daemon-tv8zk" (UID: "9868a0a5-34ec-40ba-8178-c0a1bd64a921") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:29:50.589462 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:50.589410    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bgcc\" (UniqueName: \"kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc\") pod \"network-check-target-2wxbp\" (UID: \"29971043-47bb-4a97-8e4c-696ff995faf7\") " pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:29:50.589657 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:50.589518    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret\") pod \"global-pull-secret-syncer-4qbz6\" (UID: \"35e7cb6b-bc4e-456f-94af-d0bf29f87e76\") " pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:50.589748 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:50.589683    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:29:50.589748 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:50.589735    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:29:50.589841 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:50.589762    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret podName:35e7cb6b-bc4e-456f-94af-d0bf29f87e76 nodeName:}" failed. No retries permitted until 2026-09-11 16:29:58.589739323 +0000 UTC m=+18.208013476 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret") pod "global-pull-secret-syncer-4qbz6" (UID: "35e7cb6b-bc4e-456f-94af-d0bf29f87e76") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:29:50.589841 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:50.589764    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:29:50.589841 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:50.589783    2557 projected.go:196] Error preparing data for projected volume kube-api-access-9bgcc for pod openshift-network-diagnostics/network-check-target-2wxbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:29:50.589841 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:50.589841    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc podName:29971043-47bb-4a97-8e4c-696ff995faf7 nodeName:}" failed. No retries permitted until 2026-09-11 16:29:58.589823426 +0000 UTC m=+18.208097593 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bgcc" (UniqueName: "kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc") pod "network-check-target-2wxbp" (UID: "29971043-47bb-4a97-8e4c-696ff995faf7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:29:50.941983 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:50.941888    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:29:50.941983 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:50.941938    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:29:50.942255 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:50.942017    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wxbp" podUID="29971043-47bb-4a97-8e4c-696ff995faf7"
Sep 11 16:29:50.942526 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:50.942474    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv8zk" podUID="9868a0a5-34ec-40ba-8178-c0a1bd64a921"
Sep 11 16:29:51.940771 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:51.940727    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:51.941283 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:51.940891    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qbz6" podUID="35e7cb6b-bc4e-456f-94af-d0bf29f87e76"
Sep 11 16:29:52.940274 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:52.940237    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:29:52.940482 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:52.940399    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv8zk" podUID="9868a0a5-34ec-40ba-8178-c0a1bd64a921"
Sep 11 16:29:52.940482 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:52.940237    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:29:52.941087 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:52.940615    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wxbp" podUID="29971043-47bb-4a97-8e4c-696ff995faf7"
Sep 11 16:29:53.940759 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:53.940720    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:53.940965 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:53.940865    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qbz6" podUID="35e7cb6b-bc4e-456f-94af-d0bf29f87e76"
Sep 11 16:29:54.940067 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:54.940035    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:29:54.940451 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:54.940143    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wxbp" podUID="29971043-47bb-4a97-8e4c-696ff995faf7"
Sep 11 16:29:54.940451 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:54.940205    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:29:54.940451 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:54.940302    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv8zk" podUID="9868a0a5-34ec-40ba-8178-c0a1bd64a921"
Sep 11 16:29:55.940393 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:55.940360    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:55.940877 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:55.940481    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qbz6" podUID="35e7cb6b-bc4e-456f-94af-d0bf29f87e76"
Sep 11 16:29:56.939898 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:56.939856    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:29:56.939898 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:56.939895    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:29:56.940119 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:56.940001    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv8zk" podUID="9868a0a5-34ec-40ba-8178-c0a1bd64a921"
Sep 11 16:29:56.940193 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:56.940147    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wxbp" podUID="29971043-47bb-4a97-8e4c-696ff995faf7"
Sep 11 16:29:57.940469 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:57.940432    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:57.940931 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:57.940554    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qbz6" podUID="35e7cb6b-bc4e-456f-94af-d0bf29f87e76"
Sep 11 16:29:58.552767 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:58.552722    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs\") pod \"network-metrics-daemon-tv8zk\" (UID: \"9868a0a5-34ec-40ba-8178-c0a1bd64a921\") " pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:29:58.552951 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:58.552895    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:29:58.553009 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:58.552978    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs podName:9868a0a5-34ec-40ba-8178-c0a1bd64a921 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:14.552956986 +0000 UTC m=+34.171231134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs") pod "network-metrics-daemon-tv8zk" (UID: "9868a0a5-34ec-40ba-8178-c0a1bd64a921") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:29:58.654025 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:58.653990    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bgcc\" (UniqueName: \"kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc\") pod \"network-check-target-2wxbp\" (UID: \"29971043-47bb-4a97-8e4c-696ff995faf7\") " pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:29:58.654186 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:58.654050    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret\") pod \"global-pull-secret-syncer-4qbz6\" (UID: \"35e7cb6b-bc4e-456f-94af-d0bf29f87e76\") " pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:58.654186 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:58.654146    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:29:58.654186 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:58.654171    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:29:58.654350 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:58.654192    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:29:58.654350 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:58.654198    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret podName:35e7cb6b-bc4e-456f-94af-d0bf29f87e76 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:14.654184344 +0000 UTC m=+34.272458506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret") pod "global-pull-secret-syncer-4qbz6" (UID: "35e7cb6b-bc4e-456f-94af-d0bf29f87e76") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:29:58.654350 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:58.654203    2557 projected.go:196] Error preparing data for projected volume kube-api-access-9bgcc for pod openshift-network-diagnostics/network-check-target-2wxbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:29:58.654350 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:58.654246    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc podName:29971043-47bb-4a97-8e4c-696ff995faf7 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:14.654234297 +0000 UTC m=+34.272508462 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bgcc" (UniqueName: "kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc") pod "network-check-target-2wxbp" (UID: "29971043-47bb-4a97-8e4c-696ff995faf7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:29:58.940162 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:58.940070    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:29:58.940330 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:58.940086    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:29:58.940330 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:58.940224    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv8zk" podUID="9868a0a5-34ec-40ba-8178-c0a1bd64a921"
Sep 11 16:29:58.940330 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:58.940249    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wxbp" podUID="29971043-47bb-4a97-8e4c-696ff995faf7"
Sep 11 16:29:59.940327 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:29:59.940287    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:29:59.940751 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:29:59.940429    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qbz6" podUID="35e7cb6b-bc4e-456f-94af-d0bf29f87e76"
Sep 11 16:30:00.940499 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:00.940463    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:30:00.941055 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:00.940574    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wxbp" podUID="29971043-47bb-4a97-8e4c-696ff995faf7"
Sep 11 16:30:00.941055 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:00.940654    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:30:00.941055 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:00.940758    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv8zk" podUID="9868a0a5-34ec-40ba-8178-c0a1bd64a921"
Sep 11 16:30:01.940385 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:01.940346    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:30:01.940577 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:01.940489    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qbz6" podUID="35e7cb6b-bc4e-456f-94af-d0bf29f87e76"
Sep 11 16:30:02.940161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:02.939948    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:30:02.940360 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:02.940098    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:30:02.940360 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:02.940265    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wxbp" podUID="29971043-47bb-4a97-8e4c-696ff995faf7"
Sep 11 16:30:02.940485 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:02.940388    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv8zk" podUID="9868a0a5-34ec-40ba-8178-c0a1bd64a921"
Sep 11 16:30:03.056671 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.056635    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-f9nlm" event={"ID":"5da99747-5918-4454-b404-349af508e59b","Type":"ContainerStarted","Data":"4513f2ad713a7b8239a6a2aa9e9f988eb5cbed128387edc0a7055db8e7b48356"}
Sep 11 16:30:03.058292 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.058268    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-scmbh" event={"ID":"01d4b389-7479-4f04-bc20-adb48efdddcd","Type":"ContainerStarted","Data":"a57ac78580a80f37e7edd64ef32b7b09731f79b81d5efab5c7dd7dcc9f5613c6"}
Sep 11 16:30:03.059775 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.059748    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7f9zb" event={"ID":"626143a7-d803-4b33-ae26-1cd1802b8cf0","Type":"ContainerStarted","Data":"e6cd7eda3fbadcd18baa6716bfcfdb6b8eb99b428706d5c0579ffb4210c3a4c3"}
Sep 11 16:30:03.061248 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.061221    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tjrdf" event={"ID":"46ac947a-de40-4a38-b72e-f3baac35980d","Type":"ContainerStarted","Data":"354db58295f2691e76df93a08cf7fc53d1c7f870aa2a915ad66edef7307d9636"}
Sep 11 16:30:03.062760 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.062739    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh" event={"ID":"2f7f2239-9a00-42fb-97bf-9359a3366f95","Type":"ContainerStarted","Data":"7a682f7667597107e37999b3d38b6c2e86b952a0de0cc11098080bd37a4dded9"}
Sep 11 16:30:03.064033 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.064011    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ptdtw" event={"ID":"fac41999-310c-4cbe-aa82-073191607d1d","Type":"ContainerStarted","Data":"6fe484bb90df0eab49274d1e66febb11c58da3b6451346bf7963955ed10dd37a"}
Sep 11 16:30:03.066712 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.066694    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h666m" event={"ID":"82cd4407-5809-4cad-b2c5-6da954810415","Type":"ContainerStarted","Data":"abd633478a480341c4bbd6fc83e8fddb3dcbda096451f6d07a678db7669102d2"}
Sep 11 16:30:03.066803 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.066747    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h666m" event={"ID":"82cd4407-5809-4cad-b2c5-6da954810415","Type":"ContainerStarted","Data":"4ff411626b9ddc492c78758830c4a84ba81b734d104ee6839ba8dfdb4dc53e36"}
Sep 11 16:30:03.066803 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.066785    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h666m" event={"ID":"82cd4407-5809-4cad-b2c5-6da954810415","Type":"ContainerStarted","Data":"c6033529fde0d0b97d89a6039b329a5d8c3f3df904a2003235675f72e3e1c7f7"}
Sep 11 16:30:03.066885 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.066827    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h666m" event={"ID":"82cd4407-5809-4cad-b2c5-6da954810415","Type":"ContainerStarted","Data":"4eba71ce3f030e708492ee5845d639900bb0e6525c6bca53292494a0f0392e25"}
Sep 11 16:30:03.066885 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.066860    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h666m" event={"ID":"82cd4407-5809-4cad-b2c5-6da954810415","Type":"ContainerStarted","Data":"b3999f0b59e2dbb2b0e04047e0eda8a8df310291b7188099ca4e103acd3f1de7"}
Sep 11 16:30:03.068197 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.068174    2557 generic.go:356] "Generic (PLEG): container finished" podID="bc30a043-24a9-456a-94a2-a47fd49e9475" containerID="4dd90149c94135245337bef3547d797140b73de87dad45d9528d563cac7889c9" exitCode=0
Sep 11 16:30:03.068281 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.068210    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjzkx" event={"ID":"bc30a043-24a9-456a-94a2-a47fd49e9475","Type":"ContainerDied","Data":"4dd90149c94135245337bef3547d797140b73de87dad45d9528d563cac7889c9"}
Sep 11 16:30:03.081137 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.081095    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-196.ec2.internal" podStartSLOduration=20.081083139 podStartE2EDuration="20.081083139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:29:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:29:47.041308977 +0000 UTC m=+6.659583154" watchObservedRunningTime="2026-09-11 16:30:03.081083139 +0000 UTC m=+22.699357309"
Sep 11 16:30:03.081370 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.081351    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-f9nlm" podStartSLOduration=1.659929026 podStartE2EDuration="21.081346412s" totalImagesPullingTime="19.421417386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:03.081234055 +0000 UTC m=+22.699508225" watchObservedRunningTime="2026-09-11 16:30:03.081346412 +0000 UTC m=+22.699620588"
Sep 11 16:30:03.103638 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.103575    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ptdtw" podStartSLOduration=1.718298811 podStartE2EDuration="21.103560924s" totalImagesPullingTime="19.385262113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:03.103364885 +0000 UTC m=+22.721639057" watchObservedRunningTime="2026-09-11 16:30:03.103560924 +0000 UTC m=+22.721835090"
Sep 11 16:30:03.160754 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.160708    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7f9zb" podStartSLOduration=5.731149997 podStartE2EDuration="21.1606858s" totalImagesPullingTime="15.429535803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:03.160381599 +0000 UTC m=+22.778655770" watchObservedRunningTime="2026-09-11 16:30:03.1606858 +0000 UTC m=+22.778959970"
Sep 11 16:30:03.236031 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.235981    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tjrdf" podStartSLOduration=1.846568441 podStartE2EDuration="21.235963407s" totalImagesPullingTime="19.389394966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:03.235894307 +0000 UTC m=+22.854168477" watchObservedRunningTime="2026-09-11 16:30:03.235963407 +0000 UTC m=+22.854237577"
Sep 11 16:30:03.268255 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.268159    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-scmbh" podStartSLOduration=1.85986401 podStartE2EDuration="21.268141261s" totalImagesPullingTime="19.408277251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:03.267631246 +0000 UTC m=+22.885905416" watchObservedRunningTime="2026-09-11 16:30:03.268141261 +0000 UTC m=+22.886415431"
Sep 11 16:30:03.939896 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.939864    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:30:03.940086 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:03.939974    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qbz6" podUID="35e7cb6b-bc4e-456f-94af-d0bf29f87e76"
Sep 11 16:30:03.959684 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.959654    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7f9zb"
Sep 11 16:30:03.960308 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:03.960284    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7f9zb"
Sep 11 16:30:04.075342 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:04.075299    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h666m" event={"ID":"82cd4407-5809-4cad-b2c5-6da954810415","Type":"ContainerStarted","Data":"3b0a5d7ec431768bc41a4ffd05ff4b9b72f9f4b77e43a03de8fd27202758763f"}
Sep 11 16:30:04.078009 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:04.077974    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q6wwm" event={"ID":"6d72bc55-1cd2-492c-b327-98c0048d53ca","Type":"ContainerStarted","Data":"9d1f6f24a2c3cca57f2c5bc3fdac9065a7ae24558d657c1e957aa1836b9c24e7"}
Sep 11 16:30:04.100963 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:04.100907    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q6wwm" podStartSLOduration=2.696448755 podStartE2EDuration="22.100890104s" totalImagesPullingTime="19.404441349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:04.100422425 +0000 UTC m=+23.718696592" watchObservedRunningTime="2026-09-11 16:30:04.100890104 +0000 UTC m=+23.719164273"
Sep 11 16:30:04.547903 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:04.547876    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 16:30:04.877174 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:04.877021    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T16:30:04.54789556Z","UUID":"4fa99d1d-d2c3-4289-a94c-67c99f086ec7","Handler":null,"Name":"","Endpoint":""}
Sep 11 16:30:04.878664 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:04.878640    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 16:30:04.878805 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:04.878678    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 16:30:04.940961 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:04.940922    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:30:04.941156 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:04.941061    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wxbp" podUID="29971043-47bb-4a97-8e4c-696ff995faf7"
Sep 11 16:30:04.941156 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:04.941121    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:30:04.941273 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:04.941216    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv8zk" podUID="9868a0a5-34ec-40ba-8178-c0a1bd64a921"
Sep 11 16:30:05.082337 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:05.082301    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh" event={"ID":"2f7f2239-9a00-42fb-97bf-9359a3366f95","Type":"ContainerStarted","Data":"32d52299b218a1afeaa430d1d7d774f3fd065a66ec1aca3324bdc3f723a0bb06"}
Sep 11 16:30:05.082757 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:05.082499    2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 16:30:05.940289 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:05.940257    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:30:05.940468 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:05.940432    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qbz6" podUID="35e7cb6b-bc4e-456f-94af-d0bf29f87e76"
Sep 11 16:30:06.086792 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:06.086703    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh" event={"ID":"2f7f2239-9a00-42fb-97bf-9359a3366f95","Type":"ContainerStarted","Data":"737ce7964f1e89180c6e70c85480255940b917ce52d17e1b650687f98f84bc22"}
Sep 11 16:30:06.090004 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:06.089980    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h666m" event={"ID":"82cd4407-5809-4cad-b2c5-6da954810415","Type":"ContainerStarted","Data":"128b523ded3834f82a5207387f10a8cf6ef9216d17d6a16a0889ac5585c8ba42"}
Sep 11 16:30:06.940430 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:06.940395    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:30:06.940637 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:06.940402    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:30:06.940637 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:06.940540    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wxbp" podUID="29971043-47bb-4a97-8e4c-696ff995faf7"
Sep 11 16:30:06.940758 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:06.940650    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv8zk" podUID="9868a0a5-34ec-40ba-8178-c0a1bd64a921"
Sep 11 16:30:07.940524 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:07.940222    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:30:07.941015 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:07.940590    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qbz6" podUID="35e7cb6b-bc4e-456f-94af-d0bf29f87e76"
Sep 11 16:30:08.940248 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:08.940150    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:30:08.940404 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:08.940271    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wxbp" podUID="29971043-47bb-4a97-8e4c-696ff995faf7"
Sep 11 16:30:08.940404 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:08.940291    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:30:08.940491 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:08.940402    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv8zk" podUID="9868a0a5-34ec-40ba-8178-c0a1bd64a921"
Sep 11 16:30:09.101479 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:09.101448    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h666m" event={"ID":"82cd4407-5809-4cad-b2c5-6da954810415","Type":"ContainerStarted","Data":"de0a90e928253c526a7ab98c6d271040404c2583c14c3eb76199561935291b36"}
Sep 11 16:30:09.102349 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:09.101717    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:30:09.103515 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:09.103483    2557 generic.go:356] "Generic (PLEG): container finished" podID="bc30a043-24a9-456a-94a2-a47fd49e9475" containerID="d828b9fc51e4b532679d07350007e8ccf0acecbd8dfdc86d38cc6215a5d27665" exitCode=0
Sep 11 16:30:09.103619 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:09.103515    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjzkx" event={"ID":"bc30a043-24a9-456a-94a2-a47fd49e9475","Type":"ContainerDied","Data":"d828b9fc51e4b532679d07350007e8ccf0acecbd8dfdc86d38cc6215a5d27665"}
Sep 11 16:30:09.117536 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:09.117509    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:30:09.141124 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:09.141077    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h666m" podStartSLOduration=7.691083553 podStartE2EDuration="27.141063866s" totalImagesPullingTime="19.449980313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:09.14059768 +0000 UTC m=+28.758871850" watchObservedRunningTime="2026-09-11 16:30:09.141063866 +0000 UTC m=+28.759338035"
Sep 11 16:30:09.141286 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:09.141268    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4r7zh" podStartSLOduration=4.97298151 podStartE2EDuration="27.141263385s" totalImagesPullingTime="22.168281875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:29:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:06.110150203 +0000 UTC m=+25.728424374" watchObservedRunningTime="2026-09-11 16:30:09.141263385 +0000 UTC m=+28.759537554"
Sep 11 16:30:09.939665 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:09.939627    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:30:09.939839 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:09.939738    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qbz6" podUID="35e7cb6b-bc4e-456f-94af-d0bf29f87e76"
Sep 11 16:30:10.105794 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:10.105768    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:30:10.106175 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:10.105836    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:30:10.121539 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:10.121510    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:30:10.547588 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:10.547555    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4qbz6"]
Sep 11 16:30:10.547757 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:10.547743    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:30:10.547878 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:10.547846    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qbz6" podUID="35e7cb6b-bc4e-456f-94af-d0bf29f87e76"
Sep 11 16:30:10.548378 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:10.548355    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2wxbp"]
Sep 11 16:30:10.548471 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:10.548440    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:30:10.548544 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:10.548524    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wxbp" podUID="29971043-47bb-4a97-8e4c-696ff995faf7"
Sep 11 16:30:10.551834 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:10.551809    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tv8zk"]
Sep 11 16:30:10.551926 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:10.551910    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:30:10.552000 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:10.551982    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv8zk" podUID="9868a0a5-34ec-40ba-8178-c0a1bd64a921"
Sep 11 16:30:11.109498 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:11.109462    2557 generic.go:356] "Generic (PLEG): container finished" podID="bc30a043-24a9-456a-94a2-a47fd49e9475" containerID="8fdb9cd1e184294e215ee28d00a3b447a45fa47b25b2cf0b377016a28d23ad2a" exitCode=0
Sep 11 16:30:11.109919 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:11.109555    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjzkx" event={"ID":"bc30a043-24a9-456a-94a2-a47fd49e9475","Type":"ContainerDied","Data":"8fdb9cd1e184294e215ee28d00a3b447a45fa47b25b2cf0b377016a28d23ad2a"}
Sep 11 16:30:11.231188 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:11.231143    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7f9zb"
Sep 11 16:30:11.231347 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:11.231293    2557 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 11 16:30:11.231783 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:11.231764    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7f9zb"
Sep 11 16:30:11.940385 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:11.940286    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:30:11.940385 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:11.940337    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:30:11.940574 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:11.940488    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv8zk" podUID="9868a0a5-34ec-40ba-8178-c0a1bd64a921"
Sep 11 16:30:11.940661 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:11.940629    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wxbp" podUID="29971043-47bb-4a97-8e4c-696ff995faf7"
Sep 11 16:30:12.114617 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:12.114576    2557 generic.go:356] "Generic (PLEG): container finished" podID="bc30a043-24a9-456a-94a2-a47fd49e9475" containerID="41d326f56356cfe2bbcb5c42122a79c005309d110b919adcd09d1409365aab6c" exitCode=0
Sep 11 16:30:12.114975 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:12.114659    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjzkx" event={"ID":"bc30a043-24a9-456a-94a2-a47fd49e9475","Type":"ContainerDied","Data":"41d326f56356cfe2bbcb5c42122a79c005309d110b919adcd09d1409365aab6c"}
Sep 11 16:30:12.940343 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:12.940264    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:30:12.940490 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:12.940381    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qbz6" podUID="35e7cb6b-bc4e-456f-94af-d0bf29f87e76"
Sep 11 16:30:13.939881 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:13.939832    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:30:13.940307 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:13.939884    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:30:13.940307 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:13.939959    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tv8zk" podUID="9868a0a5-34ec-40ba-8178-c0a1bd64a921"
Sep 11 16:30:13.940307 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:13.940082    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wxbp" podUID="29971043-47bb-4a97-8e4c-696ff995faf7"
Sep 11 16:30:14.573359 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:14.573318    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs\") pod \"network-metrics-daemon-tv8zk\" (UID: \"9868a0a5-34ec-40ba-8178-c0a1bd64a921\") " pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:30:14.573689 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:14.573491    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:30:14.573689 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:14.573574    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs podName:9868a0a5-34ec-40ba-8178-c0a1bd64a921 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:46.573550679 +0000 UTC m=+66.191824830 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs") pod "network-metrics-daemon-tv8zk" (UID: "9868a0a5-34ec-40ba-8178-c0a1bd64a921") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:30:14.674003 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:14.673951    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret\") pod \"global-pull-secret-syncer-4qbz6\" (UID: \"35e7cb6b-bc4e-456f-94af-d0bf29f87e76\") " pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:30:14.674003 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:14.674012    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bgcc\" (UniqueName: \"kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc\") pod \"network-check-target-2wxbp\" (UID: \"29971043-47bb-4a97-8e4c-696ff995faf7\") " pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:30:14.674314 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:14.674140    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:30:14.674314 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:14.674218    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret podName:35e7cb6b-bc4e-456f-94af-d0bf29f87e76 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:46.674197443 +0000 UTC m=+66.292471604 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret") pod "global-pull-secret-syncer-4qbz6" (UID: "35e7cb6b-bc4e-456f-94af-d0bf29f87e76") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:30:14.674314 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:14.674148    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:30:14.674314 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:14.674275    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:30:14.674314 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:14.674301    2557 projected.go:196] Error preparing data for projected volume kube-api-access-9bgcc for pod openshift-network-diagnostics/network-check-target-2wxbp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:30:14.674559 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:14.674360    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc podName:29971043-47bb-4a97-8e4c-696ff995faf7 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:46.674342868 +0000 UTC m=+66.292617019 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9bgcc" (UniqueName: "kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc") pod "network-check-target-2wxbp" (UID: "29971043-47bb-4a97-8e4c-696ff995faf7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:30:14.940134 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:14.940057    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:30:14.940565 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:14.940180    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4qbz6" podUID="35e7cb6b-bc4e-456f-94af-d0bf29f87e76"
Sep 11 16:30:15.142110 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.142081    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-196.ec2.internal" event="NodeReady"
Sep 11 16:30:15.142270 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.142221    2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 16:30:15.182675 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.182634    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"]
Sep 11 16:30:15.235641 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.235544    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74f4b6c6d4-xnjzw"]
Sep 11 16:30:15.235811 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.235712    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.238412 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.238384    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 16:30:15.238573 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.238426    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 16:30:15.238707 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.238688    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 16:30:15.238821 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.238690    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6rbz9\""
Sep 11 16:30:15.244973 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.244952    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 16:30:15.255357 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.255335    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797dffcdfb-9fcpd"]
Sep 11 16:30:15.255496 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.255472    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74f4b6c6d4-xnjzw"
Sep 11 16:30:15.259066 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.259043    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 16:30:15.259188 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.259086    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 16:30:15.259188 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.259150    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 16:30:15.259508 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.259483    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 11 16:30:15.271471 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.271446    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"]
Sep 11 16:30:15.271602 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.271586    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797dffcdfb-9fcpd"
Sep 11 16:30:15.274180 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.274159    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xfwxg\""
Sep 11 16:30:15.274302 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.274209    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 11 16:30:15.284682 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.284653    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797dffcdfb-9fcpd"]
Sep 11 16:30:15.284682 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.284682    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74f4b6c6d4-xnjzw"]
Sep 11 16:30:15.284825 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.284724    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"]
Sep 11 16:30:15.284825 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.284743    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tvq8f"]
Sep 11 16:30:15.284908 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.284858    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.287818 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.287797    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 11 16:30:15.287927 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.287878    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 11 16:30:15.287927 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.287891    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 11 16:30:15.288045 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.287882    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 11 16:30:15.298975 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.298952    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jmfl8"]
Sep 11 16:30:15.299119 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.299046    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:30:15.301536 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.301515    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 16:30:15.301709 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.301685    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 16:30:15.301798 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.301708    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-55n2r\""
Sep 11 16:30:15.319162 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.319126    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"]
Sep 11 16:30:15.319162 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.319164    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jmfl8"]
Sep 11 16:30:15.319321 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.319182    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tvq8f"]
Sep 11 16:30:15.319321 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.319251    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jmfl8"
Sep 11 16:30:15.323199 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.321997    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-t57kr\""
Sep 11 16:30:15.323199 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.322019    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 16:30:15.323199 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.322228    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 16:30:15.323199 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.322315    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 16:30:15.379278 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379247    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cfe52c2d-431a-4789-93cc-0ccd03dbf891-hub\") pod \"cluster-proxy-proxy-agent-6b84c4844b-x7xr4\" (UID: \"cfe52c2d-431a-4789-93cc-0ccd03dbf891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.379278 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379281    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75b74905-0fdb-448d-b158-ec421b28c721-installation-pull-secrets\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.379508 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379319    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsgtw\" (UniqueName: \"kubernetes.io/projected/aa169a0d-cdbf-4505-8840-04ea28f6b620-kube-api-access-lsgtw\") pod \"klusterlet-addon-workmgr-74f4b6c6d4-xnjzw\" (UID: \"aa169a0d-cdbf-4505-8840-04ea28f6b620\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74f4b6c6d4-xnjzw"
Sep 11 16:30:15.379508 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379336    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75b74905-0fdb-448d-b158-ec421b28c721-registry-certificates\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.379508 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379357    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75b74905-0fdb-448d-b158-ec421b28c721-trusted-ca\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.379508 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379375    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75b74905-0fdb-448d-b158-ec421b28c721-image-registry-private-configuration\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.379508 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379391    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.379508 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379405    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75b74905-0fdb-448d-b158-ec421b28c721-ca-trust-extracted\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.379508 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379420    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/be76568d-e693-434e-9342-20d7b22278f1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-797dffcdfb-9fcpd\" (UID: \"be76568d-e693-434e-9342-20d7b22278f1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797dffcdfb-9fcpd"
Sep 11 16:30:15.379750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379508    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-bound-sa-token\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.379750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379539    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtkpt\" (UniqueName: \"kubernetes.io/projected/be76568d-e693-434e-9342-20d7b22278f1-kube-api-access-mtkpt\") pod \"managed-serviceaccount-addon-agent-797dffcdfb-9fcpd\" (UID: \"be76568d-e693-434e-9342-20d7b22278f1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797dffcdfb-9fcpd"
Sep 11 16:30:15.379750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379558    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cfe52c2d-431a-4789-93cc-0ccd03dbf891-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b84c4844b-x7xr4\" (UID: \"cfe52c2d-431a-4789-93cc-0ccd03dbf891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.379750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379572    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfe52c2d-431a-4789-93cc-0ccd03dbf891-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b84c4844b-x7xr4\" (UID: \"cfe52c2d-431a-4789-93cc-0ccd03dbf891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.379750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379602    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cfe52c2d-431a-4789-93cc-0ccd03dbf891-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b84c4844b-x7xr4\" (UID: \"cfe52c2d-431a-4789-93cc-0ccd03dbf891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.379750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379650    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t47vk\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-kube-api-access-t47vk\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.379750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379736    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cfe52c2d-431a-4789-93cc-0ccd03dbf891-ca\") pod \"cluster-proxy-proxy-agent-6b84c4844b-x7xr4\" (UID: \"cfe52c2d-431a-4789-93cc-0ccd03dbf891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.379974 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379761    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6cad760a-cbe5-4fb3-9229-ee77198fab07-config-volume\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:30:15.379974 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379783    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:30:15.379974 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379799    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtnd6\" (UniqueName: \"kubernetes.io/projected/6cad760a-cbe5-4fb3-9229-ee77198fab07-kube-api-access-mtnd6\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:30:15.379974 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379829    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/aa169a0d-cdbf-4505-8840-04ea28f6b620-klusterlet-config\") pod \"klusterlet-addon-workmgr-74f4b6c6d4-xnjzw\" (UID: \"aa169a0d-cdbf-4505-8840-04ea28f6b620\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74f4b6c6d4-xnjzw"
Sep 11 16:30:15.379974 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379857    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa169a0d-cdbf-4505-8840-04ea28f6b620-tmp\") pod \"klusterlet-addon-workmgr-74f4b6c6d4-xnjzw\" (UID: \"aa169a0d-cdbf-4505-8840-04ea28f6b620\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74f4b6c6d4-xnjzw"
Sep 11 16:30:15.379974 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379879    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjs47\" (UniqueName: \"kubernetes.io/projected/cfe52c2d-431a-4789-93cc-0ccd03dbf891-kube-api-access-tjs47\") pod \"cluster-proxy-proxy-agent-6b84c4844b-x7xr4\" (UID: \"cfe52c2d-431a-4789-93cc-0ccd03dbf891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.379974 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.379909    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cad760a-cbe5-4fb3-9229-ee77198fab07-tmp-dir\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:30:15.386304 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.386269    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f9zb_626143a7-d803-4b33-ae26-1cd1802b8cf0/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:15.477201 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.477167    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f9zb_626143a7-d803-4b33-ae26-1cd1802b8cf0/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:15.481150 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481123    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cfe52c2d-431a-4789-93cc-0ccd03dbf891-ca\") pod \"cluster-proxy-proxy-agent-6b84c4844b-x7xr4\" (UID: \"cfe52c2d-431a-4789-93cc-0ccd03dbf891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.481295 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481154    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6cad760a-cbe5-4fb3-9229-ee77198fab07-config-volume\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:30:15.481295 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481179    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:30:15.481295 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481204    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtnd6\" (UniqueName: \"kubernetes.io/projected/6cad760a-cbe5-4fb3-9229-ee77198fab07-kube-api-access-mtnd6\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:30:15.481295 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481233    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/aa169a0d-cdbf-4505-8840-04ea28f6b620-klusterlet-config\") pod \"klusterlet-addon-workmgr-74f4b6c6d4-xnjzw\" (UID: \"aa169a0d-cdbf-4505-8840-04ea28f6b620\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74f4b6c6d4-xnjzw"
Sep 11 16:30:15.481295 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481258    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa169a0d-cdbf-4505-8840-04ea28f6b620-tmp\") pod \"klusterlet-addon-workmgr-74f4b6c6d4-xnjzw\" (UID: \"aa169a0d-cdbf-4505-8840-04ea28f6b620\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74f4b6c6d4-xnjzw"
Sep 11 16:30:15.481295 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481280    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjs47\" (UniqueName: \"kubernetes.io/projected/cfe52c2d-431a-4789-93cc-0ccd03dbf891-kube-api-access-tjs47\") pod \"cluster-proxy-proxy-agent-6b84c4844b-x7xr4\" (UID: \"cfe52c2d-431a-4789-93cc-0ccd03dbf891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.481295 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:15.481290    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:30:15.481635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481307    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdxfd\" (UniqueName: \"kubernetes.io/projected/7830a971-ff74-4997-aa28-471e1d0686a3-kube-api-access-pdxfd\") pod \"ingress-canary-jmfl8\" (UID: \"7830a971-ff74-4997-aa28-471e1d0686a3\") " pod="openshift-ingress-canary/ingress-canary-jmfl8"
Sep 11 16:30:15.481635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481335    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cad760a-cbe5-4fb3-9229-ee77198fab07-tmp-dir\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:30:15.481635 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:15.481352    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls podName:6cad760a-cbe5-4fb3-9229-ee77198fab07 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:15.981333264 +0000 UTC m=+35.599607435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls") pod "dns-default-tvq8f" (UID: "6cad760a-cbe5-4fb3-9229-ee77198fab07") : secret "dns-default-metrics-tls" not found
Sep 11 16:30:15.481635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481387    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cfe52c2d-431a-4789-93cc-0ccd03dbf891-hub\") pod \"cluster-proxy-proxy-agent-6b84c4844b-x7xr4\" (UID: \"cfe52c2d-431a-4789-93cc-0ccd03dbf891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.481635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481413    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75b74905-0fdb-448d-b158-ec421b28c721-installation-pull-secrets\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.481635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481456    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsgtw\" (UniqueName: \"kubernetes.io/projected/aa169a0d-cdbf-4505-8840-04ea28f6b620-kube-api-access-lsgtw\") pod \"klusterlet-addon-workmgr-74f4b6c6d4-xnjzw\" (UID: \"aa169a0d-cdbf-4505-8840-04ea28f6b620\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74f4b6c6d4-xnjzw"
Sep 11 16:30:15.481635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481481    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75b74905-0fdb-448d-b158-ec421b28c721-registry-certificates\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.481635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481509    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75b74905-0fdb-448d-b158-ec421b28c721-trusted-ca\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.481635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481539    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75b74905-0fdb-448d-b158-ec421b28c721-image-registry-private-configuration\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.481635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481566    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.481635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481590    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75b74905-0fdb-448d-b158-ec421b28c721-ca-trust-extracted\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.482128 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481638    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/be76568d-e693-434e-9342-20d7b22278f1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-797dffcdfb-9fcpd\" (UID: \"be76568d-e693-434e-9342-20d7b22278f1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797dffcdfb-9fcpd"
Sep 11 16:30:15.482128 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481692    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cad760a-cbe5-4fb3-9229-ee77198fab07-tmp-dir\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:30:15.483203 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.482493    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75b74905-0fdb-448d-b158-ec421b28c721-registry-certificates\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.483203 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.482509    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75b74905-0fdb-448d-b158-ec421b28c721-ca-trust-extracted\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.483203 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.482899    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa169a0d-cdbf-4505-8840-04ea28f6b620-tmp\") pod \"klusterlet-addon-workmgr-74f4b6c6d4-xnjzw\" (UID: \"aa169a0d-cdbf-4505-8840-04ea28f6b620\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74f4b6c6d4-xnjzw"
Sep 11 16:30:15.483203 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.481695    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-bound-sa-token\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.483453 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.483217    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtkpt\" (UniqueName: \"kubernetes.io/projected/be76568d-e693-434e-9342-20d7b22278f1-kube-api-access-mtkpt\") pod \"managed-serviceaccount-addon-agent-797dffcdfb-9fcpd\" (UID: \"be76568d-e693-434e-9342-20d7b22278f1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797dffcdfb-9fcpd"
Sep 11 16:30:15.483453 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.483255    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7830a971-ff74-4997-aa28-471e1d0686a3-cert\") pod \"ingress-canary-jmfl8\" (UID: \"7830a971-ff74-4997-aa28-471e1d0686a3\") " pod="openshift-ingress-canary/ingress-canary-jmfl8"
Sep 11 16:30:15.483453 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.483284    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cfe52c2d-431a-4789-93cc-0ccd03dbf891-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b84c4844b-x7xr4\" (UID: \"cfe52c2d-431a-4789-93cc-0ccd03dbf891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.483453 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.483312    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfe52c2d-431a-4789-93cc-0ccd03dbf891-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b84c4844b-x7xr4\" (UID: \"cfe52c2d-431a-4789-93cc-0ccd03dbf891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.483453 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.483340    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cfe52c2d-431a-4789-93cc-0ccd03dbf891-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b84c4844b-x7xr4\" (UID: \"cfe52c2d-431a-4789-93cc-0ccd03dbf891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.483453 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.483367    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t47vk\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-kube-api-access-t47vk\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.483775 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.483525    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75b74905-0fdb-448d-b158-ec421b28c721-trusted-ca\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.483775 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:15.483644    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:30:15.483775 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:15.483664    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b6d6dfc9-2kkc2: secret "image-registry-tls" not found
Sep 11 16:30:15.483775 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:15.483725    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls podName:75b74905-0fdb-448d-b158-ec421b28c721 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:15.983707129 +0000 UTC m=+35.601981282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls") pod "image-registry-57b6d6dfc9-2kkc2" (UID: "75b74905-0fdb-448d-b158-ec421b28c721") : secret "image-registry-tls" not found
Sep 11 16:30:15.484919 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.484440    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfe52c2d-431a-4789-93cc-0ccd03dbf891-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b84c4844b-x7xr4\" (UID: \"cfe52c2d-431a-4789-93cc-0ccd03dbf891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.484919 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.484867    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6cad760a-cbe5-4fb3-9229-ee77198fab07-config-volume\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:30:15.487147 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.487076    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cfe52c2d-431a-4789-93cc-0ccd03dbf891-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b84c4844b-x7xr4\" (UID: \"cfe52c2d-431a-4789-93cc-0ccd03dbf891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.487147 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.487082    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cfe52c2d-431a-4789-93cc-0ccd03dbf891-hub\") pod \"cluster-proxy-proxy-agent-6b84c4844b-x7xr4\" (UID: \"cfe52c2d-431a-4789-93cc-0ccd03dbf891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.487147 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.487087    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/aa169a0d-cdbf-4505-8840-04ea28f6b620-klusterlet-config\") pod \"klusterlet-addon-workmgr-74f4b6c6d4-xnjzw\" (UID: \"aa169a0d-cdbf-4505-8840-04ea28f6b620\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74f4b6c6d4-xnjzw"
Sep 11 16:30:15.487416 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.487393    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cfe52c2d-431a-4789-93cc-0ccd03dbf891-ca\") pod \"cluster-proxy-proxy-agent-6b84c4844b-x7xr4\" (UID: \"cfe52c2d-431a-4789-93cc-0ccd03dbf891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.487508 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.487488    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cfe52c2d-431a-4789-93cc-0ccd03dbf891-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b84c4844b-x7xr4\" (UID: \"cfe52c2d-431a-4789-93cc-0ccd03dbf891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.487798 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.487769    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75b74905-0fdb-448d-b158-ec421b28c721-image-registry-private-configuration\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.488227 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.488207    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/be76568d-e693-434e-9342-20d7b22278f1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-797dffcdfb-9fcpd\" (UID: \"be76568d-e693-434e-9342-20d7b22278f1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797dffcdfb-9fcpd"
Sep 11 16:30:15.488618 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.488581    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75b74905-0fdb-448d-b158-ec421b28c721-installation-pull-secrets\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.492380 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.492351    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-bound-sa-token\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.492575 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.492545    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjs47\" (UniqueName: \"kubernetes.io/projected/cfe52c2d-431a-4789-93cc-0ccd03dbf891-kube-api-access-tjs47\") pod \"cluster-proxy-proxy-agent-6b84c4844b-x7xr4\" (UID: \"cfe52c2d-431a-4789-93cc-0ccd03dbf891\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.492993 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.492964    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsgtw\" (UniqueName: \"kubernetes.io/projected/aa169a0d-cdbf-4505-8840-04ea28f6b620-kube-api-access-lsgtw\") pod \"klusterlet-addon-workmgr-74f4b6c6d4-xnjzw\" (UID: \"aa169a0d-cdbf-4505-8840-04ea28f6b620\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74f4b6c6d4-xnjzw"
Sep 11 16:30:15.493514 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.493493    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtkpt\" (UniqueName: \"kubernetes.io/projected/be76568d-e693-434e-9342-20d7b22278f1-kube-api-access-mtkpt\") pod \"managed-serviceaccount-addon-agent-797dffcdfb-9fcpd\" (UID: \"be76568d-e693-434e-9342-20d7b22278f1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797dffcdfb-9fcpd"
Sep 11 16:30:15.493514 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.493501    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t47vk\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-kube-api-access-t47vk\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.497985 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.497962    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtnd6\" (UniqueName: \"kubernetes.io/projected/6cad760a-cbe5-4fb3-9229-ee77198fab07-kube-api-access-mtnd6\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:30:15.565892 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.565855    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74f4b6c6d4-xnjzw"
Sep 11 16:30:15.584181 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.584148    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7830a971-ff74-4997-aa28-471e1d0686a3-cert\") pod \"ingress-canary-jmfl8\" (UID: \"7830a971-ff74-4997-aa28-471e1d0686a3\") " pod="openshift-ingress-canary/ingress-canary-jmfl8"
Sep 11 16:30:15.584363 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.584344    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdxfd\" (UniqueName: \"kubernetes.io/projected/7830a971-ff74-4997-aa28-471e1d0686a3-kube-api-access-pdxfd\") pod \"ingress-canary-jmfl8\" (UID: \"7830a971-ff74-4997-aa28-471e1d0686a3\") " pod="openshift-ingress-canary/ingress-canary-jmfl8"
Sep 11 16:30:15.587060 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.587033    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7830a971-ff74-4997-aa28-471e1d0686a3-cert\") pod \"ingress-canary-jmfl8\" (UID: \"7830a971-ff74-4997-aa28-471e1d0686a3\") " pod="openshift-ingress-canary/ingress-canary-jmfl8"
Sep 11 16:30:15.596265 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.596242    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797dffcdfb-9fcpd"
Sep 11 16:30:15.596701 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.596676    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdxfd\" (UniqueName: \"kubernetes.io/projected/7830a971-ff74-4997-aa28-471e1d0686a3-kube-api-access-pdxfd\") pod \"ingress-canary-jmfl8\" (UID: \"7830a971-ff74-4997-aa28-471e1d0686a3\") " pod="openshift-ingress-canary/ingress-canary-jmfl8"
Sep 11 16:30:15.605909 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.605891    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:30:15.640993 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.640961    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jmfl8"
Sep 11 16:30:15.811192 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.811097    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f9zb_626143a7-d803-4b33-ae26-1cd1802b8cf0/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:15.914269 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.914228    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f9zb_626143a7-d803-4b33-ae26-1cd1802b8cf0/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:15.939978 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.939949    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:30:15.940149 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.940130    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:30:15.943277 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.943242    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 16:30:15.943399 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.943296    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 16:30:15.943399 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.943331    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5vm65\""
Sep 11 16:30:15.943399 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.943296    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cczvg\""
Sep 11 16:30:15.943399 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.943247    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 16:30:15.988098 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.987964    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:30:15.988098 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:15.988059    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:15.988342 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:15.988133    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:30:15.988342 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:15.988158    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:30:15.988342 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:15.988170    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b6d6dfc9-2kkc2: secret "image-registry-tls" not found
Sep 11 16:30:15.988342 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:15.988202    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls podName:6cad760a-cbe5-4fb3-9229-ee77198fab07 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:16.988182891 +0000 UTC m=+36.606457042 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls") pod "dns-default-tvq8f" (UID: "6cad760a-cbe5-4fb3-9229-ee77198fab07") : secret "dns-default-metrics-tls" not found
Sep 11 16:30:15.988342 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:15.988221    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls podName:75b74905-0fdb-448d-b158-ec421b28c721 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:16.988211729 +0000 UTC m=+36.606485876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls") pod "image-registry-57b6d6dfc9-2kkc2" (UID: "75b74905-0fdb-448d-b158-ec421b28c721") : secret "image-registry-tls" not found
Sep 11 16:30:16.940755 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:16.940708    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:30:16.944075 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:16.943988    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 16:30:16.995920 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:16.995885    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:16.996077 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:16.995949    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:30:16.996077 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:16.996045    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:30:16.996077 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:16.996057    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:30:16.996178 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:16.996132    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls podName:6cad760a-cbe5-4fb3-9229-ee77198fab07 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:18.99611212 +0000 UTC m=+38.614386286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls") pod "dns-default-tvq8f" (UID: "6cad760a-cbe5-4fb3-9229-ee77198fab07") : secret "dns-default-metrics-tls" not found
Sep 11 16:30:16.996178 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:16.996063    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b6d6dfc9-2kkc2: secret "image-registry-tls" not found
Sep 11 16:30:16.996246 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:16.996187    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls podName:75b74905-0fdb-448d-b158-ec421b28c721 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:18.996174127 +0000 UTC m=+38.614448300 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls") pod "image-registry-57b6d6dfc9-2kkc2" (UID: "75b74905-0fdb-448d-b158-ec421b28c721") : secret "image-registry-tls" not found
Sep 11 16:30:17.336716 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:17.336380    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jmfl8"]
Sep 11 16:30:17.336855 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:17.336802    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74f4b6c6d4-xnjzw"]
Sep 11 16:30:17.338198 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:17.338172    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797dffcdfb-9fcpd"]
Sep 11 16:30:17.340274 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:30:17.338775    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7830a971_ff74_4997_aa28_471e1d0686a3.slice/crio-56b00119c3266489e10b6a0873281483ade3c8414fc67dfc5545855da01e127d WatchSource:0}: Error finding container 56b00119c3266489e10b6a0873281483ade3c8414fc67dfc5545855da01e127d: Status 404 returned error can't find the container with id 56b00119c3266489e10b6a0873281483ade3c8414fc67dfc5545855da01e127d
Sep 11 16:30:17.340274 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:17.339030    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"]
Sep 11 16:30:17.344211 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:30:17.344171    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa169a0d_cdbf_4505_8840_04ea28f6b620.slice/crio-69ec3e32d7118e345f3115970c7a871a8daeeb33019e87f45db159ce3805779e WatchSource:0}: Error finding container 69ec3e32d7118e345f3115970c7a871a8daeeb33019e87f45db159ce3805779e: Status 404 returned error can't find the container with id 69ec3e32d7118e345f3115970c7a871a8daeeb33019e87f45db159ce3805779e
Sep 11 16:30:17.344544 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:30:17.344523    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe76568d_e693_434e_9342_20d7b22278f1.slice/crio-a19aa4d8560ef210223dbdf4b65ea45a62946d4a7c0c07b2b7f669b126126565 WatchSource:0}: Error finding container a19aa4d8560ef210223dbdf4b65ea45a62946d4a7c0c07b2b7f669b126126565: Status 404 returned error can't find the container with id a19aa4d8560ef210223dbdf4b65ea45a62946d4a7c0c07b2b7f669b126126565
Sep 11 16:30:17.345203 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:30:17.345181    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfe52c2d_431a_4789_93cc_0ccd03dbf891.slice/crio-a6a992e12860fd6dbabfd535399345a192c91104831224119ee060e7a6293e4e WatchSource:0}: Error finding container a6a992e12860fd6dbabfd535399345a192c91104831224119ee060e7a6293e4e: Status 404 returned error can't find the container with id a6a992e12860fd6dbabfd535399345a192c91104831224119ee060e7a6293e4e
Sep 11 16:30:18.137979 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:18.137899    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4" event={"ID":"cfe52c2d-431a-4789-93cc-0ccd03dbf891","Type":"ContainerStarted","Data":"a6a992e12860fd6dbabfd535399345a192c91104831224119ee060e7a6293e4e"}
Sep 11 16:30:18.140186 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:18.140100    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jmfl8" event={"ID":"7830a971-ff74-4997-aa28-471e1d0686a3","Type":"ContainerStarted","Data":"56b00119c3266489e10b6a0873281483ade3c8414fc67dfc5545855da01e127d"}
Sep 11 16:30:18.145857 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:18.144958    2557 generic.go:356] "Generic (PLEG): container finished" podID="bc30a043-24a9-456a-94a2-a47fd49e9475" containerID="675c96ecfc35f6f5da78cbaba9abd42114404e7b5859577e412da7fc3cbe7a03" exitCode=0
Sep 11 16:30:18.146081 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:18.146017    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjzkx" event={"ID":"bc30a043-24a9-456a-94a2-a47fd49e9475","Type":"ContainerDied","Data":"675c96ecfc35f6f5da78cbaba9abd42114404e7b5859577e412da7fc3cbe7a03"}
Sep 11 16:30:18.149977 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:18.149925    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797dffcdfb-9fcpd" event={"ID":"be76568d-e693-434e-9342-20d7b22278f1","Type":"ContainerStarted","Data":"a19aa4d8560ef210223dbdf4b65ea45a62946d4a7c0c07b2b7f669b126126565"}
Sep 11 16:30:18.163023 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:18.162543    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74f4b6c6d4-xnjzw" event={"ID":"aa169a0d-cdbf-4505-8840-04ea28f6b620","Type":"ContainerStarted","Data":"69ec3e32d7118e345f3115970c7a871a8daeeb33019e87f45db159ce3805779e"}
Sep 11 16:30:19.013890 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:19.013804    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:19.014076 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:19.013899    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:30:19.014076 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:19.014028    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:30:19.014202 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:19.014089    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls podName:6cad760a-cbe5-4fb3-9229-ee77198fab07 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:23.014070932 +0000 UTC m=+42.632345081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls") pod "dns-default-tvq8f" (UID: "6cad760a-cbe5-4fb3-9229-ee77198fab07") : secret "dns-default-metrics-tls" not found
Sep 11 16:30:19.014646 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:19.014514    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:30:19.014646 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:19.014538    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b6d6dfc9-2kkc2: secret "image-registry-tls" not found
Sep 11 16:30:19.014646 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:19.014599    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls podName:75b74905-0fdb-448d-b158-ec421b28c721 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:23.014581885 +0000 UTC m=+42.632856053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls") pod "image-registry-57b6d6dfc9-2kkc2" (UID: "75b74905-0fdb-448d-b158-ec421b28c721") : secret "image-registry-tls" not found
Sep 11 16:30:19.179665 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:19.179540    2557 generic.go:356] "Generic (PLEG): container finished" podID="bc30a043-24a9-456a-94a2-a47fd49e9475" containerID="0f357b62b62f680be693980dc881791b2f40a047685bbb6e05f334b3993a6e28" exitCode=0
Sep 11 16:30:19.179665 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:19.179598    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjzkx" event={"ID":"bc30a043-24a9-456a-94a2-a47fd49e9475","Type":"ContainerDied","Data":"0f357b62b62f680be693980dc881791b2f40a047685bbb6e05f334b3993a6e28"}
Sep 11 16:30:20.191178 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:20.191137    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mjzkx" event={"ID":"bc30a043-24a9-456a-94a2-a47fd49e9475","Type":"ContainerStarted","Data":"d5d792cf98e10befeef936ba7c15d37b3a8df8d2d3fb73cdfe00288eeeb298c1"}
Sep 11 16:30:20.218339 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:20.217961    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mjzkx" podStartSLOduration=7.091881963 podStartE2EDuration="39.217939151s" totalImagesPullingTime="32.126057188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:29:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:20.21648727 +0000 UTC m=+39.834761453" watchObservedRunningTime="2026-09-11 16:30:20.217939151 +0000 UTC m=+39.836213318"
Sep 11 16:30:20.267851 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:20.267816    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f9zb_626143a7-d803-4b33-ae26-1cd1802b8cf0/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:20.367145 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:20.366949    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f9zb_626143a7-d803-4b33-ae26-1cd1802b8cf0/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:20.467317 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:20.467247    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f9zb_626143a7-d803-4b33-ae26-1cd1802b8cf0/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:20.539315 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:20.539225    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f9zb_626143a7-d803-4b33-ae26-1cd1802b8cf0/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:20.816811 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:20.816669    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f9zb_626143a7-d803-4b33-ae26-1cd1802b8cf0/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:20.918483 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:20.918446    2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f9zb_626143a7-d803-4b33-ae26-1cd1802b8cf0/konnectivity-agent/0.log" limit=1024
Sep 11 16:30:23.050200 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:23.050165    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:30:23.050565 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:23.050224    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:23.050565 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:23.050326    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:30:23.050565 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:23.050394    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls podName:6cad760a-cbe5-4fb3-9229-ee77198fab07 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:31.050377619 +0000 UTC m=+50.668651792 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls") pod "dns-default-tvq8f" (UID: "6cad760a-cbe5-4fb3-9229-ee77198fab07") : secret "dns-default-metrics-tls" not found
Sep 11 16:30:23.050565 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:23.050329    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:30:23.050565 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:23.050429    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b6d6dfc9-2kkc2: secret "image-registry-tls" not found
Sep 11 16:30:23.050565 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:23.050478    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls podName:75b74905-0fdb-448d-b158-ec421b28c721 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:31.050464987 +0000 UTC m=+50.668739151 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls") pod "image-registry-57b6d6dfc9-2kkc2" (UID: "75b74905-0fdb-448d-b158-ec421b28c721") : secret "image-registry-tls" not found
Sep 11 16:30:27.213382 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:27.213342    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4" event={"ID":"cfe52c2d-431a-4789-93cc-0ccd03dbf891","Type":"ContainerStarted","Data":"31cc8cc41444313762e3c655e9ed701a7df5717b3dc958349675c5fa198cd815"}
Sep 11 16:30:27.213887 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:27.213397    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4" event={"ID":"cfe52c2d-431a-4789-93cc-0ccd03dbf891","Type":"ContainerStarted","Data":"6464370a2bb560f3fbc051e24cf925404c2f952285e4a8b4fecd0c7eac146fb4"}
Sep 11 16:30:27.213887 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:27.213416    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4" event={"ID":"cfe52c2d-431a-4789-93cc-0ccd03dbf891","Type":"ContainerStarted","Data":"a02a3a07d045ef2a79e4405b9ddb03ff6656ed742451945c699d2e0c6566338d"}
Sep 11 16:30:27.214904 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:27.214876    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jmfl8" event={"ID":"7830a971-ff74-4997-aa28-471e1d0686a3","Type":"ContainerStarted","Data":"19746025ac37f67669ceb3f1cf2899051f809a0679c05e923fa9787f7f3165f5"}
Sep 11 16:30:27.216257 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:27.216228    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797dffcdfb-9fcpd" event={"ID":"be76568d-e693-434e-9342-20d7b22278f1","Type":"ContainerStarted","Data":"a2c95266f492cdd4dd3950037ab0edc22a9859b91b9d5a7031342b9da872b617"}
Sep 11 16:30:27.217696 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:27.217668    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74f4b6c6d4-xnjzw" event={"ID":"aa169a0d-cdbf-4505-8840-04ea28f6b620","Type":"ContainerStarted","Data":"daec92545603fb235da3bf8f7cb67c7c55909435567682dbc2764014c8ee2e36"}
Sep 11 16:30:27.217911 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:27.217883    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74f4b6c6d4-xnjzw"
Sep 11 16:30:27.219412 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:27.219393    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74f4b6c6d4-xnjzw"
Sep 11 16:30:27.234665 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:27.234600    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4" podStartSLOduration=31.314181696 podStartE2EDuration="40.234587132s" totalImagesPullingTime="8.920405436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:27.233483705 +0000 UTC m=+46.851757876" watchObservedRunningTime="2026-09-11 16:30:27.234587132 +0000 UTC m=+46.852861293"
Sep 11 16:30:27.249996 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:27.249942    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jmfl8" podStartSLOduration=3.33943099 podStartE2EDuration="12.249929266s" totalImagesPullingTime="8.910498276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:30:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:27.249722138 +0000 UTC m=+46.867996307" watchObservedRunningTime="2026-09-11 16:30:27.249929266 +0000 UTC m=+46.868203437"
Sep 11 16:30:27.267305 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:27.267247    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74f4b6c6d4-xnjzw" podStartSLOduration=31.361381632 podStartE2EDuration="40.267227572s" totalImagesPullingTime="8.90584594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:27.266539183 +0000 UTC m=+46.884813355" watchObservedRunningTime="2026-09-11 16:30:27.267227572 +0000 UTC m=+46.885501741"
Sep 11 16:30:27.283057 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:27.282998    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-797dffcdfb-9fcpd" podStartSLOduration=31.378195913 podStartE2EDuration="40.28297546s" totalImagesPullingTime="8.904779547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:27.282651945 +0000 UTC m=+46.900926108" watchObservedRunningTime="2026-09-11 16:30:27.28297546 +0000 UTC m=+46.901249631"
Sep 11 16:30:31.111565 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:31.111520    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:30:31.111983 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:31.111595    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:31.111983 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:31.111693    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:30:31.111983 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:31.111734    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:30:31.111983 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:31.111748    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b6d6dfc9-2kkc2: secret "image-registry-tls" not found
Sep 11 16:30:31.111983 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:31.111789    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls podName:6cad760a-cbe5-4fb3-9229-ee77198fab07 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:47.111771826 +0000 UTC m=+66.730045974 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls") pod "dns-default-tvq8f" (UID: "6cad760a-cbe5-4fb3-9229-ee77198fab07") : secret "dns-default-metrics-tls" not found
Sep 11 16:30:31.111983 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:31.111804    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls podName:75b74905-0fdb-448d-b158-ec421b28c721 nodeName:}" failed. No retries permitted until 2026-09-11 16:30:47.111797873 +0000 UTC m=+66.730072021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls") pod "image-registry-57b6d6dfc9-2kkc2" (UID: "75b74905-0fdb-448d-b158-ec421b28c721") : secret "image-registry-tls" not found
Sep 11 16:30:42.126192 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:42.126155    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h666m"
Sep 11 16:30:46.626788 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:46.626746    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs\") pod \"network-metrics-daemon-tv8zk\" (UID: \"9868a0a5-34ec-40ba-8178-c0a1bd64a921\") " pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:30:46.629675 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:46.629650    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 16:30:46.637883 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:46.637860    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 16:30:46.637957 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:46.637924    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs podName:9868a0a5-34ec-40ba-8178-c0a1bd64a921 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:50.637903685 +0000 UTC m=+130.256177846 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs") pod "network-metrics-daemon-tv8zk" (UID: "9868a0a5-34ec-40ba-8178-c0a1bd64a921") : secret "metrics-daemon-secret" not found
Sep 11 16:30:46.727749 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:46.727707    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret\") pod \"global-pull-secret-syncer-4qbz6\" (UID: \"35e7cb6b-bc4e-456f-94af-d0bf29f87e76\") " pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:30:46.727917 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:46.727778    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bgcc\" (UniqueName: \"kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc\") pod \"network-check-target-2wxbp\" (UID: \"29971043-47bb-4a97-8e4c-696ff995faf7\") " pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:30:46.730377 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:46.730355    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 16:30:46.730442 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:46.730417    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 16:30:46.740587 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:46.740558    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 16:30:46.741916 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:46.741895    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/35e7cb6b-bc4e-456f-94af-d0bf29f87e76-original-pull-secret\") pod \"global-pull-secret-syncer-4qbz6\" (UID: \"35e7cb6b-bc4e-456f-94af-d0bf29f87e76\") " pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:30:46.751681 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:46.751658    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bgcc\" (UniqueName: \"kubernetes.io/projected/29971043-47bb-4a97-8e4c-696ff995faf7-kube-api-access-9bgcc\") pod \"network-check-target-2wxbp\" (UID: \"29971043-47bb-4a97-8e4c-696ff995faf7\") " pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:30:46.854396 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:46.854360    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cczvg\""
Sep 11 16:30:46.861853 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:46.861826    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:30:46.952900 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:46.952873    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4qbz6"
Sep 11 16:30:47.132228 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:47.132182    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:30:47.132441 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:47.132257    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:30:47.132441 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:47.132404    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:30:47.132441 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:47.132428    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b6d6dfc9-2kkc2: secret "image-registry-tls" not found
Sep 11 16:30:47.132441 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:47.132434    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:30:47.132642 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:47.132496    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls podName:6cad760a-cbe5-4fb3-9229-ee77198fab07 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:19.132475943 +0000 UTC m=+98.750750107 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls") pod "dns-default-tvq8f" (UID: "6cad760a-cbe5-4fb3-9229-ee77198fab07") : secret "dns-default-metrics-tls" not found
Sep 11 16:30:47.132642 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:30:47.132516    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls podName:75b74905-0fdb-448d-b158-ec421b28c721 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:19.132506261 +0000 UTC m=+98.750780414 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls") pod "image-registry-57b6d6dfc9-2kkc2" (UID: "75b74905-0fdb-448d-b158-ec421b28c721") : secret "image-registry-tls" not found
Sep 11 16:30:47.172241 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:47.172216    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2wxbp"]
Sep 11 16:30:47.174634 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:30:47.174597    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29971043_47bb_4a97_8e4c_696ff995faf7.slice/crio-41a831f67fca2c83a62f11fe8c2852b900f84bca9d448131573f9da620994333 WatchSource:0}: Error finding container 41a831f67fca2c83a62f11fe8c2852b900f84bca9d448131573f9da620994333: Status 404 returned error can't find the container with id 41a831f67fca2c83a62f11fe8c2852b900f84bca9d448131573f9da620994333
Sep 11 16:30:47.236268 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:47.236237    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4qbz6"]
Sep 11 16:30:47.239143 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:30:47.239114    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35e7cb6b_bc4e_456f_94af_d0bf29f87e76.slice/crio-5c960171e329dfe20fd36a6a083ab5c42523baf7dfae3276e5a81dfbc0261bec WatchSource:0}: Error finding container 5c960171e329dfe20fd36a6a083ab5c42523baf7dfae3276e5a81dfbc0261bec: Status 404 returned error can't find the container with id 5c960171e329dfe20fd36a6a083ab5c42523baf7dfae3276e5a81dfbc0261bec
Sep 11 16:30:47.279772 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:47.279736    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4qbz6" event={"ID":"35e7cb6b-bc4e-456f-94af-d0bf29f87e76","Type":"ContainerStarted","Data":"5c960171e329dfe20fd36a6a083ab5c42523baf7dfae3276e5a81dfbc0261bec"}
Sep 11 16:30:47.280894 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:47.280869    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2wxbp" event={"ID":"29971043-47bb-4a97-8e4c-696ff995faf7","Type":"ContainerStarted","Data":"41a831f67fca2c83a62f11fe8c2852b900f84bca9d448131573f9da620994333"}
Sep 11 16:30:52.302532 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:52.302491    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4qbz6" event={"ID":"35e7cb6b-bc4e-456f-94af-d0bf29f87e76","Type":"ContainerStarted","Data":"49c713b2dd1343992767cda81f872f3d3963b45761d2c9f78dc9660590e6e15e"}
Sep 11 16:30:52.304034 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:52.304005    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2wxbp" event={"ID":"29971043-47bb-4a97-8e4c-696ff995faf7","Type":"ContainerStarted","Data":"311cfe7990d26db03415d68c6f134f9db8b73598ff309237a891dfaca68e3d36"}
Sep 11 16:30:52.304162 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:52.304131    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:30:52.325742 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:52.325689    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4qbz6" podStartSLOduration=65.63232501 podStartE2EDuration="1m10.32567387s" totalImagesPullingTime="4.69334886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:52.325142603 +0000 UTC m=+71.943416773" watchObservedRunningTime="2026-09-11 16:30:52.32567387 +0000 UTC m=+71.943948039"
Sep 11 16:30:52.342588 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:30:52.342536    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2wxbp" podStartSLOduration=66.590278589 podStartE2EDuration="1m11.342521594s" totalImagesPullingTime="4.752243005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:30:52.341293439 +0000 UTC m=+71.959567608" watchObservedRunningTime="2026-09-11 16:30:52.342521594 +0000 UTC m=+71.960795812"
Sep 11 16:31:19.173754 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:19.173623    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls\") pod \"image-registry-57b6d6dfc9-2kkc2\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") " pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:31:19.173754 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:19.173693    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:31:19.174241 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:19.173754    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:31:19.174241 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:19.173777    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57b6d6dfc9-2kkc2: secret "image-registry-tls" not found
Sep 11 16:31:19.174241 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:19.173791    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:31:19.174241 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:19.173835    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls podName:75b74905-0fdb-448d-b158-ec421b28c721 nodeName:}" failed. No retries permitted until 2026-09-11 16:32:23.173818797 +0000 UTC m=+162.792092958 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls") pod "image-registry-57b6d6dfc9-2kkc2" (UID: "75b74905-0fdb-448d-b158-ec421b28c721") : secret "image-registry-tls" not found
Sep 11 16:31:19.174241 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:19.173848    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls podName:6cad760a-cbe5-4fb3-9229-ee77198fab07 nodeName:}" failed. No retries permitted until 2026-09-11 16:32:23.17384221 +0000 UTC m=+162.792116358 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls") pod "dns-default-tvq8f" (UID: "6cad760a-cbe5-4fb3-9229-ee77198fab07") : secret "dns-default-metrics-tls" not found
Sep 11 16:31:20.086260 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.086228    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-d5958"]
Sep 11 16:31:20.090425 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.090408    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:20.096818 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.096790    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 16:31:20.096936 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.096794    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 16:31:20.097225 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.097206    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vrmx6\""
Sep 11 16:31:20.097957 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.097939    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 16:31:20.098096 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.098065    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 16:31:20.115926 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.115885    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d5958"]
Sep 11 16:31:20.180054 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.180015    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/65fa786c-889c-4b0f-8a55-c738ceca7cc8-data-volume\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:20.180501 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.180065    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmblw\" (UniqueName: \"kubernetes.io/projected/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-api-access-nmblw\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:20.180501 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.180090    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/65fa786c-889c-4b0f-8a55-c738ceca7cc8-crio-socket\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:20.180501 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.180128    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:20.180501 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.180157    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:20.280649 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.280596    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:20.280778 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.280701    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/65fa786c-889c-4b0f-8a55-c738ceca7cc8-data-volume\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:20.280778 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.280737    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmblw\" (UniqueName: \"kubernetes.io/projected/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-api-access-nmblw\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:20.280778 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.280758    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/65fa786c-889c-4b0f-8a55-c738ceca7cc8-crio-socket\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:20.280935 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:20.280781    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:20.280935 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:20.280853    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:31:20.280935 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.280873    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/65fa786c-889c-4b0f-8a55-c738ceca7cc8-crio-socket\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:20.280935 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.280792    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:20.280935 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:20.280888    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls podName:65fa786c-889c-4b0f-8a55-c738ceca7cc8 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:20.780863618 +0000 UTC m=+100.399137789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d5958" (UID: "65fa786c-889c-4b0f-8a55-c738ceca7cc8") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:20.281131 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:20.280941    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-rbac-proxy-cm podName:65fa786c-889c-4b0f-8a55-c738ceca7cc8 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:20.780924652 +0000 UTC m=+100.399198799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d5958" (UID: "65fa786c-889c-4b0f-8a55-c738ceca7cc8") : configmap "kube-rbac-proxy" not found
Sep 11 16:31:20.281131 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.281106    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/65fa786c-889c-4b0f-8a55-c738ceca7cc8-data-volume\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:20.292271 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.292240    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmblw\" (UniqueName: \"kubernetes.io/projected/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-api-access-nmblw\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:20.785169 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.785127    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:20.785387 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:20.785219    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:20.785387 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:20.785283    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:31:20.785387 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:20.785304    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:20.785387 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:20.785333    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-rbac-proxy-cm podName:65fa786c-889c-4b0f-8a55-c738ceca7cc8 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:21.78531945 +0000 UTC m=+101.403593611 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d5958" (UID: "65fa786c-889c-4b0f-8a55-c738ceca7cc8") : configmap "kube-rbac-proxy" not found
Sep 11 16:31:20.785387 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:20.785366    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls podName:65fa786c-889c-4b0f-8a55-c738ceca7cc8 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:21.785348705 +0000 UTC m=+101.403622870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d5958" (UID: "65fa786c-889c-4b0f-8a55-c738ceca7cc8") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:21.793095 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:21.793056    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:21.793533 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:21.793110    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:21.793533 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:21.793215    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:31:21.793533 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:21.793240    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:21.793533 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:21.793282    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls podName:65fa786c-889c-4b0f-8a55-c738ceca7cc8 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:23.793269601 +0000 UTC m=+103.411543749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d5958" (UID: "65fa786c-889c-4b0f-8a55-c738ceca7cc8") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:21.793533 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:21.793294    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-rbac-proxy-cm podName:65fa786c-889c-4b0f-8a55-c738ceca7cc8 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:23.793288382 +0000 UTC m=+103.411562530 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d5958" (UID: "65fa786c-889c-4b0f-8a55-c738ceca7cc8") : configmap "kube-rbac-proxy" not found
Sep 11 16:31:22.244263 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:22.244186    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ptdtw_fac41999-310c-4cbe-aa82-073191607d1d/dns-node-resolver/0.log"
Sep 11 16:31:23.040778 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:23.040746    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f9nlm_5da99747-5918-4454-b404-349af508e59b/node-ca/0.log"
Sep 11 16:31:23.309372 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:23.309285    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2wxbp"
Sep 11 16:31:23.810796 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:23.810765    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:23.810973 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:23.810869    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:23.810973 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:23.810931    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:23.810973 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:23.810946    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:31:23.811080 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:23.811001    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-rbac-proxy-cm podName:65fa786c-889c-4b0f-8a55-c738ceca7cc8 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:27.810986381 +0000 UTC m=+107.429260548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d5958" (UID: "65fa786c-889c-4b0f-8a55-c738ceca7cc8") : configmap "kube-rbac-proxy" not found
Sep 11 16:31:23.811080 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:23.811016    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls podName:65fa786c-889c-4b0f-8a55-c738ceca7cc8 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:27.811010131 +0000 UTC m=+107.429284279 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d5958" (UID: "65fa786c-889c-4b0f-8a55-c738ceca7cc8") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:23.845627 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:23.845584    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jmfl8_7830a971-ff74-4997-aa28-471e1d0686a3/serve-healthcheck-canary/0.log"
Sep 11 16:31:27.844440 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:27.844398    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:27.844947 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:27.844506    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:27.844947 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:27.844553    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:27.844947 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:27.844582    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:31:27.844947 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:27.844636    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls podName:65fa786c-889c-4b0f-8a55-c738ceca7cc8 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:35.844620962 +0000 UTC m=+115.462895122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d5958" (UID: "65fa786c-889c-4b0f-8a55-c738ceca7cc8") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:27.844947 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:27.844652    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-rbac-proxy-cm podName:65fa786c-889c-4b0f-8a55-c738ceca7cc8 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:35.844645334 +0000 UTC m=+115.462919482 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-d5958" (UID: "65fa786c-889c-4b0f-8a55-c738ceca7cc8") : configmap "kube-rbac-proxy" not found
Sep 11 16:31:35.909223 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:35.909176    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:35.909647 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:35.909325    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:35.909647 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:35.909334    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:35.909647 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:31:35.909417    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls podName:65fa786c-889c-4b0f-8a55-c738ceca7cc8 nodeName:}" failed. No retries permitted until 2026-09-11 16:31:51.909398685 +0000 UTC m=+131.527672847 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-d5958" (UID: "65fa786c-889c-4b0f-8a55-c738ceca7cc8") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:31:35.909959 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:35.909942    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/65fa786c-889c-4b0f-8a55-c738ceca7cc8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:45.607600 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:45.607553    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4" podUID="cfe52c2d-431a-4789-93cc-0ccd03dbf891" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 11 16:31:50.727055 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:50.726999    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs\") pod \"network-metrics-daemon-tv8zk\" (UID: \"9868a0a5-34ec-40ba-8178-c0a1bd64a921\") " pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:31:50.729589 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:50.729555    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9868a0a5-34ec-40ba-8178-c0a1bd64a921-metrics-certs\") pod \"network-metrics-daemon-tv8zk\" (UID: \"9868a0a5-34ec-40ba-8178-c0a1bd64a921\") " pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:31:50.760689 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:50.760655    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5vm65\""
Sep 11 16:31:50.768224 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:50.768190    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tv8zk"
Sep 11 16:31:51.044224 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:51.044189    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tv8zk"]
Sep 11 16:31:51.047092 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:31:51.047055    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9868a0a5_34ec_40ba_8178_c0a1bd64a921.slice/crio-dec99548f59383364e00b1306e34f897f160b307327c922c2a427e2f9bcd0d3b WatchSource:0}: Error finding container dec99548f59383364e00b1306e34f897f160b307327c922c2a427e2f9bcd0d3b: Status 404 returned error can't find the container with id dec99548f59383364e00b1306e34f897f160b307327c922c2a427e2f9bcd0d3b
Sep 11 16:31:51.482919 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:51.482834    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tv8zk" event={"ID":"9868a0a5-34ec-40ba-8178-c0a1bd64a921","Type":"ContainerStarted","Data":"dec99548f59383364e00b1306e34f897f160b307327c922c2a427e2f9bcd0d3b"}
Sep 11 16:31:51.936878 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:51.936836    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:51.939114 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:51.939094    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/65fa786c-889c-4b0f-8a55-c738ceca7cc8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d5958\" (UID: \"65fa786c-889c-4b0f-8a55-c738ceca7cc8\") " pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:52.201477 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:52.201406    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vrmx6\""
Sep 11 16:31:52.209598 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:52.209563    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d5958"
Sep 11 16:31:52.650159 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:52.650128    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d5958"]
Sep 11 16:31:52.653989 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:31:52.653963    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65fa786c_889c_4b0f_8a55_c738ceca7cc8.slice/crio-65353cb124ea01c560fbecbcd8ef9b363e0556191d5d2e2dbc06613fb836fa91 WatchSource:0}: Error finding container 65353cb124ea01c560fbecbcd8ef9b363e0556191d5d2e2dbc06613fb836fa91: Status 404 returned error can't find the container with id 65353cb124ea01c560fbecbcd8ef9b363e0556191d5d2e2dbc06613fb836fa91
Sep 11 16:31:53.491638 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:53.491586    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tv8zk" event={"ID":"9868a0a5-34ec-40ba-8178-c0a1bd64a921","Type":"ContainerStarted","Data":"ea6dc3aa6993fc79824865cd6d4bc3d53897440e86b64e3cb9f011ec407bc3c1"}
Sep 11 16:31:53.492073 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:53.491692    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tv8zk" event={"ID":"9868a0a5-34ec-40ba-8178-c0a1bd64a921","Type":"ContainerStarted","Data":"0a688770c2652168e02643887e9a5aacac30bf8c90cd963fa654b9f20afb5ab1"}
Sep 11 16:31:53.493430 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:53.493403    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d5958" event={"ID":"65fa786c-889c-4b0f-8a55-c738ceca7cc8","Type":"ContainerStarted","Data":"f07831ba74486dd4accb60dad8c99baba4e578c305d90e3b59a71183679f157e"}
Sep 11 16:31:53.493544 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:53.493454    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d5958" event={"ID":"65fa786c-889c-4b0f-8a55-c738ceca7cc8","Type":"ContainerStarted","Data":"e7406d9d156005c4744c5467de6f096d39163efbea1ef0ab54a946e155f3c8c1"}
Sep 11 16:31:53.493544 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:53.493479    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d5958" event={"ID":"65fa786c-889c-4b0f-8a55-c738ceca7cc8","Type":"ContainerStarted","Data":"65353cb124ea01c560fbecbcd8ef9b363e0556191d5d2e2dbc06613fb836fa91"}
Sep 11 16:31:53.513071 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:53.512964    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tv8zk" podStartSLOduration=130.132207301 podStartE2EDuration="2m11.512944927s" totalImagesPullingTime="1.380737626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:31:53.512119745 +0000 UTC m=+133.130393915" watchObservedRunningTime="2026-09-11 16:31:53.512944927 +0000 UTC m=+133.131219097"
Sep 11 16:31:55.502952 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:55.502914    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d5958" event={"ID":"65fa786c-889c-4b0f-8a55-c738ceca7cc8","Type":"ContainerStarted","Data":"13455d964cb7211f6d665199be356771596a106a30e294b6f82c0ac9297a3fdc"}
Sep 11 16:31:55.547584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:55.547529    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-d5958" podStartSLOduration=33.516045477 podStartE2EDuration="35.547511926s" totalImagesPullingTime="2.031466449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:31:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:31:55.546940463 +0000 UTC m=+135.165214634" watchObservedRunningTime="2026-09-11 16:31:55.547511926 +0000 UTC m=+135.165786096"
Sep 11 16:31:55.607214 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:55.607174    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4" podUID="cfe52c2d-431a-4789-93cc-0ccd03dbf891" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 11 16:31:58.421580 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.421545    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5gz7w"]
Sep 11 16:31:58.424816 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.424796    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.428416 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.428393    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 16:31:58.428533 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.428402    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 16:31:58.428992 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.428973    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 16:31:58.429512 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.429485    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 16:31:58.429636 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.429528    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-775mx\""
Sep 11 16:31:58.429766 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.429750    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 16:31:58.430388 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.430367    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 16:31:58.481034 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.480998    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/317842b7-0911-4518-91aa-9f7dcc0ae801-root\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.481034 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.481035    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/317842b7-0911-4518-91aa-9f7dcc0ae801-node-exporter-textfile\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.481262 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.481056    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/317842b7-0911-4518-91aa-9f7dcc0ae801-node-exporter-tls\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.481262 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.481161    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/317842b7-0911-4518-91aa-9f7dcc0ae801-node-exporter-wtmp\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.481262 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.481210    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/317842b7-0911-4518-91aa-9f7dcc0ae801-metrics-client-ca\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.481262 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.481225    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgpbf\" (UniqueName: \"kubernetes.io/projected/317842b7-0911-4518-91aa-9f7dcc0ae801-kube-api-access-dgpbf\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.481262 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.481243    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/317842b7-0911-4518-91aa-9f7dcc0ae801-sys\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.481429 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.481274    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/317842b7-0911-4518-91aa-9f7dcc0ae801-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.481429 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.481303    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/317842b7-0911-4518-91aa-9f7dcc0ae801-node-exporter-accelerators-collector-config\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.581779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.581719    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/317842b7-0911-4518-91aa-9f7dcc0ae801-sys\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.581779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.581778    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/317842b7-0911-4518-91aa-9f7dcc0ae801-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.582017 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.581835    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/317842b7-0911-4518-91aa-9f7dcc0ae801-sys\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.582017 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.581897    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/317842b7-0911-4518-91aa-9f7dcc0ae801-node-exporter-accelerators-collector-config\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.582017 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.581964    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/317842b7-0911-4518-91aa-9f7dcc0ae801-root\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.582017 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.581998    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/317842b7-0911-4518-91aa-9f7dcc0ae801-node-exporter-textfile\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.582017 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.582018    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/317842b7-0911-4518-91aa-9f7dcc0ae801-root\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.582194 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.582023    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/317842b7-0911-4518-91aa-9f7dcc0ae801-node-exporter-tls\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.582194 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.582111    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/317842b7-0911-4518-91aa-9f7dcc0ae801-node-exporter-wtmp\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.582289 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.582254    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/317842b7-0911-4518-91aa-9f7dcc0ae801-node-exporter-wtmp\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.582289 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.582268    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/317842b7-0911-4518-91aa-9f7dcc0ae801-node-exporter-textfile\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.582407 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.582301    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/317842b7-0911-4518-91aa-9f7dcc0ae801-metrics-client-ca\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.582407 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.582340    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgpbf\" (UniqueName: \"kubernetes.io/projected/317842b7-0911-4518-91aa-9f7dcc0ae801-kube-api-access-dgpbf\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.582508 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.582466    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/317842b7-0911-4518-91aa-9f7dcc0ae801-node-exporter-accelerators-collector-config\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.582859 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.582834    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/317842b7-0911-4518-91aa-9f7dcc0ae801-metrics-client-ca\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.584241 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.584225    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/317842b7-0911-4518-91aa-9f7dcc0ae801-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.584333 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.584313    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/317842b7-0911-4518-91aa-9f7dcc0ae801-node-exporter-tls\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.598024 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.597994    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgpbf\" (UniqueName: \"kubernetes.io/projected/317842b7-0911-4518-91aa-9f7dcc0ae801-kube-api-access-dgpbf\") pod \"node-exporter-5gz7w\" (UID: \"317842b7-0911-4518-91aa-9f7dcc0ae801\") " pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.734149 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:58.734064    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5gz7w"
Sep 11 16:31:58.745404 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:31:58.745377    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317842b7_0911_4518_91aa_9f7dcc0ae801.slice/crio-505656f9f9793c737a92fa580661fb7b709ba7c1bb2df54bd69248810dd15a54 WatchSource:0}: Error finding container 505656f9f9793c737a92fa580661fb7b709ba7c1bb2df54bd69248810dd15a54: Status 404 returned error can't find the container with id 505656f9f9793c737a92fa580661fb7b709ba7c1bb2df54bd69248810dd15a54
Sep 11 16:31:59.522518 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:31:59.522477    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5gz7w" event={"ID":"317842b7-0911-4518-91aa-9f7dcc0ae801","Type":"ContainerStarted","Data":"505656f9f9793c737a92fa580661fb7b709ba7c1bb2df54bd69248810dd15a54"}
Sep 11 16:32:00.528177 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:00.528137    2557 generic.go:356] "Generic (PLEG): container finished" podID="317842b7-0911-4518-91aa-9f7dcc0ae801" containerID="cc630140b0a82729305d590f83e5a8139bec085338a808ddaf4b5a14cd9e1130" exitCode=0
Sep 11 16:32:00.528680 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:00.528198    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5gz7w" event={"ID":"317842b7-0911-4518-91aa-9f7dcc0ae801","Type":"ContainerDied","Data":"cc630140b0a82729305d590f83e5a8139bec085338a808ddaf4b5a14cd9e1130"}
Sep 11 16:32:01.533673 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:01.533636    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5gz7w" event={"ID":"317842b7-0911-4518-91aa-9f7dcc0ae801","Type":"ContainerStarted","Data":"48eeae2ed484b992ee22cf3d6bd2545d8cf644add27418ff900934041bfb0eca"}
Sep 11 16:32:01.534036 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:01.533694    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5gz7w" event={"ID":"317842b7-0911-4518-91aa-9f7dcc0ae801","Type":"ContainerStarted","Data":"41a7b4c1c94d71faa84815c3e8aa9b8a4b255f2504a80b39246c8f3f14bba43a"}
Sep 11 16:32:01.632978 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:01.632924    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5gz7w" podStartSLOduration=2.504208354 podStartE2EDuration="3.632905611s" totalImagesPullingTime="1.066727176s" totalInitContainerRuntime="61.970081ms" isStatefulPod=true podCreationTimestamp="2026-09-11 16:31:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:32:01.632637838 +0000 UTC m=+141.250912008" watchObservedRunningTime="2026-09-11 16:32:01.632905611 +0000 UTC m=+141.251179781"
Sep 11 16:32:05.607596 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:05.607557    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4" podUID="cfe52c2d-431a-4789-93cc-0ccd03dbf891" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 11 16:32:05.607982 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:05.607651    2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4"
Sep 11 16:32:05.608227 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:05.608198    2557 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"31cc8cc41444313762e3c655e9ed701a7df5717b3dc958349675c5fa198cd815"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 11 16:32:05.608260 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:05.608247    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4" podUID="cfe52c2d-431a-4789-93cc-0ccd03dbf891" containerName="service-proxy" containerID="cri-o://31cc8cc41444313762e3c655e9ed701a7df5717b3dc958349675c5fa198cd815" gracePeriod=30
Sep 11 16:32:06.551665 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:06.551631    2557 generic.go:356] "Generic (PLEG): container finished" podID="cfe52c2d-431a-4789-93cc-0ccd03dbf891" containerID="31cc8cc41444313762e3c655e9ed701a7df5717b3dc958349675c5fa198cd815" exitCode=2
Sep 11 16:32:06.551665 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:06.551674    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4" event={"ID":"cfe52c2d-431a-4789-93cc-0ccd03dbf891","Type":"ContainerDied","Data":"31cc8cc41444313762e3c655e9ed701a7df5717b3dc958349675c5fa198cd815"}
Sep 11 16:32:06.551934 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:06.551704    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b84c4844b-x7xr4" event={"ID":"cfe52c2d-431a-4789-93cc-0ccd03dbf891","Type":"ContainerStarted","Data":"f25b8f87a1b8510277037be0a3a7f50cf96a7c5b1b313009a933513c8c3ba52d"}
Sep 11 16:32:07.493564 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.493529    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"]
Sep 11 16:32:07.493994 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:32:07.493775    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2" podUID="75b74905-0fdb-448d-b158-ec421b28c721"
Sep 11 16:32:07.554442 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.554411    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:32:07.560780 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.560757    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:32:07.653602 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.653564    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75b74905-0fdb-448d-b158-ec421b28c721-trusted-ca\") pod \"75b74905-0fdb-448d-b158-ec421b28c721\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") "
Sep 11 16:32:07.653808 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.653647    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75b74905-0fdb-448d-b158-ec421b28c721-image-registry-private-configuration\") pod \"75b74905-0fdb-448d-b158-ec421b28c721\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") "
Sep 11 16:32:07.653808 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.653688    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t47vk\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-kube-api-access-t47vk\") pod \"75b74905-0fdb-448d-b158-ec421b28c721\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") "
Sep 11 16:32:07.653808 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.653708    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75b74905-0fdb-448d-b158-ec421b28c721-registry-certificates\") pod \"75b74905-0fdb-448d-b158-ec421b28c721\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") "
Sep 11 16:32:07.653808 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.653734    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-bound-sa-token\") pod \"75b74905-0fdb-448d-b158-ec421b28c721\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") "
Sep 11 16:32:07.654004 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.653872    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75b74905-0fdb-448d-b158-ec421b28c721-installation-pull-secrets\") pod \"75b74905-0fdb-448d-b158-ec421b28c721\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") "
Sep 11 16:32:07.654004 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.653930    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75b74905-0fdb-448d-b158-ec421b28c721-ca-trust-extracted\") pod \"75b74905-0fdb-448d-b158-ec421b28c721\" (UID: \"75b74905-0fdb-448d-b158-ec421b28c721\") "
Sep 11 16:32:07.654101 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.654051    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75b74905-0fdb-448d-b158-ec421b28c721-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "75b74905-0fdb-448d-b158-ec421b28c721" (UID: "75b74905-0fdb-448d-b158-ec421b28c721"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:32:07.654153 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.654101    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75b74905-0fdb-448d-b158-ec421b28c721-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "75b74905-0fdb-448d-b158-ec421b28c721" (UID: "75b74905-0fdb-448d-b158-ec421b28c721"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:32:07.654223 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.654199    2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/75b74905-0fdb-448d-b158-ec421b28c721-registry-certificates\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:32:07.654281 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.654225    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/75b74905-0fdb-448d-b158-ec421b28c721-trusted-ca\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:32:07.654333 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.654286    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75b74905-0fdb-448d-b158-ec421b28c721-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "75b74905-0fdb-448d-b158-ec421b28c721" (UID: "75b74905-0fdb-448d-b158-ec421b28c721"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:32:07.656159 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.656127    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-kube-api-access-t47vk" (OuterVolumeSpecName: "kube-api-access-t47vk") pod "75b74905-0fdb-448d-b158-ec421b28c721" (UID: "75b74905-0fdb-448d-b158-ec421b28c721"). InnerVolumeSpecName "kube-api-access-t47vk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:32:07.656263 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.656186    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "75b74905-0fdb-448d-b158-ec421b28c721" (UID: "75b74905-0fdb-448d-b158-ec421b28c721"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:32:07.656338 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.656317    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75b74905-0fdb-448d-b158-ec421b28c721-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "75b74905-0fdb-448d-b158-ec421b28c721" (UID: "75b74905-0fdb-448d-b158-ec421b28c721"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:32:07.656387 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.656360    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75b74905-0fdb-448d-b158-ec421b28c721-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "75b74905-0fdb-448d-b158-ec421b28c721" (UID: "75b74905-0fdb-448d-b158-ec421b28c721"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:32:07.754875 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.754781    2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/75b74905-0fdb-448d-b158-ec421b28c721-image-registry-private-configuration\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:32:07.754875 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.754822    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t47vk\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-kube-api-access-t47vk\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:32:07.754875 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.754836    2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-bound-sa-token\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:32:07.754875 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.754847    2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/75b74905-0fdb-448d-b158-ec421b28c721-installation-pull-secrets\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:32:07.754875 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:07.754856    2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/75b74905-0fdb-448d-b158-ec421b28c721-ca-trust-extracted\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:32:08.557261 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.557218    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"
Sep 11 16:32:08.597795 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.597762    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"]
Sep 11 16:32:08.606616 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.606586    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57b6d6dfc9-2kkc2"]
Sep 11 16:32:08.661336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.661299    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/75b74905-0fdb-448d-b158-ec421b28c721-registry-tls\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:32:08.795888 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.795855    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f4d675f9b-g59f8"]
Sep 11 16:32:08.799156 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.799137    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.804280 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.804253    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 16:32:08.804428 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.804294    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 16:32:08.804992 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.804961    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 16:32:08.805148 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.805030    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 16:32:08.805148 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.805047    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 16:32:08.805395 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.805381    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-p2f27\""
Sep 11 16:32:08.805542 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.805523    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 16:32:08.806444 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.806431    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 16:32:08.813444 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.813397    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 16:32:08.822981 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.822956    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4d675f9b-g59f8"]
Sep 11 16:32:08.862964 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.862931    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-trusted-ca-bundle\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.863138 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.862979    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-console-config\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.863138 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.863042    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-service-ca\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.863138 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.863076    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb14b223-9277-42e0-a419-1e2875ab8237-console-serving-cert\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.863138 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.863095    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-oauth-serving-cert\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.863271 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.863154    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb14b223-9277-42e0-a419-1e2875ab8237-console-oauth-config\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.863271 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.863181    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tckh\" (UniqueName: \"kubernetes.io/projected/eb14b223-9277-42e0-a419-1e2875ab8237-kube-api-access-7tckh\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.944741 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.944707    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75b74905-0fdb-448d-b158-ec421b28c721" path="/var/lib/kubelet/pods/75b74905-0fdb-448d-b158-ec421b28c721/volumes"
Sep 11 16:32:08.964010 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.963970    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-console-config\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.964094 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.964019    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-service-ca\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.964094 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.964039    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb14b223-9277-42e0-a419-1e2875ab8237-console-serving-cert\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.964094 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.964063    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-oauth-serving-cert\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.964245 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.964221    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb14b223-9277-42e0-a419-1e2875ab8237-console-oauth-config\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.964295 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.964276    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tckh\" (UniqueName: \"kubernetes.io/projected/eb14b223-9277-42e0-a419-1e2875ab8237-kube-api-access-7tckh\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.964365 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.964337    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-trusted-ca-bundle\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.964760 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.964734    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-console-config\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.964894 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.964829    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-oauth-serving-cert\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.964894 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.964834    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-service-ca\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.965216 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.965193    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-trusted-ca-bundle\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.966570 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.966553    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb14b223-9277-42e0-a419-1e2875ab8237-console-serving-cert\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.966728 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.966711    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb14b223-9277-42e0-a419-1e2875ab8237-console-oauth-config\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:08.977128 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:08.977103    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tckh\" (UniqueName: \"kubernetes.io/projected/eb14b223-9277-42e0-a419-1e2875ab8237-kube-api-access-7tckh\") pod \"console-6f4d675f9b-g59f8\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") " pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:09.108573 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:09.108492    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:09.393868 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:09.393790    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4d675f9b-g59f8"]
Sep 11 16:32:09.396812 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:32:09.396786    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb14b223_9277_42e0_a419_1e2875ab8237.slice/crio-c61d38a49fd330a746f71e98d0a27ec4f72db90967c4c6c3918fc86c2549814c WatchSource:0}: Error finding container c61d38a49fd330a746f71e98d0a27ec4f72db90967c4c6c3918fc86c2549814c: Status 404 returned error can't find the container with id c61d38a49fd330a746f71e98d0a27ec4f72db90967c4c6c3918fc86c2549814c
Sep 11 16:32:09.561801 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:09.561763    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4d675f9b-g59f8" event={"ID":"eb14b223-9277-42e0-a419-1e2875ab8237","Type":"ContainerStarted","Data":"c61d38a49fd330a746f71e98d0a27ec4f72db90967c4c6c3918fc86c2549814c"}
Sep 11 16:32:12.573694 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:12.573651    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4d675f9b-g59f8" event={"ID":"eb14b223-9277-42e0-a419-1e2875ab8237","Type":"ContainerStarted","Data":"2edaf055605f8c2147a87edb6e4e47e8345cf61f70423e4534c00540775cecec"}
Sep 11 16:32:12.601010 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:12.600940    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f4d675f9b-g59f8" podStartSLOduration=1.998274275 podStartE2EDuration="4.600923187s" totalImagesPullingTime="2.602648912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:32:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:32:12.600076763 +0000 UTC m=+152.218350938" watchObservedRunningTime="2026-09-11 16:32:12.600923187 +0000 UTC m=+152.219197357"
Sep 11 16:32:18.312557 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:32:18.312506    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tvq8f" podUID="6cad760a-cbe5-4fb3-9229-ee77198fab07"
Sep 11 16:32:18.592635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:18.592539    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:32:19.109083 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:19.109050    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:19.109246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:19.109124    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:19.115275 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:19.115251    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:19.599457 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:19.599428    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:32:23.174919 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:23.174879    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:32:23.177230 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:23.177207    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6cad760a-cbe5-4fb3-9229-ee77198fab07-metrics-tls\") pod \"dns-default-tvq8f\" (UID: \"6cad760a-cbe5-4fb3-9229-ee77198fab07\") " pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:32:23.395839 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:23.395807    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-55n2r\""
Sep 11 16:32:23.403337 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:23.403312    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:32:23.685305 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:23.685276    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tvq8f"]
Sep 11 16:32:23.687473 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:32:23.687445    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cad760a_cbe5_4fb3_9229_ee77198fab07.slice/crio-87b1122b2d92a8faf487af82402a1f5bb24e7f431b028969335cdd90ec066a85 WatchSource:0}: Error finding container 87b1122b2d92a8faf487af82402a1f5bb24e7f431b028969335cdd90ec066a85: Status 404 returned error can't find the container with id 87b1122b2d92a8faf487af82402a1f5bb24e7f431b028969335cdd90ec066a85
Sep 11 16:32:24.614691 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:24.614643    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tvq8f" event={"ID":"6cad760a-cbe5-4fb3-9229-ee77198fab07","Type":"ContainerStarted","Data":"87b1122b2d92a8faf487af82402a1f5bb24e7f431b028969335cdd90ec066a85"}
Sep 11 16:32:25.620055 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:25.620013    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tvq8f" event={"ID":"6cad760a-cbe5-4fb3-9229-ee77198fab07","Type":"ContainerStarted","Data":"c664816555fe97bb9cf0c13a9201791ddfb1150a314c8561a2c16531ccb759cb"}
Sep 11 16:32:25.620458 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:25.620067    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tvq8f" event={"ID":"6cad760a-cbe5-4fb3-9229-ee77198fab07","Type":"ContainerStarted","Data":"7c74039d92073ab6246d7a4adf8fd0943ca17c9c0fcfbf59cf3b4a552fa56dca"}
Sep 11 16:32:25.620458 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:25.620166    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:32:25.651838 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:25.651782    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tvq8f" podStartSLOduration=128.922469046 podStartE2EDuration="2m10.651764431s" totalImagesPullingTime="1.729295385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:30:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:32:25.651569511 +0000 UTC m=+165.269843685" watchObservedRunningTime="2026-09-11 16:32:25.651764431 +0000 UTC m=+165.270038638"
Sep 11 16:32:26.532437 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:26.532405    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tvq8f_6cad760a-cbe5-4fb3-9229-ee77198fab07/dns/0.log"
Sep 11 16:32:26.548685 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:26.548655    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tvq8f_6cad760a-cbe5-4fb3-9229-ee77198fab07/kube-rbac-proxy/0.log"
Sep 11 16:32:27.024339 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:27.024309    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ptdtw_fac41999-310c-4cbe-aa82-073191607d1d/dns-node-resolver/0.log"
Sep 11 16:32:35.626719 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:32:35.626632    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tvq8f"
Sep 11 16:33:26.951098 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:26.951065    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f4d675f9b-g59f8"]
Sep 11 16:33:51.969893 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:51.969826    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f4d675f9b-g59f8" podUID="eb14b223-9277-42e0-a419-1e2875ab8237" containerName="console" containerID="cri-o://2edaf055605f8c2147a87edb6e4e47e8345cf61f70423e4534c00540775cecec" gracePeriod=15
Sep 11 16:33:52.211719 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.211694    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:33:52.314992 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.314954    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tckh\" (UniqueName: \"kubernetes.io/projected/eb14b223-9277-42e0-a419-1e2875ab8237-kube-api-access-7tckh\") pod \"eb14b223-9277-42e0-a419-1e2875ab8237\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") "
Sep 11 16:33:52.315164 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.315023    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-trusted-ca-bundle\") pod \"eb14b223-9277-42e0-a419-1e2875ab8237\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") "
Sep 11 16:33:52.315164 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.315053    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-service-ca\") pod \"eb14b223-9277-42e0-a419-1e2875ab8237\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") "
Sep 11 16:33:52.315164 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.315145    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb14b223-9277-42e0-a419-1e2875ab8237-console-serving-cert\") pod \"eb14b223-9277-42e0-a419-1e2875ab8237\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") "
Sep 11 16:33:52.315302 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.315176    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb14b223-9277-42e0-a419-1e2875ab8237-console-oauth-config\") pod \"eb14b223-9277-42e0-a419-1e2875ab8237\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") "
Sep 11 16:33:52.315302 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.315210    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-oauth-serving-cert\") pod \"eb14b223-9277-42e0-a419-1e2875ab8237\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") "
Sep 11 16:33:52.315302 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.315251    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-console-config\") pod \"eb14b223-9277-42e0-a419-1e2875ab8237\" (UID: \"eb14b223-9277-42e0-a419-1e2875ab8237\") "
Sep 11 16:33:52.315567 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.315431    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-service-ca" (OuterVolumeSpecName: "service-ca") pod "eb14b223-9277-42e0-a419-1e2875ab8237" (UID: "eb14b223-9277-42e0-a419-1e2875ab8237"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:33:52.315567 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.315501    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "eb14b223-9277-42e0-a419-1e2875ab8237" (UID: "eb14b223-9277-42e0-a419-1e2875ab8237"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:33:52.315793 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.315718    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eb14b223-9277-42e0-a419-1e2875ab8237" (UID: "eb14b223-9277-42e0-a419-1e2875ab8237"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:33:52.315793 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.315748    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-console-config" (OuterVolumeSpecName: "console-config") pod "eb14b223-9277-42e0-a419-1e2875ab8237" (UID: "eb14b223-9277-42e0-a419-1e2875ab8237"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:33:52.317415 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.317386    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb14b223-9277-42e0-a419-1e2875ab8237-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eb14b223-9277-42e0-a419-1e2875ab8237" (UID: "eb14b223-9277-42e0-a419-1e2875ab8237"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:33:52.317477 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.317446    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb14b223-9277-42e0-a419-1e2875ab8237-kube-api-access-7tckh" (OuterVolumeSpecName: "kube-api-access-7tckh") pod "eb14b223-9277-42e0-a419-1e2875ab8237" (UID: "eb14b223-9277-42e0-a419-1e2875ab8237"). InnerVolumeSpecName "kube-api-access-7tckh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:33:52.317477 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.317448    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb14b223-9277-42e0-a419-1e2875ab8237-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eb14b223-9277-42e0-a419-1e2875ab8237" (UID: "eb14b223-9277-42e0-a419-1e2875ab8237"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:33:52.415822 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.415774    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-service-ca\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:33:52.415822 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.415804    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eb14b223-9277-42e0-a419-1e2875ab8237-console-serving-cert\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:33:52.415822 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.415815    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eb14b223-9277-42e0-a419-1e2875ab8237-console-oauth-config\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:33:52.415822 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.415824    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-oauth-serving-cert\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:33:52.415822 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.415832    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-console-config\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:33:52.416125 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.415841    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tckh\" (UniqueName: \"kubernetes.io/projected/eb14b223-9277-42e0-a419-1e2875ab8237-kube-api-access-7tckh\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:33:52.416125 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.415849    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eb14b223-9277-42e0-a419-1e2875ab8237-trusted-ca-bundle\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:33:52.911567 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.911527    2557 generic.go:356] "Generic (PLEG): container finished" podID="eb14b223-9277-42e0-a419-1e2875ab8237" containerID="2edaf055605f8c2147a87edb6e4e47e8345cf61f70423e4534c00540775cecec" exitCode=0
Sep 11 16:33:52.911743 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.911573    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4d675f9b-g59f8"
Sep 11 16:33:52.911743 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.911596    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4d675f9b-g59f8" event={"ID":"eb14b223-9277-42e0-a419-1e2875ab8237","Type":"ContainerDied","Data":"2edaf055605f8c2147a87edb6e4e47e8345cf61f70423e4534c00540775cecec"}
Sep 11 16:33:52.911743 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.911657    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4d675f9b-g59f8" event={"ID":"eb14b223-9277-42e0-a419-1e2875ab8237","Type":"ContainerDied","Data":"c61d38a49fd330a746f71e98d0a27ec4f72db90967c4c6c3918fc86c2549814c"}
Sep 11 16:33:52.911743 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.911678    2557 scope.go:117] "RemoveContainer" containerID="2edaf055605f8c2147a87edb6e4e47e8345cf61f70423e4534c00540775cecec"
Sep 11 16:33:52.920203 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.920181    2557 scope.go:117] "RemoveContainer" containerID="2edaf055605f8c2147a87edb6e4e47e8345cf61f70423e4534c00540775cecec"
Sep 11 16:33:52.920495 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:33:52.920473    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2edaf055605f8c2147a87edb6e4e47e8345cf61f70423e4534c00540775cecec\": container with ID starting with 2edaf055605f8c2147a87edb6e4e47e8345cf61f70423e4534c00540775cecec not found: ID does not exist" containerID="2edaf055605f8c2147a87edb6e4e47e8345cf61f70423e4534c00540775cecec"
Sep 11 16:33:52.920552 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.920504    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2edaf055605f8c2147a87edb6e4e47e8345cf61f70423e4534c00540775cecec"} err="failed to get container status \"2edaf055605f8c2147a87edb6e4e47e8345cf61f70423e4534c00540775cecec\": rpc error: code = NotFound desc = could not find container \"2edaf055605f8c2147a87edb6e4e47e8345cf61f70423e4534c00540775cecec\": container with ID starting with 2edaf055605f8c2147a87edb6e4e47e8345cf61f70423e4534c00540775cecec not found: ID does not exist"
Sep 11 16:33:52.932749 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.932717    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f4d675f9b-g59f8"]
Sep 11 16:33:52.935697 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.935669    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f4d675f9b-g59f8"]
Sep 11 16:33:52.944074 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:33:52.944041    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb14b223-9277-42e0-a419-1e2875ab8237" path="/var/lib/kubelet/pods/eb14b223-9277-42e0-a419-1e2875ab8237/volumes"
Sep 11 16:34:13.284814 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.284735    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98"]
Sep 11 16:34:13.285180 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.284966    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb14b223-9277-42e0-a419-1e2875ab8237" containerName="console"
Sep 11 16:34:13.285180 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.284977    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb14b223-9277-42e0-a419-1e2875ab8237" containerName="console"
Sep 11 16:34:13.285180 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.285016    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb14b223-9277-42e0-a419-1e2875ab8237" containerName="console"
Sep 11 16:34:13.287950 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.287933    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98"
Sep 11 16:34:13.292034 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.292009    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-77xls\""
Sep 11 16:34:13.292333 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.292318    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 16:34:13.293149 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.293121    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 16:34:13.304155 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.304127    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98"]
Sep 11 16:34:13.371728 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.371690    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f64ed62-0fa4-4a50-b0bc-7bfcbceff617-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98\" (UID: \"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98"
Sep 11 16:34:13.371909 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.371741    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drl2z\" (UniqueName: \"kubernetes.io/projected/4f64ed62-0fa4-4a50-b0bc-7bfcbceff617-kube-api-access-drl2z\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98\" (UID: \"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98"
Sep 11 16:34:13.371909 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.371818    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f64ed62-0fa4-4a50-b0bc-7bfcbceff617-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98\" (UID: \"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98"
Sep 11 16:34:13.472952 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.472911    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f64ed62-0fa4-4a50-b0bc-7bfcbceff617-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98\" (UID: \"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98"
Sep 11 16:34:13.473076 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.472959    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f64ed62-0fa4-4a50-b0bc-7bfcbceff617-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98\" (UID: \"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98"
Sep 11 16:34:13.473076 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.472995    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drl2z\" (UniqueName: \"kubernetes.io/projected/4f64ed62-0fa4-4a50-b0bc-7bfcbceff617-kube-api-access-drl2z\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98\" (UID: \"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98"
Sep 11 16:34:13.473390 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.473365    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f64ed62-0fa4-4a50-b0bc-7bfcbceff617-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98\" (UID: \"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98"
Sep 11 16:34:13.473442 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.473378    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f64ed62-0fa4-4a50-b0bc-7bfcbceff617-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98\" (UID: \"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98"
Sep 11 16:34:13.484357 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.484321    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drl2z\" (UniqueName: \"kubernetes.io/projected/4f64ed62-0fa4-4a50-b0bc-7bfcbceff617-kube-api-access-drl2z\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98\" (UID: \"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98"
Sep 11 16:34:13.596595 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.596496    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98"
Sep 11 16:34:13.883707 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.883628    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98"]
Sep 11 16:34:13.888754 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:34:13.888721    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f64ed62_0fa4_4a50_b0bc_7bfcbceff617.slice/crio-a8f500a62363c2dfd78bd523ac499c08949565a3da5ddf70c30648167a1daf9f WatchSource:0}: Error finding container a8f500a62363c2dfd78bd523ac499c08949565a3da5ddf70c30648167a1daf9f: Status 404 returned error can't find the container with id a8f500a62363c2dfd78bd523ac499c08949565a3da5ddf70c30648167a1daf9f
Sep 11 16:34:13.980202 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:13.980163    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98" event={"ID":"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617","Type":"ContainerStarted","Data":"a8f500a62363c2dfd78bd523ac499c08949565a3da5ddf70c30648167a1daf9f"}
Sep 11 16:34:20.004239 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:20.004199    2557 generic.go:356] "Generic (PLEG): container finished" podID="4f64ed62-0fa4-4a50-b0bc-7bfcbceff617" containerID="2dad6ed19deba6fe45f55da81f3462bc5beda2b2e4ae7c68b48636376a5e5fa5" exitCode=0
Sep 11 16:34:20.004648 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:20.004260    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98" event={"ID":"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617","Type":"ContainerDied","Data":"2dad6ed19deba6fe45f55da81f3462bc5beda2b2e4ae7c68b48636376a5e5fa5"}
Sep 11 16:34:22.014729 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:22.014690    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98" event={"ID":"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617","Type":"ContainerStarted","Data":"0ed6547088cbe77b33b8d706a3c9e520457197c34ea8cae7fcadb020e9c84c45"}
Sep 11 16:34:23.019810 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:23.019772    2557 generic.go:356] "Generic (PLEG): container finished" podID="4f64ed62-0fa4-4a50-b0bc-7bfcbceff617" containerID="0ed6547088cbe77b33b8d706a3c9e520457197c34ea8cae7fcadb020e9c84c45" exitCode=0
Sep 11 16:34:23.020384 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:23.019837    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98" event={"ID":"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617","Type":"ContainerDied","Data":"0ed6547088cbe77b33b8d706a3c9e520457197c34ea8cae7fcadb020e9c84c45"}
Sep 11 16:34:29.044341 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:29.044308    2557 generic.go:356] "Generic (PLEG): container finished" podID="4f64ed62-0fa4-4a50-b0bc-7bfcbceff617" containerID="f165ddf518667fbfdfc949a53a66eaed415130f52132ad6dc6a4a893f7f6c5de" exitCode=0
Sep 11 16:34:29.044748 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:29.044394    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98" event={"ID":"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617","Type":"ContainerDied","Data":"f165ddf518667fbfdfc949a53a66eaed415130f52132ad6dc6a4a893f7f6c5de"}
Sep 11 16:34:30.166920 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:30.166892    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98"
Sep 11 16:34:30.307003 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:30.306909    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drl2z\" (UniqueName: \"kubernetes.io/projected/4f64ed62-0fa4-4a50-b0bc-7bfcbceff617-kube-api-access-drl2z\") pod \"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617\" (UID: \"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617\") "
Sep 11 16:34:30.307003 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:30.306953    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f64ed62-0fa4-4a50-b0bc-7bfcbceff617-bundle\") pod \"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617\" (UID: \"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617\") "
Sep 11 16:34:30.307003 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:30.306970    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f64ed62-0fa4-4a50-b0bc-7bfcbceff617-util\") pod \"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617\" (UID: \"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617\") "
Sep 11 16:34:30.307695 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:30.307668    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f64ed62-0fa4-4a50-b0bc-7bfcbceff617-bundle" (OuterVolumeSpecName: "bundle") pod "4f64ed62-0fa4-4a50-b0bc-7bfcbceff617" (UID: "4f64ed62-0fa4-4a50-b0bc-7bfcbceff617"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:34:30.309237 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:30.309204    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f64ed62-0fa4-4a50-b0bc-7bfcbceff617-kube-api-access-drl2z" (OuterVolumeSpecName: "kube-api-access-drl2z") pod "4f64ed62-0fa4-4a50-b0bc-7bfcbceff617" (UID: "4f64ed62-0fa4-4a50-b0bc-7bfcbceff617"). InnerVolumeSpecName "kube-api-access-drl2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:34:30.311428 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:30.311410    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f64ed62-0fa4-4a50-b0bc-7bfcbceff617-util" (OuterVolumeSpecName: "util") pod "4f64ed62-0fa4-4a50-b0bc-7bfcbceff617" (UID: "4f64ed62-0fa4-4a50-b0bc-7bfcbceff617"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:34:30.407733 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:30.407684    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drl2z\" (UniqueName: \"kubernetes.io/projected/4f64ed62-0fa4-4a50-b0bc-7bfcbceff617-kube-api-access-drl2z\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:34:30.407733 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:30.407730    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4f64ed62-0fa4-4a50-b0bc-7bfcbceff617-bundle\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:34:30.407733 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:30.407739    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4f64ed62-0fa4-4a50-b0bc-7bfcbceff617-util\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:34:31.053550 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:31.053513    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98" event={"ID":"4f64ed62-0fa4-4a50-b0bc-7bfcbceff617","Type":"ContainerDied","Data":"a8f500a62363c2dfd78bd523ac499c08949565a3da5ddf70c30648167a1daf9f"}
Sep 11 16:34:31.053550 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:31.053559    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8f500a62363c2dfd78bd523ac499c08949565a3da5ddf70c30648167a1daf9f"
Sep 11 16:34:31.053819 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:31.053560    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540mzz98"
Sep 11 16:34:40.818404 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:40.818382    2557 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 16:34:41.951426 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:41.951388    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2"]
Sep 11 16:34:41.953692 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:41.951632    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f64ed62-0fa4-4a50-b0bc-7bfcbceff617" containerName="extract"
Sep 11 16:34:41.953692 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:41.951642    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f64ed62-0fa4-4a50-b0bc-7bfcbceff617" containerName="extract"
Sep 11 16:34:41.953692 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:41.951658    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f64ed62-0fa4-4a50-b0bc-7bfcbceff617" containerName="util"
Sep 11 16:34:41.953692 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:41.951663    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f64ed62-0fa4-4a50-b0bc-7bfcbceff617" containerName="util"
Sep 11 16:34:41.953692 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:41.951672    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f64ed62-0fa4-4a50-b0bc-7bfcbceff617" containerName="pull"
Sep 11 16:34:41.953692 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:41.951679    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f64ed62-0fa4-4a50-b0bc-7bfcbceff617" containerName="pull"
Sep 11 16:34:41.953692 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:41.951712    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f64ed62-0fa4-4a50-b0bc-7bfcbceff617" containerName="extract"
Sep 11 16:34:41.954594 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:41.954577    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2"
Sep 11 16:34:41.957919 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:41.957891    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 16:34:41.958050 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:41.958034    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-77xls\""
Sep 11 16:34:41.959319 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:41.959297    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 16:34:41.973948 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:41.973924    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2"]
Sep 11 16:34:41.990888 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:41.990859    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n92rx\" (UniqueName: \"kubernetes.io/projected/779524e9-5197-4c2f-a1ea-da569cfa9ef8-kube-api-access-n92rx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2\" (UID: \"779524e9-5197-4c2f-a1ea-da569cfa9ef8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2"
Sep 11 16:34:41.991077 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:41.990901    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/779524e9-5197-4c2f-a1ea-da569cfa9ef8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2\" (UID: \"779524e9-5197-4c2f-a1ea-da569cfa9ef8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2"
Sep 11 16:34:41.991077 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:41.990922    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/779524e9-5197-4c2f-a1ea-da569cfa9ef8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2\" (UID: \"779524e9-5197-4c2f-a1ea-da569cfa9ef8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2"
Sep 11 16:34:42.091597 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:42.091562    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/779524e9-5197-4c2f-a1ea-da569cfa9ef8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2\" (UID: \"779524e9-5197-4c2f-a1ea-da569cfa9ef8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2"
Sep 11 16:34:42.091597 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:42.091602    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/779524e9-5197-4c2f-a1ea-da569cfa9ef8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2\" (UID: \"779524e9-5197-4c2f-a1ea-da569cfa9ef8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2"
Sep 11 16:34:42.091822 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:42.091678    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n92rx\" (UniqueName: \"kubernetes.io/projected/779524e9-5197-4c2f-a1ea-da569cfa9ef8-kube-api-access-n92rx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2\" (UID: \"779524e9-5197-4c2f-a1ea-da569cfa9ef8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2"
Sep 11 16:34:42.092001 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:42.091981    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/779524e9-5197-4c2f-a1ea-da569cfa9ef8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2\" (UID: \"779524e9-5197-4c2f-a1ea-da569cfa9ef8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2"
Sep 11 16:34:42.092037 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:42.092006    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/779524e9-5197-4c2f-a1ea-da569cfa9ef8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2\" (UID: \"779524e9-5197-4c2f-a1ea-da569cfa9ef8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2"
Sep 11 16:34:42.107941 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:42.107908    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n92rx\" (UniqueName: \"kubernetes.io/projected/779524e9-5197-4c2f-a1ea-da569cfa9ef8-kube-api-access-n92rx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2\" (UID: \"779524e9-5197-4c2f-a1ea-da569cfa9ef8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2"
Sep 11 16:34:42.262871 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:42.262842    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2"
Sep 11 16:34:42.543477 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:42.543437    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2"]
Sep 11 16:34:42.545892 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:34:42.545854    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod779524e9_5197_4c2f_a1ea_da569cfa9ef8.slice/crio-3626da1b4a77e0bca3fb6e55b0fa53994e023dbd230d5a41c4252cd08f9beeba WatchSource:0}: Error finding container 3626da1b4a77e0bca3fb6e55b0fa53994e023dbd230d5a41c4252cd08f9beeba: Status 404 returned error can't find the container with id 3626da1b4a77e0bca3fb6e55b0fa53994e023dbd230d5a41c4252cd08f9beeba
Sep 11 16:34:43.094909 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:43.094873    2557 generic.go:356] "Generic (PLEG): container finished" podID="779524e9-5197-4c2f-a1ea-da569cfa9ef8" containerID="260fa9a80f8c40226254bdd35b69aedfbe7f7acb19901c39898b10ce7773115b" exitCode=0
Sep 11 16:34:43.095309 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:43.094966    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2" event={"ID":"779524e9-5197-4c2f-a1ea-da569cfa9ef8","Type":"ContainerDied","Data":"260fa9a80f8c40226254bdd35b69aedfbe7f7acb19901c39898b10ce7773115b"}
Sep 11 16:34:43.095309 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:43.095015    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2" event={"ID":"779524e9-5197-4c2f-a1ea-da569cfa9ef8","Type":"ContainerStarted","Data":"3626da1b4a77e0bca3fb6e55b0fa53994e023dbd230d5a41c4252cd08f9beeba"}
Sep 11 16:34:43.095929 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:43.095915    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:34:45.103403 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:45.103370    2557 generic.go:356] "Generic (PLEG): container finished" podID="779524e9-5197-4c2f-a1ea-da569cfa9ef8" containerID="5685ac9a7c236f23e0982a958ea3c35b6df6132e29f771dba4f2b3499f1ae6a5" exitCode=0
Sep 11 16:34:45.103806 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:45.103448    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2" event={"ID":"779524e9-5197-4c2f-a1ea-da569cfa9ef8","Type":"ContainerDied","Data":"5685ac9a7c236f23e0982a958ea3c35b6df6132e29f771dba4f2b3499f1ae6a5"}
Sep 11 16:34:46.111469 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:46.111435    2557 generic.go:356] "Generic (PLEG): container finished" podID="779524e9-5197-4c2f-a1ea-da569cfa9ef8" containerID="ce997d5187415614045a62d61c577ccdc0ebbd91c4ea1fdc339bbd152bc26a72" exitCode=0
Sep 11 16:34:46.111872 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:46.111494    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2" event={"ID":"779524e9-5197-4c2f-a1ea-da569cfa9ef8","Type":"ContainerDied","Data":"ce997d5187415614045a62d61c577ccdc0ebbd91c4ea1fdc339bbd152bc26a72"}
Sep 11 16:34:47.234634 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:47.234596    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2"
Sep 11 16:34:47.329137 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:47.329095    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n92rx\" (UniqueName: \"kubernetes.io/projected/779524e9-5197-4c2f-a1ea-da569cfa9ef8-kube-api-access-n92rx\") pod \"779524e9-5197-4c2f-a1ea-da569cfa9ef8\" (UID: \"779524e9-5197-4c2f-a1ea-da569cfa9ef8\") "
Sep 11 16:34:47.329318 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:47.329204    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/779524e9-5197-4c2f-a1ea-da569cfa9ef8-util\") pod \"779524e9-5197-4c2f-a1ea-da569cfa9ef8\" (UID: \"779524e9-5197-4c2f-a1ea-da569cfa9ef8\") "
Sep 11 16:34:47.329318 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:47.329268    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/779524e9-5197-4c2f-a1ea-da569cfa9ef8-bundle\") pod \"779524e9-5197-4c2f-a1ea-da569cfa9ef8\" (UID: \"779524e9-5197-4c2f-a1ea-da569cfa9ef8\") "
Sep 11 16:34:47.329698 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:47.329668    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/779524e9-5197-4c2f-a1ea-da569cfa9ef8-bundle" (OuterVolumeSpecName: "bundle") pod "779524e9-5197-4c2f-a1ea-da569cfa9ef8" (UID: "779524e9-5197-4c2f-a1ea-da569cfa9ef8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:34:47.331241 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:47.331214    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/779524e9-5197-4c2f-a1ea-da569cfa9ef8-kube-api-access-n92rx" (OuterVolumeSpecName: "kube-api-access-n92rx") pod "779524e9-5197-4c2f-a1ea-da569cfa9ef8" (UID: "779524e9-5197-4c2f-a1ea-da569cfa9ef8"). InnerVolumeSpecName "kube-api-access-n92rx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:34:47.334737 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:47.334693    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/779524e9-5197-4c2f-a1ea-da569cfa9ef8-util" (OuterVolumeSpecName: "util") pod "779524e9-5197-4c2f-a1ea-da569cfa9ef8" (UID: "779524e9-5197-4c2f-a1ea-da569cfa9ef8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:34:47.430537 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:47.430454    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/779524e9-5197-4c2f-a1ea-da569cfa9ef8-bundle\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:34:47.430537 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:47.430486    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n92rx\" (UniqueName: \"kubernetes.io/projected/779524e9-5197-4c2f-a1ea-da569cfa9ef8-kube-api-access-n92rx\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:34:47.430537 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:47.430500    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/779524e9-5197-4c2f-a1ea-da569cfa9ef8-util\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:34:48.120882 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:48.120842    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2" event={"ID":"779524e9-5197-4c2f-a1ea-da569cfa9ef8","Type":"ContainerDied","Data":"3626da1b4a77e0bca3fb6e55b0fa53994e023dbd230d5a41c4252cd08f9beeba"}
Sep 11 16:34:48.121062 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:48.120895    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3626da1b4a77e0bca3fb6e55b0fa53994e023dbd230d5a41c4252cd08f9beeba"
Sep 11 16:34:48.121062 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:48.120857    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2c6v2"
Sep 11 16:34:51.747365 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:51.747328    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hsn8q"]
Sep 11 16:34:51.747769 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:51.747565    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="779524e9-5197-4c2f-a1ea-da569cfa9ef8" containerName="extract"
Sep 11 16:34:51.747769 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:51.747576    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="779524e9-5197-4c2f-a1ea-da569cfa9ef8" containerName="extract"
Sep 11 16:34:51.747769 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:51.747592    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="779524e9-5197-4c2f-a1ea-da569cfa9ef8" containerName="pull"
Sep 11 16:34:51.747769 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:51.747597    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="779524e9-5197-4c2f-a1ea-da569cfa9ef8" containerName="pull"
Sep 11 16:34:51.747769 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:51.747618    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="779524e9-5197-4c2f-a1ea-da569cfa9ef8" containerName="util"
Sep 11 16:34:51.747769 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:51.747624    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="779524e9-5197-4c2f-a1ea-da569cfa9ef8" containerName="util"
Sep 11 16:34:51.747769 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:51.747659    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="779524e9-5197-4c2f-a1ea-da569cfa9ef8" containerName="extract"
Sep 11 16:34:51.750523 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:51.750507    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hsn8q"
Sep 11 16:34:51.753248 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:51.753228    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 16:34:51.753359 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:51.753252    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 16:34:51.754347 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:51.754328    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-q7g6f\""
Sep 11 16:34:51.760708 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:51.760684    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkcw8\" (UniqueName: \"kubernetes.io/projected/a4e870ae-f578-480e-9eaa-b942c31883da-kube-api-access-gkcw8\") pod \"cert-manager-55b4d954d5-hsn8q\" (UID: \"a4e870ae-f578-480e-9eaa-b942c31883da\") " pod="cert-manager/cert-manager-55b4d954d5-hsn8q"
Sep 11 16:34:51.760850 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:51.760730    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4e870ae-f578-480e-9eaa-b942c31883da-bound-sa-token\") pod \"cert-manager-55b4d954d5-hsn8q\" (UID: \"a4e870ae-f578-480e-9eaa-b942c31883da\") " pod="cert-manager/cert-manager-55b4d954d5-hsn8q"
Sep 11 16:34:51.761466 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:51.761444    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hsn8q"]
Sep 11 16:34:51.861457 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:51.861421    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkcw8\" (UniqueName: \"kubernetes.io/projected/a4e870ae-f578-480e-9eaa-b942c31883da-kube-api-access-gkcw8\") pod \"cert-manager-55b4d954d5-hsn8q\" (UID: \"a4e870ae-f578-480e-9eaa-b942c31883da\") " pod="cert-manager/cert-manager-55b4d954d5-hsn8q"
Sep 11 16:34:51.861457 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:51.861468    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4e870ae-f578-480e-9eaa-b942c31883da-bound-sa-token\") pod \"cert-manager-55b4d954d5-hsn8q\" (UID: \"a4e870ae-f578-480e-9eaa-b942c31883da\") " pod="cert-manager/cert-manager-55b4d954d5-hsn8q"
Sep 11 16:34:51.872387 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:51.872349    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkcw8\" (UniqueName: \"kubernetes.io/projected/a4e870ae-f578-480e-9eaa-b942c31883da-kube-api-access-gkcw8\") pod \"cert-manager-55b4d954d5-hsn8q\" (UID: \"a4e870ae-f578-480e-9eaa-b942c31883da\") " pod="cert-manager/cert-manager-55b4d954d5-hsn8q"
Sep 11 16:34:51.872387 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:51.872353    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4e870ae-f578-480e-9eaa-b942c31883da-bound-sa-token\") pod \"cert-manager-55b4d954d5-hsn8q\" (UID: \"a4e870ae-f578-480e-9eaa-b942c31883da\") " pod="cert-manager/cert-manager-55b4d954d5-hsn8q"
Sep 11 16:34:52.059561 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:52.059514    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-hsn8q"
Sep 11 16:34:52.338493 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:52.338410    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-hsn8q"]
Sep 11 16:34:52.343953 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:34:52.343923    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4e870ae_f578_480e_9eaa_b942c31883da.slice/crio-b99822c55b45897721bef8405f26bd6636c481acb23f8889d8a01ddd6636acd7 WatchSource:0}: Error finding container b99822c55b45897721bef8405f26bd6636c481acb23f8889d8a01ddd6636acd7: Status 404 returned error can't find the container with id b99822c55b45897721bef8405f26bd6636c481acb23f8889d8a01ddd6636acd7
Sep 11 16:34:53.139383 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:53.139344    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hsn8q" event={"ID":"a4e870ae-f578-480e-9eaa-b942c31883da","Type":"ContainerStarted","Data":"b99822c55b45897721bef8405f26bd6636c481acb23f8889d8a01ddd6636acd7"}
Sep 11 16:34:55.148682 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:55.148647    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-hsn8q" event={"ID":"a4e870ae-f578-480e-9eaa-b942c31883da","Type":"ContainerStarted","Data":"b287faf724189a284a256f86f909a9d1daf6a1ccc93aede83e6d93fa6a23898f"}
Sep 11 16:34:55.166011 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:55.165841    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-hsn8q" podStartSLOduration=1.853082718 podStartE2EDuration="4.165822472s" totalImagesPullingTime="2.312739754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:34:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:34:55.165562775 +0000 UTC m=+314.783836944" watchObservedRunningTime="2026-09-11 16:34:55.165822472 +0000 UTC m=+314.784096643"
Sep 11 16:34:59.493802 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:59.493761    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg"]
Sep 11 16:34:59.518187 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:59.518154    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg"]
Sep 11 16:34:59.518364 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:59.518299    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg"
Sep 11 16:34:59.521114 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:59.521094    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 16:34:59.522214 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:59.522200    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-77xls\""
Sep 11 16:34:59.522274 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:59.522203    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 16:34:59.615715 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:59.615671    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk2x4\" (UniqueName: \"kubernetes.io/projected/332c96d0-a473-4c4d-8473-309a84fc9eac-kube-api-access-dk2x4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg\" (UID: \"332c96d0-a473-4c4d-8473-309a84fc9eac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg"
Sep 11 16:34:59.615715 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:59.615727    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/332c96d0-a473-4c4d-8473-309a84fc9eac-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg\" (UID: \"332c96d0-a473-4c4d-8473-309a84fc9eac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg"
Sep 11 16:34:59.615972 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:59.615794    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/332c96d0-a473-4c4d-8473-309a84fc9eac-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg\" (UID: \"332c96d0-a473-4c4d-8473-309a84fc9eac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg"
Sep 11 16:34:59.716224 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:59.716187    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dk2x4\" (UniqueName: \"kubernetes.io/projected/332c96d0-a473-4c4d-8473-309a84fc9eac-kube-api-access-dk2x4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg\" (UID: \"332c96d0-a473-4c4d-8473-309a84fc9eac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg"
Sep 11 16:34:59.716369 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:59.716240    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/332c96d0-a473-4c4d-8473-309a84fc9eac-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg\" (UID: \"332c96d0-a473-4c4d-8473-309a84fc9eac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg"
Sep 11 16:34:59.716435 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:59.716363    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/332c96d0-a473-4c4d-8473-309a84fc9eac-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg\" (UID: \"332c96d0-a473-4c4d-8473-309a84fc9eac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg"
Sep 11 16:34:59.716601 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:59.716584    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/332c96d0-a473-4c4d-8473-309a84fc9eac-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg\" (UID: \"332c96d0-a473-4c4d-8473-309a84fc9eac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg"
Sep 11 16:34:59.716692 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:59.716675    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/332c96d0-a473-4c4d-8473-309a84fc9eac-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg\" (UID: \"332c96d0-a473-4c4d-8473-309a84fc9eac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg"
Sep 11 16:34:59.725276 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:59.725251    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk2x4\" (UniqueName: \"kubernetes.io/projected/332c96d0-a473-4c4d-8473-309a84fc9eac-kube-api-access-dk2x4\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg\" (UID: \"332c96d0-a473-4c4d-8473-309a84fc9eac\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg"
Sep 11 16:34:59.827369 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:34:59.827321    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg"
Sep 11 16:35:00.110310 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:00.110208    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg"]
Sep 11 16:35:00.113160 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:35:00.113123    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod332c96d0_a473_4c4d_8473_309a84fc9eac.slice/crio-e5f209b33eeab917380731edd2353c4612f44d6b5f6da7cc0fe17a08bc97af93 WatchSource:0}: Error finding container e5f209b33eeab917380731edd2353c4612f44d6b5f6da7cc0fe17a08bc97af93: Status 404 returned error can't find the container with id e5f209b33eeab917380731edd2353c4612f44d6b5f6da7cc0fe17a08bc97af93
Sep 11 16:35:00.169373 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:00.169343    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg" event={"ID":"332c96d0-a473-4c4d-8473-309a84fc9eac","Type":"ContainerStarted","Data":"e5f209b33eeab917380731edd2353c4612f44d6b5f6da7cc0fe17a08bc97af93"}
Sep 11 16:35:01.174191 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:01.174154    2557 generic.go:356] "Generic (PLEG): container finished" podID="332c96d0-a473-4c4d-8473-309a84fc9eac" containerID="6b4c7356a2bcaf9a76822cdcb8a081b4b90aec7ac264a1f63958497dcf8fa2f3" exitCode=0
Sep 11 16:35:01.174676 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:01.174200    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg" event={"ID":"332c96d0-a473-4c4d-8473-309a84fc9eac","Type":"ContainerDied","Data":"6b4c7356a2bcaf9a76822cdcb8a081b4b90aec7ac264a1f63958497dcf8fa2f3"}
Sep 11 16:35:03.183309 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:03.183266    2557 generic.go:356] "Generic (PLEG): container finished" podID="332c96d0-a473-4c4d-8473-309a84fc9eac" containerID="e4e124bcc21e8afeccaaa708ffa8e4ea16ccb808d44581eeab772cf1ee4c4314" exitCode=0
Sep 11 16:35:03.183733 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:03.183338    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg" event={"ID":"332c96d0-a473-4c4d-8473-309a84fc9eac","Type":"ContainerDied","Data":"e4e124bcc21e8afeccaaa708ffa8e4ea16ccb808d44581eeab772cf1ee4c4314"}
Sep 11 16:35:04.189063 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:04.189026    2557 generic.go:356] "Generic (PLEG): container finished" podID="332c96d0-a473-4c4d-8473-309a84fc9eac" containerID="05ef66c15617d99948087adf7af7eedc868db3229dec6ec090552cd476f251d4" exitCode=0
Sep 11 16:35:04.189454 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:04.189081    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg" event={"ID":"332c96d0-a473-4c4d-8473-309a84fc9eac","Type":"ContainerDied","Data":"05ef66c15617d99948087adf7af7eedc868db3229dec6ec090552cd476f251d4"}
Sep 11 16:35:05.314966 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:05.314939    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg"
Sep 11 16:35:05.358869 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:05.358834    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dk2x4\" (UniqueName: \"kubernetes.io/projected/332c96d0-a473-4c4d-8473-309a84fc9eac-kube-api-access-dk2x4\") pod \"332c96d0-a473-4c4d-8473-309a84fc9eac\" (UID: \"332c96d0-a473-4c4d-8473-309a84fc9eac\") "
Sep 11 16:35:05.358869 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:05.358877    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/332c96d0-a473-4c4d-8473-309a84fc9eac-bundle\") pod \"332c96d0-a473-4c4d-8473-309a84fc9eac\" (UID: \"332c96d0-a473-4c4d-8473-309a84fc9eac\") "
Sep 11 16:35:05.359116 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:05.358900    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/332c96d0-a473-4c4d-8473-309a84fc9eac-util\") pod \"332c96d0-a473-4c4d-8473-309a84fc9eac\" (UID: \"332c96d0-a473-4c4d-8473-309a84fc9eac\") "
Sep 11 16:35:05.359622 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:05.359583    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/332c96d0-a473-4c4d-8473-309a84fc9eac-bundle" (OuterVolumeSpecName: "bundle") pod "332c96d0-a473-4c4d-8473-309a84fc9eac" (UID: "332c96d0-a473-4c4d-8473-309a84fc9eac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:35:05.360893 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:05.360869    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/332c96d0-a473-4c4d-8473-309a84fc9eac-kube-api-access-dk2x4" (OuterVolumeSpecName: "kube-api-access-dk2x4") pod "332c96d0-a473-4c4d-8473-309a84fc9eac" (UID: "332c96d0-a473-4c4d-8473-309a84fc9eac"). InnerVolumeSpecName "kube-api-access-dk2x4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:35:05.364495 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:05.364465    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/332c96d0-a473-4c4d-8473-309a84fc9eac-util" (OuterVolumeSpecName: "util") pod "332c96d0-a473-4c4d-8473-309a84fc9eac" (UID: "332c96d0-a473-4c4d-8473-309a84fc9eac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:35:05.459437 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:05.459343    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dk2x4\" (UniqueName: \"kubernetes.io/projected/332c96d0-a473-4c4d-8473-309a84fc9eac-kube-api-access-dk2x4\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:35:05.459437 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:05.459376    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/332c96d0-a473-4c4d-8473-309a84fc9eac-bundle\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:35:05.459437 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:05.459385    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/332c96d0-a473-4c4d-8473-309a84fc9eac-util\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:35:06.198401 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:06.198369    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg"
Sep 11 16:35:06.198601 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:06.198368    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn75rg" event={"ID":"332c96d0-a473-4c4d-8473-309a84fc9eac","Type":"ContainerDied","Data":"e5f209b33eeab917380731edd2353c4612f44d6b5f6da7cc0fe17a08bc97af93"}
Sep 11 16:35:06.198601 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:06.198490    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5f209b33eeab917380731edd2353c4612f44d6b5f6da7cc0fe17a08bc97af93"
Sep 11 16:35:14.295051 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.295015    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp"]
Sep 11 16:35:14.295444 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.295243    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="332c96d0-a473-4c4d-8473-309a84fc9eac" containerName="util"
Sep 11 16:35:14.295444 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.295255    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="332c96d0-a473-4c4d-8473-309a84fc9eac" containerName="util"
Sep 11 16:35:14.295444 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.295275    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="332c96d0-a473-4c4d-8473-309a84fc9eac" containerName="extract"
Sep 11 16:35:14.295444 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.295283    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="332c96d0-a473-4c4d-8473-309a84fc9eac" containerName="extract"
Sep 11 16:35:14.295444 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.295293    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="332c96d0-a473-4c4d-8473-309a84fc9eac" containerName="pull"
Sep 11 16:35:14.295444 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.295298    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="332c96d0-a473-4c4d-8473-309a84fc9eac" containerName="pull"
Sep 11 16:35:14.295444 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.295339    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="332c96d0-a473-4c4d-8473-309a84fc9eac" containerName="extract"
Sep 11 16:35:14.303424 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.303398    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp"
Sep 11 16:35:14.307669 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.307644    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 16:35:14.308101 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.308086    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 16:35:14.308149 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.308094    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-77xls\""
Sep 11 16:35:14.312544 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.312521    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp"]
Sep 11 16:35:14.422789 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.422743    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b47fc659-bd18-418b-add4-dba8603d99e9-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp\" (UID: \"b47fc659-bd18-418b-add4-dba8603d99e9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp"
Sep 11 16:35:14.422966 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.422802    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nghc\" (UniqueName: \"kubernetes.io/projected/b47fc659-bd18-418b-add4-dba8603d99e9-kube-api-access-8nghc\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp\" (UID: \"b47fc659-bd18-418b-add4-dba8603d99e9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp"
Sep 11 16:35:14.422966 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.422828    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b47fc659-bd18-418b-add4-dba8603d99e9-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp\" (UID: \"b47fc659-bd18-418b-add4-dba8603d99e9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp"
Sep 11 16:35:14.524131 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.524077    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nghc\" (UniqueName: \"kubernetes.io/projected/b47fc659-bd18-418b-add4-dba8603d99e9-kube-api-access-8nghc\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp\" (UID: \"b47fc659-bd18-418b-add4-dba8603d99e9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp"
Sep 11 16:35:14.524279 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.524146    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b47fc659-bd18-418b-add4-dba8603d99e9-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp\" (UID: \"b47fc659-bd18-418b-add4-dba8603d99e9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp"
Sep 11 16:35:14.524279 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.524207    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b47fc659-bd18-418b-add4-dba8603d99e9-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp\" (UID: \"b47fc659-bd18-418b-add4-dba8603d99e9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp"
Sep 11 16:35:14.524573 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.524552    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b47fc659-bd18-418b-add4-dba8603d99e9-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp\" (UID: \"b47fc659-bd18-418b-add4-dba8603d99e9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp"
Sep 11 16:35:14.524675 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.524553    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b47fc659-bd18-418b-add4-dba8603d99e9-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp\" (UID: \"b47fc659-bd18-418b-add4-dba8603d99e9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp"
Sep 11 16:35:14.537419 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.537391    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nghc\" (UniqueName: \"kubernetes.io/projected/b47fc659-bd18-418b-add4-dba8603d99e9-kube-api-access-8nghc\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp\" (UID: \"b47fc659-bd18-418b-add4-dba8603d99e9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp"
Sep 11 16:35:14.612474 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.612376    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp"
Sep 11 16:35:14.903497 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:14.903414    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp"]
Sep 11 16:35:14.906665 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:35:14.906636    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47fc659_bd18_418b_add4_dba8603d99e9.slice/crio-748d631f23fc57567167e1c3b38357ea1fb1af31bec1cba2def49b084eb18515 WatchSource:0}: Error finding container 748d631f23fc57567167e1c3b38357ea1fb1af31bec1cba2def49b084eb18515: Status 404 returned error can't find the container with id 748d631f23fc57567167e1c3b38357ea1fb1af31bec1cba2def49b084eb18515
Sep 11 16:35:15.230931 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:15.230835    2557 generic.go:356] "Generic (PLEG): container finished" podID="b47fc659-bd18-418b-add4-dba8603d99e9" containerID="dbc939bb547669924e830f25d017d635b1e357fe8573b9d53bac48369c2118ba" exitCode=0
Sep 11 16:35:15.230931 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:15.230877    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp" event={"ID":"b47fc659-bd18-418b-add4-dba8603d99e9","Type":"ContainerDied","Data":"dbc939bb547669924e830f25d017d635b1e357fe8573b9d53bac48369c2118ba"}
Sep 11 16:35:15.230931 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:15.230921    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp" event={"ID":"b47fc659-bd18-418b-add4-dba8603d99e9","Type":"ContainerStarted","Data":"748d631f23fc57567167e1c3b38357ea1fb1af31bec1cba2def49b084eb18515"}
Sep 11 16:35:16.236917 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.236830    2557 generic.go:356] "Generic (PLEG): container finished" podID="b47fc659-bd18-418b-add4-dba8603d99e9" containerID="520668b779a50030eaa3d8e4a6d5d43915903ce346d4bb98cb646e75ab07a663" exitCode=0
Sep 11 16:35:16.236917 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.236892    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp" event={"ID":"b47fc659-bd18-418b-add4-dba8603d99e9","Type":"ContainerDied","Data":"520668b779a50030eaa3d8e4a6d5d43915903ce346d4bb98cb646e75ab07a663"}
Sep 11 16:35:16.480124 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.480089    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"]
Sep 11 16:35:16.483252 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.483230    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"
Sep 11 16:35:16.489637 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.489589    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 16:35:16.489765 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.489641    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 16:35:16.489765 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.489739    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mvggq\""
Sep 11 16:35:16.489892 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.489810    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 16:35:16.490475 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.490454    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 16:35:16.501756 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.501729    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"]
Sep 11 16:35:16.538856 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.538823    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/21180bc2-30ff-4e46-b744-0f73b6d0730f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-665d69bffd-22ssr\" (UID: \"21180bc2-30ff-4e46-b744-0f73b6d0730f\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"
Sep 11 16:35:16.538856 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.538859    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21180bc2-30ff-4e46-b744-0f73b6d0730f-webhook-cert\") pod \"opendatahub-operator-controller-manager-665d69bffd-22ssr\" (UID: \"21180bc2-30ff-4e46-b744-0f73b6d0730f\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"
Sep 11 16:35:16.539089 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.538886    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21180bc2-30ff-4e46-b744-0f73b6d0730f-tmp\") pod \"opendatahub-operator-controller-manager-665d69bffd-22ssr\" (UID: \"21180bc2-30ff-4e46-b744-0f73b6d0730f\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"
Sep 11 16:35:16.539089 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.538935    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/21180bc2-30ff-4e46-b744-0f73b6d0730f-manifests\") pod \"opendatahub-operator-controller-manager-665d69bffd-22ssr\" (UID: \"21180bc2-30ff-4e46-b744-0f73b6d0730f\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"
Sep 11 16:35:16.539089 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.538983    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whbrd\" (UniqueName: \"kubernetes.io/projected/21180bc2-30ff-4e46-b744-0f73b6d0730f-kube-api-access-whbrd\") pod \"opendatahub-operator-controller-manager-665d69bffd-22ssr\" (UID: \"21180bc2-30ff-4e46-b744-0f73b6d0730f\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"
Sep 11 16:35:16.639892 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.639850    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/21180bc2-30ff-4e46-b744-0f73b6d0730f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-665d69bffd-22ssr\" (UID: \"21180bc2-30ff-4e46-b744-0f73b6d0730f\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"
Sep 11 16:35:16.639892 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.639893    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21180bc2-30ff-4e46-b744-0f73b6d0730f-webhook-cert\") pod \"opendatahub-operator-controller-manager-665d69bffd-22ssr\" (UID: \"21180bc2-30ff-4e46-b744-0f73b6d0730f\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"
Sep 11 16:35:16.640130 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.639933    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21180bc2-30ff-4e46-b744-0f73b6d0730f-tmp\") pod \"opendatahub-operator-controller-manager-665d69bffd-22ssr\" (UID: \"21180bc2-30ff-4e46-b744-0f73b6d0730f\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"
Sep 11 16:35:16.640130 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.639957    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/21180bc2-30ff-4e46-b744-0f73b6d0730f-manifests\") pod \"opendatahub-operator-controller-manager-665d69bffd-22ssr\" (UID: \"21180bc2-30ff-4e46-b744-0f73b6d0730f\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"
Sep 11 16:35:16.640130 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.639974    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whbrd\" (UniqueName: \"kubernetes.io/projected/21180bc2-30ff-4e46-b744-0f73b6d0730f-kube-api-access-whbrd\") pod \"opendatahub-operator-controller-manager-665d69bffd-22ssr\" (UID: \"21180bc2-30ff-4e46-b744-0f73b6d0730f\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"
Sep 11 16:35:16.640446 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.640421    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/21180bc2-30ff-4e46-b744-0f73b6d0730f-manifests\") pod \"opendatahub-operator-controller-manager-665d69bffd-22ssr\" (UID: \"21180bc2-30ff-4e46-b744-0f73b6d0730f\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"
Sep 11 16:35:16.642357 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.642324    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21180bc2-30ff-4e46-b744-0f73b6d0730f-tmp\") pod \"opendatahub-operator-controller-manager-665d69bffd-22ssr\" (UID: \"21180bc2-30ff-4e46-b744-0f73b6d0730f\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"
Sep 11 16:35:16.642357 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.642352    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21180bc2-30ff-4e46-b744-0f73b6d0730f-webhook-cert\") pod \"opendatahub-operator-controller-manager-665d69bffd-22ssr\" (UID: \"21180bc2-30ff-4e46-b744-0f73b6d0730f\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"
Sep 11 16:35:16.642481 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.642428    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/21180bc2-30ff-4e46-b744-0f73b6d0730f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-665d69bffd-22ssr\" (UID: \"21180bc2-30ff-4e46-b744-0f73b6d0730f\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"
Sep 11 16:35:16.653130 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.653108    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whbrd\" (UniqueName: \"kubernetes.io/projected/21180bc2-30ff-4e46-b744-0f73b6d0730f-kube-api-access-whbrd\") pod \"opendatahub-operator-controller-manager-665d69bffd-22ssr\" (UID: \"21180bc2-30ff-4e46-b744-0f73b6d0730f\") " pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"
Sep 11 16:35:16.793399 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:16.793350    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"
Sep 11 16:35:17.087869 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:17.087722    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"]
Sep 11 16:35:17.091326 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:35:17.091298    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21180bc2_30ff_4e46_b744_0f73b6d0730f.slice/crio-9cbf8d9c55c779add94ce8ba1f827273ea53f46083dfa7ecc0068b56eb563210 WatchSource:0}: Error finding container 9cbf8d9c55c779add94ce8ba1f827273ea53f46083dfa7ecc0068b56eb563210: Status 404 returned error can't find the container with id 9cbf8d9c55c779add94ce8ba1f827273ea53f46083dfa7ecc0068b56eb563210
Sep 11 16:35:17.243621 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:17.243575    2557 generic.go:356] "Generic (PLEG): container finished" podID="b47fc659-bd18-418b-add4-dba8603d99e9" containerID="231955f7f1246dfa97957527a9cfce71ac62956bb208373bf78007de35f7ba58" exitCode=0
Sep 11 16:35:17.244045 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:17.243637    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp" event={"ID":"b47fc659-bd18-418b-add4-dba8603d99e9","Type":"ContainerDied","Data":"231955f7f1246dfa97957527a9cfce71ac62956bb208373bf78007de35f7ba58"}
Sep 11 16:35:17.245035 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:17.245009    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr" event={"ID":"21180bc2-30ff-4e46-b744-0f73b6d0730f","Type":"ContainerStarted","Data":"9cbf8d9c55c779add94ce8ba1f827273ea53f46083dfa7ecc0068b56eb563210"}
Sep 11 16:35:18.403794 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:18.403757    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp"
Sep 11 16:35:18.454960 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:18.454925    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8nghc\" (UniqueName: \"kubernetes.io/projected/b47fc659-bd18-418b-add4-dba8603d99e9-kube-api-access-8nghc\") pod \"b47fc659-bd18-418b-add4-dba8603d99e9\" (UID: \"b47fc659-bd18-418b-add4-dba8603d99e9\") "
Sep 11 16:35:18.454960 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:18.454976    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b47fc659-bd18-418b-add4-dba8603d99e9-util\") pod \"b47fc659-bd18-418b-add4-dba8603d99e9\" (UID: \"b47fc659-bd18-418b-add4-dba8603d99e9\") "
Sep 11 16:35:18.455221 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:18.455012    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b47fc659-bd18-418b-add4-dba8603d99e9-bundle\") pod \"b47fc659-bd18-418b-add4-dba8603d99e9\" (UID: \"b47fc659-bd18-418b-add4-dba8603d99e9\") "
Sep 11 16:35:18.456182 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:18.456149    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b47fc659-bd18-418b-add4-dba8603d99e9-bundle" (OuterVolumeSpecName: "bundle") pod "b47fc659-bd18-418b-add4-dba8603d99e9" (UID: "b47fc659-bd18-418b-add4-dba8603d99e9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:35:18.457503 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:18.457469    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b47fc659-bd18-418b-add4-dba8603d99e9-kube-api-access-8nghc" (OuterVolumeSpecName: "kube-api-access-8nghc") pod "b47fc659-bd18-418b-add4-dba8603d99e9" (UID: "b47fc659-bd18-418b-add4-dba8603d99e9"). InnerVolumeSpecName "kube-api-access-8nghc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:35:18.463530 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:18.463499    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b47fc659-bd18-418b-add4-dba8603d99e9-util" (OuterVolumeSpecName: "util") pod "b47fc659-bd18-418b-add4-dba8603d99e9" (UID: "b47fc659-bd18-418b-add4-dba8603d99e9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:35:18.555680 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:18.555636    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8nghc\" (UniqueName: \"kubernetes.io/projected/b47fc659-bd18-418b-add4-dba8603d99e9-kube-api-access-8nghc\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:35:18.555680 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:18.555676    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b47fc659-bd18-418b-add4-dba8603d99e9-util\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:35:18.555933 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:18.555692    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b47fc659-bd18-418b-add4-dba8603d99e9-bundle\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:35:19.257117 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:19.257033    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp"
Sep 11 16:35:19.257117 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:19.257045    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0tpbqp" event={"ID":"b47fc659-bd18-418b-add4-dba8603d99e9","Type":"ContainerDied","Data":"748d631f23fc57567167e1c3b38357ea1fb1af31bec1cba2def49b084eb18515"}
Sep 11 16:35:19.257117 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:19.257102    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="748d631f23fc57567167e1c3b38357ea1fb1af31bec1cba2def49b084eb18515"
Sep 11 16:35:20.262935 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:20.262881    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr" event={"ID":"21180bc2-30ff-4e46-b744-0f73b6d0730f","Type":"ContainerStarted","Data":"893779dd0b61dea3f4c22811d41440ba04bde265ef263f553d71eb9f3f289ba4"}
Sep 11 16:35:21.268667 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:21.268636    2557 generic.go:356] "Generic (PLEG): container finished" podID="21180bc2-30ff-4e46-b744-0f73b6d0730f" containerID="893779dd0b61dea3f4c22811d41440ba04bde265ef263f553d71eb9f3f289ba4" exitCode=0
Sep 11 16:35:21.269029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:21.268694    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr" event={"ID":"21180bc2-30ff-4e46-b744-0f73b6d0730f","Type":"ContainerDied","Data":"893779dd0b61dea3f4c22811d41440ba04bde265ef263f553d71eb9f3f289ba4"}
Sep 11 16:35:22.275277 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:22.275232    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr" event={"ID":"21180bc2-30ff-4e46-b744-0f73b6d0730f","Type":"ContainerStarted","Data":"a3f388c25cd7aaca1ece1362c5a94e5fb5c7e264fb82f985e3ad549f5629d07e"}
Sep 11 16:35:22.275783 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:22.275362    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"
Sep 11 16:35:22.324410 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:22.324346    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr" podStartSLOduration=1.931714995 podStartE2EDuration="6.324329439s" totalImagesPullingTime="3.342583741s" totalInitContainerRuntime="1.050030703s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:35:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:35:22.320088341 +0000 UTC m=+341.938362511" watchObservedRunningTime="2026-09-11 16:35:22.324329439 +0000 UTC m=+341.942603609"
Sep 11 16:35:33.282462 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:33.282383    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-665d69bffd-22ssr"
Sep 11 16:35:35.551522 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.551484    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5d87f6b9bb-57hz6"]
Sep 11 16:35:35.551931 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.551770    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b47fc659-bd18-418b-add4-dba8603d99e9" containerName="pull"
Sep 11 16:35:35.551931 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.551782    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b47fc659-bd18-418b-add4-dba8603d99e9" containerName="pull"
Sep 11 16:35:35.551931 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.551795    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b47fc659-bd18-418b-add4-dba8603d99e9" containerName="extract"
Sep 11 16:35:35.551931 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.551801    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b47fc659-bd18-418b-add4-dba8603d99e9" containerName="extract"
Sep 11 16:35:35.551931 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.551808    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b47fc659-bd18-418b-add4-dba8603d99e9" containerName="util"
Sep 11 16:35:35.551931 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.551814    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b47fc659-bd18-418b-add4-dba8603d99e9" containerName="util"
Sep 11 16:35:35.551931 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.551867    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b47fc659-bd18-418b-add4-dba8603d99e9" containerName="extract"
Sep 11 16:35:35.554913 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.554891    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-57hz6"
Sep 11 16:35:35.561232 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.560830    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 16:35:35.561991 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.561968    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 16:35:35.562096 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.561966    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 16:35:35.562096 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.561969    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-c2gsl\""
Sep 11 16:35:35.562206 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.561977    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 16:35:35.576953 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.576923    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d87f6b9bb-57hz6"]
Sep 11 16:35:35.673187 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.673149    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84p8t\" (UniqueName: \"kubernetes.io/projected/83a01613-65e7-40a8-b3dd-b5938cf4345b-kube-api-access-84p8t\") pod \"kube-auth-proxy-5d87f6b9bb-57hz6\" (UID: \"83a01613-65e7-40a8-b3dd-b5938cf4345b\") " pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-57hz6"
Sep 11 16:35:35.673187 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.673197    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83a01613-65e7-40a8-b3dd-b5938cf4345b-tls-certs\") pod \"kube-auth-proxy-5d87f6b9bb-57hz6\" (UID: \"83a01613-65e7-40a8-b3dd-b5938cf4345b\") " pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-57hz6"
Sep 11 16:35:35.673472 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.673288    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83a01613-65e7-40a8-b3dd-b5938cf4345b-tmp\") pod \"kube-auth-proxy-5d87f6b9bb-57hz6\" (UID: \"83a01613-65e7-40a8-b3dd-b5938cf4345b\") " pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-57hz6"
Sep 11 16:35:35.773860 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.773819    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84p8t\" (UniqueName: \"kubernetes.io/projected/83a01613-65e7-40a8-b3dd-b5938cf4345b-kube-api-access-84p8t\") pod \"kube-auth-proxy-5d87f6b9bb-57hz6\" (UID: \"83a01613-65e7-40a8-b3dd-b5938cf4345b\") " pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-57hz6"
Sep 11 16:35:35.773860 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.773864    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83a01613-65e7-40a8-b3dd-b5938cf4345b-tls-certs\") pod \"kube-auth-proxy-5d87f6b9bb-57hz6\" (UID: \"83a01613-65e7-40a8-b3dd-b5938cf4345b\") " pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-57hz6"
Sep 11 16:35:35.774112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.773895    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83a01613-65e7-40a8-b3dd-b5938cf4345b-tmp\") pod \"kube-auth-proxy-5d87f6b9bb-57hz6\" (UID: \"83a01613-65e7-40a8-b3dd-b5938cf4345b\") " pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-57hz6"
Sep 11 16:35:35.776302 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.776278    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/83a01613-65e7-40a8-b3dd-b5938cf4345b-tmp\") pod \"kube-auth-proxy-5d87f6b9bb-57hz6\" (UID: \"83a01613-65e7-40a8-b3dd-b5938cf4345b\") " pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-57hz6"
Sep 11 16:35:35.776420 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.776337    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83a01613-65e7-40a8-b3dd-b5938cf4345b-tls-certs\") pod \"kube-auth-proxy-5d87f6b9bb-57hz6\" (UID: \"83a01613-65e7-40a8-b3dd-b5938cf4345b\") " pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-57hz6"
Sep 11 16:35:35.784383 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.784358    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84p8t\" (UniqueName: \"kubernetes.io/projected/83a01613-65e7-40a8-b3dd-b5938cf4345b-kube-api-access-84p8t\") pod \"kube-auth-proxy-5d87f6b9bb-57hz6\" (UID: \"83a01613-65e7-40a8-b3dd-b5938cf4345b\") " pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-57hz6"
Sep 11 16:35:35.864460 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:35.864371    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-57hz6"
Sep 11 16:35:36.149558 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:36.149529    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d87f6b9bb-57hz6"]
Sep 11 16:35:36.151694 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:35:36.151666    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a01613_65e7_40a8_b3dd_b5938cf4345b.slice/crio-69094bcc1ccc04e62b02fda15decfdc7ec0adb971cd46cab5595121c8b20eaca WatchSource:0}: Error finding container 69094bcc1ccc04e62b02fda15decfdc7ec0adb971cd46cab5595121c8b20eaca: Status 404 returned error can't find the container with id 69094bcc1ccc04e62b02fda15decfdc7ec0adb971cd46cab5595121c8b20eaca
Sep 11 16:35:36.328999 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:36.328964    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-57hz6" event={"ID":"83a01613-65e7-40a8-b3dd-b5938cf4345b","Type":"ContainerStarted","Data":"69094bcc1ccc04e62b02fda15decfdc7ec0adb971cd46cab5595121c8b20eaca"}
Sep 11 16:35:37.561071 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.561034    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"]
Sep 11 16:35:37.564352 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.564328    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.567499 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.567355    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 16:35:37.567499 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.567411    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 16:35:37.567861 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.567837    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-d6p2s\""
Sep 11 16:35:37.568060 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.568042    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 16:35:37.568060 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.568057    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 16:35:37.583161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.583114    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"]
Sep 11 16:35:37.689791 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.689753    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a1a88e93-d3eb-4b41-994a-c30644b0e0be-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.689791 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.689799    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.690057 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.689825    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.690057 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.689861    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.690057 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.689989    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1a88e93-d3eb-4b41-994a-c30644b0e0be-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.690057 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.690032    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4f7c\" (UniqueName: \"kubernetes.io/projected/a1a88e93-d3eb-4b41-994a-c30644b0e0be-kube-api-access-p4f7c\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.690238 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.690082    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.791372 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.791331    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a1a88e93-d3eb-4b41-994a-c30644b0e0be-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.791372 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.791379    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.791651 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.791404    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.791651 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.791445    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.791651 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.791509    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1a88e93-d3eb-4b41-994a-c30644b0e0be-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.791651 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.791536    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4f7c\" (UniqueName: \"kubernetes.io/projected/a1a88e93-d3eb-4b41-994a-c30644b0e0be-kube-api-access-p4f7c\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.791651 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.791591    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.792553 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.792363    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.794638 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.794579    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.794845 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.794821    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a1a88e93-d3eb-4b41-994a-c30644b0e0be-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.794950 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.794927    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1a88e93-d3eb-4b41-994a-c30644b0e0be-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.795222 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.795190    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.802415 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.802386    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4f7c\" (UniqueName: \"kubernetes.io/projected/a1a88e93-d3eb-4b41-994a-c30644b0e0be-kube-api-access-p4f7c\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.802794 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.802647    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-959s5\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:37.877782 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:37.877698    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:39.191600 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:39.191445    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"]
Sep 11 16:35:39.194285 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:35:39.194260    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a88e93_d3eb_4b41_994a_c30644b0e0be.slice/crio-6981504f0a4249d8c49d3b83dd35acac6fead5bbdcd7d1c46a835d2590c536a4 WatchSource:0}: Error finding container 6981504f0a4249d8c49d3b83dd35acac6fead5bbdcd7d1c46a835d2590c536a4: Status 404 returned error can't find the container with id 6981504f0a4249d8c49d3b83dd35acac6fead5bbdcd7d1c46a835d2590c536a4
Sep 11 16:35:39.343254 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:39.343215    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-57hz6" event={"ID":"83a01613-65e7-40a8-b3dd-b5938cf4345b","Type":"ContainerStarted","Data":"e8174422a452b7dc2fffd94b0a2a134a9eb7231a4376eb3743a58862eb43898a"}
Sep 11 16:35:39.344420 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:39.344396    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5" event={"ID":"a1a88e93-d3eb-4b41-994a-c30644b0e0be","Type":"ContainerStarted","Data":"6981504f0a4249d8c49d3b83dd35acac6fead5bbdcd7d1c46a835d2590c536a4"}
Sep 11 16:35:39.364709 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:39.364665    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5d87f6b9bb-57hz6" podStartSLOduration=1.5392057559999999 podStartE2EDuration="4.364650116s" totalImagesPullingTime="2.82544436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:35:39.363749205 +0000 UTC m=+358.982023377" watchObservedRunningTime="2026-09-11 16:35:39.364650116 +0000 UTC m=+358.982924311"
Sep 11 16:35:41.663020 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:41.662952    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:35:41.663272 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:41.663056    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:35:42.361698 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:42.361655    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5" event={"ID":"a1a88e93-d3eb-4b41-994a-c30644b0e0be","Type":"ContainerStarted","Data":"26dd4dcacaf62c56160a16afa7bb8d552d0aa117cf4ba2e123206afb6d3269e3"}
Sep 11 16:35:42.361912 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:42.361817    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:42.363506 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:42.363477    2557 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-959s5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 16:35:42.363667 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:42.363534    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5" podUID="a1a88e93-d3eb-4b41-994a-c30644b0e0be" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 16:35:42.401891 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:42.401807    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5" podStartSLOduration=2.935872107 podStartE2EDuration="5.401780303s" totalImagesPullingTime="2.465908196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:35:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:35:42.397413107 +0000 UTC m=+362.015687279" watchObservedRunningTime="2026-09-11 16:35:42.401780303 +0000 UTC m=+362.020054534"
Sep 11 16:35:43.366203 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:43.366175    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:35:57.857442 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:57.857408    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-pwcdc"]
Sep 11 16:35:57.866651 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:57.866590    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pwcdc"
Sep 11 16:35:57.873730 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:57.873707    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 11 16:35:57.883252 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:57.883232    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-wzmdg\""
Sep 11 16:35:57.896803 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:57.896768    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-pwcdc"]
Sep 11 16:35:57.957129 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:57.957090    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rct9l\" (UniqueName: \"kubernetes.io/projected/887a2e15-3397-46d1-8204-146b4de3ab23-kube-api-access-rct9l\") pod \"llmisvc-controller-manager-777c6bd7d5-pwcdc\" (UID: \"887a2e15-3397-46d1-8204-146b4de3ab23\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pwcdc"
Sep 11 16:35:57.957129 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:57.957135    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/887a2e15-3397-46d1-8204-146b4de3ab23-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pwcdc\" (UID: \"887a2e15-3397-46d1-8204-146b4de3ab23\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pwcdc"
Sep 11 16:35:58.058183 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:58.058143    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rct9l\" (UniqueName: \"kubernetes.io/projected/887a2e15-3397-46d1-8204-146b4de3ab23-kube-api-access-rct9l\") pod \"llmisvc-controller-manager-777c6bd7d5-pwcdc\" (UID: \"887a2e15-3397-46d1-8204-146b4de3ab23\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pwcdc"
Sep 11 16:35:58.058183 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:58.058184    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/887a2e15-3397-46d1-8204-146b4de3ab23-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pwcdc\" (UID: \"887a2e15-3397-46d1-8204-146b4de3ab23\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pwcdc"
Sep 11 16:35:58.060648 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:58.060631    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/887a2e15-3397-46d1-8204-146b4de3ab23-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-pwcdc\" (UID: \"887a2e15-3397-46d1-8204-146b4de3ab23\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pwcdc"
Sep 11 16:35:58.073933 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:58.073908    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rct9l\" (UniqueName: \"kubernetes.io/projected/887a2e15-3397-46d1-8204-146b4de3ab23-kube-api-access-rct9l\") pod \"llmisvc-controller-manager-777c6bd7d5-pwcdc\" (UID: \"887a2e15-3397-46d1-8204-146b4de3ab23\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pwcdc"
Sep 11 16:35:58.176355 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:58.176267    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pwcdc"
Sep 11 16:35:58.505303 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:58.505274    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-pwcdc"]
Sep 11 16:35:58.507178 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:35:58.507144    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod887a2e15_3397_46d1_8204_146b4de3ab23.slice/crio-15997f97634b2f7bae14710c117208f3a48573a22d6182fc280757bbd32880b2 WatchSource:0}: Error finding container 15997f97634b2f7bae14710c117208f3a48573a22d6182fc280757bbd32880b2: Status 404 returned error can't find the container with id 15997f97634b2f7bae14710c117208f3a48573a22d6182fc280757bbd32880b2
Sep 11 16:35:59.434752 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:35:59.434719    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pwcdc" event={"ID":"887a2e15-3397-46d1-8204-146b4de3ab23","Type":"ContainerStarted","Data":"15997f97634b2f7bae14710c117208f3a48573a22d6182fc280757bbd32880b2"}
Sep 11 16:36:00.749457 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:00.749419    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"]
Sep 11 16:36:00.749904 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:00.749653    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5" podUID="a1a88e93-d3eb-4b41-994a-c30644b0e0be" containerName="discovery" containerID="cri-o://26dd4dcacaf62c56160a16afa7bb8d552d0aa117cf4ba2e123206afb6d3269e3" gracePeriod=30
Sep 11 16:36:01.366384 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.366347    2557 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-959s5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.21:8080/ready\": dial tcp 10.132.0.21:8080: connect: connection refused" start-of-body=
Sep 11 16:36:01.366541 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.366409    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5" podUID="a1a88e93-d3eb-4b41-994a-c30644b0e0be" containerName="discovery" probeResult="failure" output="Get \"http://10.132.0.21:8080/ready\": dial tcp 10.132.0.21:8080: connect: connection refused"
Sep 11 16:36:01.446356 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.446319    2557 generic.go:356] "Generic (PLEG): container finished" podID="a1a88e93-d3eb-4b41-994a-c30644b0e0be" containerID="26dd4dcacaf62c56160a16afa7bb8d552d0aa117cf4ba2e123206afb6d3269e3" exitCode=0
Sep 11 16:36:01.446521 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.446366    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5" event={"ID":"a1a88e93-d3eb-4b41-994a-c30644b0e0be","Type":"ContainerDied","Data":"26dd4dcacaf62c56160a16afa7bb8d552d0aa117cf4ba2e123206afb6d3269e3"}
Sep 11 16:36:01.482387 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.482363    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:36:01.588907 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.588870    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1a88e93-d3eb-4b41-994a-c30644b0e0be-local-certs\") pod \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") "
Sep 11 16:36:01.589096 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.588927    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-csr-ca-configmap\") pod \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") "
Sep 11 16:36:01.589096 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.588957    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-kubeconfig\") pod \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") "
Sep 11 16:36:01.589096 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.589026    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-csr-dns-cert\") pod \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") "
Sep 11 16:36:01.589096 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.589060    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a1a88e93-d3eb-4b41-994a-c30644b0e0be-cacerts\") pod \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") "
Sep 11 16:36:01.589096 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.589083    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4f7c\" (UniqueName: \"kubernetes.io/projected/a1a88e93-d3eb-4b41-994a-c30644b0e0be-kube-api-access-p4f7c\") pod \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") "
Sep 11 16:36:01.589341 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.589112    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-token\") pod \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\" (UID: \"a1a88e93-d3eb-4b41-994a-c30644b0e0be\") "
Sep 11 16:36:01.589892 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.589738    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a1a88e93-d3eb-4b41-994a-c30644b0e0be" (UID: "a1a88e93-d3eb-4b41-994a-c30644b0e0be"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:36:01.594171 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.593860    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-token" (OuterVolumeSpecName: "istio-token") pod "a1a88e93-d3eb-4b41-994a-c30644b0e0be" (UID: "a1a88e93-d3eb-4b41-994a-c30644b0e0be"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:36:01.594171 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.593917    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1a88e93-d3eb-4b41-994a-c30644b0e0be-kube-api-access-p4f7c" (OuterVolumeSpecName: "kube-api-access-p4f7c") pod "a1a88e93-d3eb-4b41-994a-c30644b0e0be" (UID: "a1a88e93-d3eb-4b41-994a-c30644b0e0be"). InnerVolumeSpecName "kube-api-access-p4f7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:36:01.594171 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.594048    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a1a88e93-d3eb-4b41-994a-c30644b0e0be" (UID: "a1a88e93-d3eb-4b41-994a-c30644b0e0be"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:36:01.594385 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.594192    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1a88e93-d3eb-4b41-994a-c30644b0e0be-cacerts" (OuterVolumeSpecName: "cacerts") pod "a1a88e93-d3eb-4b41-994a-c30644b0e0be" (UID: "a1a88e93-d3eb-4b41-994a-c30644b0e0be"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:36:01.596425 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.596092    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a1a88e93-d3eb-4b41-994a-c30644b0e0be" (UID: "a1a88e93-d3eb-4b41-994a-c30644b0e0be"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:36:01.596425 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.596103    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1a88e93-d3eb-4b41-994a-c30644b0e0be-local-certs" (OuterVolumeSpecName: "local-certs") pod "a1a88e93-d3eb-4b41-994a-c30644b0e0be" (UID: "a1a88e93-d3eb-4b41-994a-c30644b0e0be"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:36:01.689999 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.689914    2557 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a1a88e93-d3eb-4b41-994a-c30644b0e0be-cacerts\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:36:01.689999 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.689963    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4f7c\" (UniqueName: \"kubernetes.io/projected/a1a88e93-d3eb-4b41-994a-c30644b0e0be-kube-api-access-p4f7c\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:36:01.689999 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.689975    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-token\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:36:01.689999 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.689986    2557 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1a88e93-d3eb-4b41-994a-c30644b0e0be-local-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:36:01.689999 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.689994    2557 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-csr-ca-configmap\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:36:01.689999 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.690002    2557 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-kubeconfig\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:36:01.690324 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:01.690011    2557 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a1a88e93-d3eb-4b41-994a-c30644b0e0be-istio-csr-dns-cert\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:36:02.451971 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:02.451931    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pwcdc" event={"ID":"887a2e15-3397-46d1-8204-146b4de3ab23","Type":"ContainerStarted","Data":"cd74be491dadf3d4c35eb4c450dd2a29f6a970c24e179657a06309f3a39f7897"}
Sep 11 16:36:02.452419 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:02.452121    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pwcdc"
Sep 11 16:36:02.453289 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:02.453269    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"
Sep 11 16:36:02.453397 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:02.453267    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5" event={"ID":"a1a88e93-d3eb-4b41-994a-c30644b0e0be","Type":"ContainerDied","Data":"6981504f0a4249d8c49d3b83dd35acac6fead5bbdcd7d1c46a835d2590c536a4"}
Sep 11 16:36:02.453442 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:02.453395    2557 scope.go:117] "RemoveContainer" containerID="26dd4dcacaf62c56160a16afa7bb8d552d0aa117cf4ba2e123206afb6d3269e3"
Sep 11 16:36:02.511011 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:02.510952    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pwcdc" podStartSLOduration=2.622800018 podStartE2EDuration="5.510934326s" totalImagesPullingTime="2.888134308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:35:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:36:02.510875141 +0000 UTC m=+382.129149312" watchObservedRunningTime="2026-09-11 16:36:02.510934326 +0000 UTC m=+382.129208496"
Sep 11 16:36:02.536572 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:02.536535    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"]
Sep 11 16:36:02.547892 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:02.547848    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-959s5"]
Sep 11 16:36:02.946624 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:02.946577    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1a88e93-d3eb-4b41-994a-c30644b0e0be" path="/var/lib/kubelet/pods/a1a88e93-d3eb-4b41-994a-c30644b0e0be/volumes"
Sep 11 16:36:33.461393 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:33.461356    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-pwcdc"
Sep 11 16:36:52.113520 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.113488    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n"]
Sep 11 16:36:52.114003 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.113799    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1a88e93-d3eb-4b41-994a-c30644b0e0be" containerName="discovery"
Sep 11 16:36:52.114003 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.113811    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1a88e93-d3eb-4b41-994a-c30644b0e0be" containerName="discovery"
Sep 11 16:36:52.114003 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.113856    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1a88e93-d3eb-4b41-994a-c30644b0e0be" containerName="discovery"
Sep 11 16:36:52.118470 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.118448    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n"
Sep 11 16:36:52.121372 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.121350    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 16:36:52.121671 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.121654    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 16:36:52.122646 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.122628    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-77xls\""
Sep 11 16:36:52.128450 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.128427    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n"]
Sep 11 16:36:52.156081 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.156041    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/011a5c8f-5f61-4334-9392-c3b744b0d9df-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n\" (UID: \"011a5c8f-5f61-4334-9392-c3b744b0d9df\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n"
Sep 11 16:36:52.156258 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.156119    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/011a5c8f-5f61-4334-9392-c3b744b0d9df-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n\" (UID: \"011a5c8f-5f61-4334-9392-c3b744b0d9df\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n"
Sep 11 16:36:52.156258 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.156148    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj52s\" (UniqueName: \"kubernetes.io/projected/011a5c8f-5f61-4334-9392-c3b744b0d9df-kube-api-access-sj52s\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n\" (UID: \"011a5c8f-5f61-4334-9392-c3b744b0d9df\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n"
Sep 11 16:36:52.198299 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.198263    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb"]
Sep 11 16:36:52.201672 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.201653    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb"
Sep 11 16:36:52.211854 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.211818    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb"]
Sep 11 16:36:52.257444 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.257411    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/011a5c8f-5f61-4334-9392-c3b744b0d9df-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n\" (UID: \"011a5c8f-5f61-4334-9392-c3b744b0d9df\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n"
Sep 11 16:36:52.257444 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.257446    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj52s\" (UniqueName: \"kubernetes.io/projected/011a5c8f-5f61-4334-9392-c3b744b0d9df-kube-api-access-sj52s\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n\" (UID: \"011a5c8f-5f61-4334-9392-c3b744b0d9df\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n"
Sep 11 16:36:52.257679 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.257470    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f7752f4-c367-4035-be14-79d2a4554421-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb\" (UID: \"0f7752f4-c367-4035-be14-79d2a4554421\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb"
Sep 11 16:36:52.257679 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.257505    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2qk2\" (UniqueName: \"kubernetes.io/projected/0f7752f4-c367-4035-be14-79d2a4554421-kube-api-access-g2qk2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb\" (UID: \"0f7752f4-c367-4035-be14-79d2a4554421\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb"
Sep 11 16:36:52.257679 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.257566    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/011a5c8f-5f61-4334-9392-c3b744b0d9df-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n\" (UID: \"011a5c8f-5f61-4334-9392-c3b744b0d9df\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n"
Sep 11 16:36:52.257679 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.257615    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f7752f4-c367-4035-be14-79d2a4554421-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb\" (UID: \"0f7752f4-c367-4035-be14-79d2a4554421\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb"
Sep 11 16:36:52.257846 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.257821    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/011a5c8f-5f61-4334-9392-c3b744b0d9df-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n\" (UID: \"011a5c8f-5f61-4334-9392-c3b744b0d9df\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n"
Sep 11 16:36:52.257846 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.257839    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/011a5c8f-5f61-4334-9392-c3b744b0d9df-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n\" (UID: \"011a5c8f-5f61-4334-9392-c3b744b0d9df\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n"
Sep 11 16:36:52.267034 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.267010    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj52s\" (UniqueName: \"kubernetes.io/projected/011a5c8f-5f61-4334-9392-c3b744b0d9df-kube-api-access-sj52s\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n\" (UID: \"011a5c8f-5f61-4334-9392-c3b744b0d9df\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n"
Sep 11 16:36:52.301241 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.301203    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw"]
Sep 11 16:36:52.304630 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.304592    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw"
Sep 11 16:36:52.313959 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.313929    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw"]
Sep 11 16:36:52.358105 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.358067    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw\" (UID: \"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw"
Sep 11 16:36:52.358105 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.358109    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f7752f4-c367-4035-be14-79d2a4554421-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb\" (UID: \"0f7752f4-c367-4035-be14-79d2a4554421\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb"
Sep 11 16:36:52.358386 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.358128    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkbj6\" (UniqueName: \"kubernetes.io/projected/9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0-kube-api-access-hkbj6\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw\" (UID: \"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw"
Sep 11 16:36:52.358386 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.358223    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f7752f4-c367-4035-be14-79d2a4554421-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb\" (UID: \"0f7752f4-c367-4035-be14-79d2a4554421\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb"
Sep 11 16:36:52.358386 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.358292    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2qk2\" (UniqueName: \"kubernetes.io/projected/0f7752f4-c367-4035-be14-79d2a4554421-kube-api-access-g2qk2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb\" (UID: \"0f7752f4-c367-4035-be14-79d2a4554421\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb"
Sep 11 16:36:52.358386 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.358325    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw\" (UID: \"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw"
Sep 11 16:36:52.358521 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.358477    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f7752f4-c367-4035-be14-79d2a4554421-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb\" (UID: \"0f7752f4-c367-4035-be14-79d2a4554421\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb"
Sep 11 16:36:52.358555 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.358531    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f7752f4-c367-4035-be14-79d2a4554421-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb\" (UID: \"0f7752f4-c367-4035-be14-79d2a4554421\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb"
Sep 11 16:36:52.368207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.368158    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2qk2\" (UniqueName: \"kubernetes.io/projected/0f7752f4-c367-4035-be14-79d2a4554421-kube-api-access-g2qk2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb\" (UID: \"0f7752f4-c367-4035-be14-79d2a4554421\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb"
Sep 11 16:36:52.395540 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.395508    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q"]
Sep 11 16:36:52.398889 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.398867    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q"
Sep 11 16:36:52.410227 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.410193    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q"]
Sep 11 16:36:52.427324 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.427282    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n"
Sep 11 16:36:52.458733 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.458701    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw\" (UID: \"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw"
Sep 11 16:36:52.458901 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.458739    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5040d909-28d3-4059-88d5-ba2b0361c3bb-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q\" (UID: \"5040d909-28d3-4059-88d5-ba2b0361c3bb\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q"
Sep 11 16:36:52.458901 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.458769    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw\" (UID: \"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw"
Sep 11 16:36:52.458901 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.458796    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkbj6\" (UniqueName: \"kubernetes.io/projected/9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0-kube-api-access-hkbj6\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw\" (UID: \"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw"
Sep 11 16:36:52.458901 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.458867    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djf99\" (UniqueName: \"kubernetes.io/projected/5040d909-28d3-4059-88d5-ba2b0361c3bb-kube-api-access-djf99\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q\" (UID: \"5040d909-28d3-4059-88d5-ba2b0361c3bb\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q"
Sep 11 16:36:52.459064 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.458910    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5040d909-28d3-4059-88d5-ba2b0361c3bb-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q\" (UID: \"5040d909-28d3-4059-88d5-ba2b0361c3bb\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q"
Sep 11 16:36:52.459117 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.459097    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw\" (UID: \"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw"
Sep 11 16:36:52.459261 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.459240    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw\" (UID: \"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw"
Sep 11 16:36:52.469806 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.469765    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkbj6\" (UniqueName: \"kubernetes.io/projected/9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0-kube-api-access-hkbj6\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw\" (UID: \"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw"
Sep 11 16:36:52.510980 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.510947    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb"
Sep 11 16:36:52.559833 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.559792    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5040d909-28d3-4059-88d5-ba2b0361c3bb-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q\" (UID: \"5040d909-28d3-4059-88d5-ba2b0361c3bb\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q"
Sep 11 16:36:52.560021 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.559887    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djf99\" (UniqueName: \"kubernetes.io/projected/5040d909-28d3-4059-88d5-ba2b0361c3bb-kube-api-access-djf99\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q\" (UID: \"5040d909-28d3-4059-88d5-ba2b0361c3bb\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q"
Sep 11 16:36:52.560021 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.559924    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5040d909-28d3-4059-88d5-ba2b0361c3bb-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q\" (UID: \"5040d909-28d3-4059-88d5-ba2b0361c3bb\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q"
Sep 11 16:36:52.560326 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.560246    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5040d909-28d3-4059-88d5-ba2b0361c3bb-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q\" (UID: \"5040d909-28d3-4059-88d5-ba2b0361c3bb\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q"
Sep 11 16:36:52.560490 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.560468    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5040d909-28d3-4059-88d5-ba2b0361c3bb-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q\" (UID: \"5040d909-28d3-4059-88d5-ba2b0361c3bb\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q"
Sep 11 16:36:52.573651 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.572245    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djf99\" (UniqueName: \"kubernetes.io/projected/5040d909-28d3-4059-88d5-ba2b0361c3bb-kube-api-access-djf99\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q\" (UID: \"5040d909-28d3-4059-88d5-ba2b0361c3bb\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q"
Sep 11 16:36:52.614049 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.614007    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw"
Sep 11 16:36:52.702646 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.702620    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n"]
Sep 11 16:36:52.704100 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:36:52.704074    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod011a5c8f_5f61_4334_9392_c3b744b0d9df.slice/crio-54eb80be6154fa4abed49392bb13b92d041061dfda9d6407b7217b3b0d497de9 WatchSource:0}: Error finding container 54eb80be6154fa4abed49392bb13b92d041061dfda9d6407b7217b3b0d497de9: Status 404 returned error can't find the container with id 54eb80be6154fa4abed49392bb13b92d041061dfda9d6407b7217b3b0d497de9
Sep 11 16:36:52.708869 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.708849    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q"
Sep 11 16:36:52.794402 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.794371    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb"]
Sep 11 16:36:52.796345 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:36:52.796315    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f7752f4_c367_4035_be14_79d2a4554421.slice/crio-01ebc00dbc240db4b40df3a863f6d50a2720b2efe36153f8f44becb8373f4f20 WatchSource:0}: Error finding container 01ebc00dbc240db4b40df3a863f6d50a2720b2efe36153f8f44becb8373f4f20: Status 404 returned error can't find the container with id 01ebc00dbc240db4b40df3a863f6d50a2720b2efe36153f8f44becb8373f4f20
Sep 11 16:36:52.892368 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:36:52.892338    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ead9fd1_793d_4b7c_8a4d_72dd6be4f6b0.slice/crio-b548314faed08d18ba4a2458305f3498fccbc68fc036f0a4ef1d0d40c940d59e WatchSource:0}: Error finding container b548314faed08d18ba4a2458305f3498fccbc68fc036f0a4ef1d0d40c940d59e: Status 404 returned error can't find the container with id b548314faed08d18ba4a2458305f3498fccbc68fc036f0a4ef1d0d40c940d59e
Sep 11 16:36:52.892476 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.892404    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw"]
Sep 11 16:36:52.990156 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:52.990132    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q"]
Sep 11 16:36:53.055583 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:36:53.055546    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5040d909_28d3_4059_88d5_ba2b0361c3bb.slice/crio-76ea9b5bd5d30a5fc5b4b2fb8240d90bc6de11956a0385d1ee0e8b5074660e92 WatchSource:0}: Error finding container 76ea9b5bd5d30a5fc5b4b2fb8240d90bc6de11956a0385d1ee0e8b5074660e92: Status 404 returned error can't find the container with id 76ea9b5bd5d30a5fc5b4b2fb8240d90bc6de11956a0385d1ee0e8b5074660e92
Sep 11 16:36:53.668306 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:53.668261    2557 generic.go:356] "Generic (PLEG): container finished" podID="0f7752f4-c367-4035-be14-79d2a4554421" containerID="100b18458a38654ba5033c3ae71bc4397d3a3222aadacd3ac55597d615e822e9" exitCode=0
Sep 11 16:36:53.668811 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:53.668306    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb" event={"ID":"0f7752f4-c367-4035-be14-79d2a4554421","Type":"ContainerDied","Data":"100b18458a38654ba5033c3ae71bc4397d3a3222aadacd3ac55597d615e822e9"}
Sep 11 16:36:53.668811 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:53.668398    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb" event={"ID":"0f7752f4-c367-4035-be14-79d2a4554421","Type":"ContainerStarted","Data":"01ebc00dbc240db4b40df3a863f6d50a2720b2efe36153f8f44becb8373f4f20"}
Sep 11 16:36:53.670136 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:53.670112    2557 generic.go:356] "Generic (PLEG): container finished" podID="011a5c8f-5f61-4334-9392-c3b744b0d9df" containerID="fabcad501fe1f6ba63f5ec037cdbcd12b7ebcfec6866c98034bc64cddc3eecd0" exitCode=0
Sep 11 16:36:53.670233 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:53.670151    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n" event={"ID":"011a5c8f-5f61-4334-9392-c3b744b0d9df","Type":"ContainerDied","Data":"fabcad501fe1f6ba63f5ec037cdbcd12b7ebcfec6866c98034bc64cddc3eecd0"}
Sep 11 16:36:53.670233 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:53.670191    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n" event={"ID":"011a5c8f-5f61-4334-9392-c3b744b0d9df","Type":"ContainerStarted","Data":"54eb80be6154fa4abed49392bb13b92d041061dfda9d6407b7217b3b0d497de9"}
Sep 11 16:36:53.671915 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:53.671892    2557 generic.go:356] "Generic (PLEG): container finished" podID="9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0" containerID="6f8103a8d04f46059d4a1fb4813658f51492ca72d6a0bbcc87c575266d232974" exitCode=0
Sep 11 16:36:53.672017 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:53.671985    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw" event={"ID":"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0","Type":"ContainerDied","Data":"6f8103a8d04f46059d4a1fb4813658f51492ca72d6a0bbcc87c575266d232974"}
Sep 11 16:36:53.672069 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:53.672031    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw" event={"ID":"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0","Type":"ContainerStarted","Data":"b548314faed08d18ba4a2458305f3498fccbc68fc036f0a4ef1d0d40c940d59e"}
Sep 11 16:36:53.673662 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:53.673643    2557 generic.go:356] "Generic (PLEG): container finished" podID="5040d909-28d3-4059-88d5-ba2b0361c3bb" containerID="ab9cce8d9aa177656546510861640e1c5ff27795e0da01cc0ad1f89997853df5" exitCode=0
Sep 11 16:36:53.673743 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:53.673678    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q" event={"ID":"5040d909-28d3-4059-88d5-ba2b0361c3bb","Type":"ContainerDied","Data":"ab9cce8d9aa177656546510861640e1c5ff27795e0da01cc0ad1f89997853df5"}
Sep 11 16:36:53.673743 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:53.673704    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q" event={"ID":"5040d909-28d3-4059-88d5-ba2b0361c3bb","Type":"ContainerStarted","Data":"76ea9b5bd5d30a5fc5b4b2fb8240d90bc6de11956a0385d1ee0e8b5074660e92"}
Sep 11 16:36:54.681529 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:54.681451    2557 generic.go:356] "Generic (PLEG): container finished" podID="9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0" containerID="f47babed2dd14268a0cb00a891fad8345d08e5c13caa224f217cd6620eb389c9" exitCode=0
Sep 11 16:36:54.681945 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:54.681529    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw" event={"ID":"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0","Type":"ContainerDied","Data":"f47babed2dd14268a0cb00a891fad8345d08e5c13caa224f217cd6620eb389c9"}
Sep 11 16:36:54.683522 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:54.683500    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb" event={"ID":"0f7752f4-c367-4035-be14-79d2a4554421","Type":"ContainerStarted","Data":"62acb94a94b29141b21fc5840dcd21a19e3e37d15556a6b8833918cf02621bcf"}
Sep 11 16:36:55.690399 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:55.690363    2557 generic.go:356] "Generic (PLEG): container finished" podID="9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0" containerID="0490e4986256a42b5e10abf39e3f95d4716967545c29aca266b63900a74a06e9" exitCode=0
Sep 11 16:36:55.690900 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:55.690435    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw" event={"ID":"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0","Type":"ContainerDied","Data":"0490e4986256a42b5e10abf39e3f95d4716967545c29aca266b63900a74a06e9"}
Sep 11 16:36:55.692245 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:55.692223    2557 generic.go:356] "Generic (PLEG): container finished" podID="5040d909-28d3-4059-88d5-ba2b0361c3bb" containerID="deaa5348776e3a205a17f215215374c3b3eda190e2d0bb62a0a86d7a65482849" exitCode=0
Sep 11 16:36:55.692361 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:55.692310    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q" event={"ID":"5040d909-28d3-4059-88d5-ba2b0361c3bb","Type":"ContainerDied","Data":"deaa5348776e3a205a17f215215374c3b3eda190e2d0bb62a0a86d7a65482849"}
Sep 11 16:36:55.694231 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:55.694214    2557 generic.go:356] "Generic (PLEG): container finished" podID="0f7752f4-c367-4035-be14-79d2a4554421" containerID="62acb94a94b29141b21fc5840dcd21a19e3e37d15556a6b8833918cf02621bcf" exitCode=0
Sep 11 16:36:55.694302 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:55.694284    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb" event={"ID":"0f7752f4-c367-4035-be14-79d2a4554421","Type":"ContainerDied","Data":"62acb94a94b29141b21fc5840dcd21a19e3e37d15556a6b8833918cf02621bcf"}
Sep 11 16:36:55.696336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:55.696316    2557 generic.go:356] "Generic (PLEG): container finished" podID="011a5c8f-5f61-4334-9392-c3b744b0d9df" containerID="990a0985e5085bcd683f933d7c98843c310d55e1e3c3ccb529f85a373084d025" exitCode=0
Sep 11 16:36:55.696415 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:55.696366    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n" event={"ID":"011a5c8f-5f61-4334-9392-c3b744b0d9df","Type":"ContainerDied","Data":"990a0985e5085bcd683f933d7c98843c310d55e1e3c3ccb529f85a373084d025"}
Sep 11 16:36:56.703467 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:56.703428    2557 generic.go:356] "Generic (PLEG): container finished" podID="5040d909-28d3-4059-88d5-ba2b0361c3bb" containerID="d12fc6d1be57990f78a4a9fcdba613a70c66c97471837400617e9513d9680bc9" exitCode=0
Sep 11 16:36:56.703947 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:56.703507    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q" event={"ID":"5040d909-28d3-4059-88d5-ba2b0361c3bb","Type":"ContainerDied","Data":"d12fc6d1be57990f78a4a9fcdba613a70c66c97471837400617e9513d9680bc9"}
Sep 11 16:36:56.705749 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:56.705727    2557 generic.go:356] "Generic (PLEG): container finished" podID="0f7752f4-c367-4035-be14-79d2a4554421" containerID="19a6abb3f0fb3c44882bdaf269d77397c91ef8ad426acd74ab7efb123505f302" exitCode=0
Sep 11 16:36:56.705850 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:56.705806    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb" event={"ID":"0f7752f4-c367-4035-be14-79d2a4554421","Type":"ContainerDied","Data":"19a6abb3f0fb3c44882bdaf269d77397c91ef8ad426acd74ab7efb123505f302"}
Sep 11 16:36:56.707883 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:56.707862    2557 generic.go:356] "Generic (PLEG): container finished" podID="011a5c8f-5f61-4334-9392-c3b744b0d9df" containerID="ece352f61343c78a011df2bc68d7942b71acd8eb9933040d11b0b79a5d886af4" exitCode=0
Sep 11 16:36:56.707990 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:56.707951    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n" event={"ID":"011a5c8f-5f61-4334-9392-c3b744b0d9df","Type":"ContainerDied","Data":"ece352f61343c78a011df2bc68d7942b71acd8eb9933040d11b0b79a5d886af4"}
Sep 11 16:36:56.841876 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:56.841850    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw"
Sep 11 16:36:56.892501 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:56.892470    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0-util\") pod \"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0\" (UID: \"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0\") "
Sep 11 16:36:56.892675 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:56.892521    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkbj6\" (UniqueName: \"kubernetes.io/projected/9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0-kube-api-access-hkbj6\") pod \"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0\" (UID: \"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0\") "
Sep 11 16:36:56.892675 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:56.892637    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0-bundle\") pod \"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0\" (UID: \"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0\") "
Sep 11 16:36:56.893411 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:56.893382    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0-bundle" (OuterVolumeSpecName: "bundle") pod "9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0" (UID: "9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:36:56.894676 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:56.894653    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0-kube-api-access-hkbj6" (OuterVolumeSpecName: "kube-api-access-hkbj6") pod "9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0" (UID: "9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0"). InnerVolumeSpecName "kube-api-access-hkbj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:36:56.897970 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:56.897948    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0-util" (OuterVolumeSpecName: "util") pod "9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0" (UID: "9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:36:56.994228 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:56.994136    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0-util\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:36:56.994228 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:56.994172    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkbj6\" (UniqueName: \"kubernetes.io/projected/9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0-kube-api-access-hkbj6\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:36:56.994228 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:56.994183    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0-bundle\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:36:57.714425 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:57.714395    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw"
Sep 11 16:36:57.714916 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:57.714427    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847apkwvw" event={"ID":"9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0","Type":"ContainerDied","Data":"b548314faed08d18ba4a2458305f3498fccbc68fc036f0a4ef1d0d40c940d59e"}
Sep 11 16:36:57.714916 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:57.714476    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b548314faed08d18ba4a2458305f3498fccbc68fc036f0a4ef1d0d40c940d59e"
Sep 11 16:36:57.880203 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:57.880178    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n"
Sep 11 16:36:57.882297 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:57.882274    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q"
Sep 11 16:36:57.911494 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:57.911469    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb"
Sep 11 16:36:58.002398 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.002311    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f7752f4-c367-4035-be14-79d2a4554421-util\") pod \"0f7752f4-c367-4035-be14-79d2a4554421\" (UID: \"0f7752f4-c367-4035-be14-79d2a4554421\") "
Sep 11 16:36:58.002398 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.002376    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/011a5c8f-5f61-4334-9392-c3b744b0d9df-util\") pod \"011a5c8f-5f61-4334-9392-c3b744b0d9df\" (UID: \"011a5c8f-5f61-4334-9392-c3b744b0d9df\") "
Sep 11 16:36:58.002398 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.002401    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5040d909-28d3-4059-88d5-ba2b0361c3bb-util\") pod \"5040d909-28d3-4059-88d5-ba2b0361c3bb\" (UID: \"5040d909-28d3-4059-88d5-ba2b0361c3bb\") "
Sep 11 16:36:58.002706 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.002424    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2qk2\" (UniqueName: \"kubernetes.io/projected/0f7752f4-c367-4035-be14-79d2a4554421-kube-api-access-g2qk2\") pod \"0f7752f4-c367-4035-be14-79d2a4554421\" (UID: \"0f7752f4-c367-4035-be14-79d2a4554421\") "
Sep 11 16:36:58.002706 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.002465    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f7752f4-c367-4035-be14-79d2a4554421-bundle\") pod \"0f7752f4-c367-4035-be14-79d2a4554421\" (UID: \"0f7752f4-c367-4035-be14-79d2a4554421\") "
Sep 11 16:36:58.002706 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.002532    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djf99\" (UniqueName: \"kubernetes.io/projected/5040d909-28d3-4059-88d5-ba2b0361c3bb-kube-api-access-djf99\") pod \"5040d909-28d3-4059-88d5-ba2b0361c3bb\" (UID: \"5040d909-28d3-4059-88d5-ba2b0361c3bb\") "
Sep 11 16:36:58.002706 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.002560    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5040d909-28d3-4059-88d5-ba2b0361c3bb-bundle\") pod \"5040d909-28d3-4059-88d5-ba2b0361c3bb\" (UID: \"5040d909-28d3-4059-88d5-ba2b0361c3bb\") "
Sep 11 16:36:58.002706 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.002591    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sj52s\" (UniqueName: \"kubernetes.io/projected/011a5c8f-5f61-4334-9392-c3b744b0d9df-kube-api-access-sj52s\") pod \"011a5c8f-5f61-4334-9392-c3b744b0d9df\" (UID: \"011a5c8f-5f61-4334-9392-c3b744b0d9df\") "
Sep 11 16:36:58.002706 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.002632    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/011a5c8f-5f61-4334-9392-c3b744b0d9df-bundle\") pod \"011a5c8f-5f61-4334-9392-c3b744b0d9df\" (UID: \"011a5c8f-5f61-4334-9392-c3b744b0d9df\") "
Sep 11 16:36:58.003287 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.003182    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5040d909-28d3-4059-88d5-ba2b0361c3bb-bundle" (OuterVolumeSpecName: "bundle") pod "5040d909-28d3-4059-88d5-ba2b0361c3bb" (UID: "5040d909-28d3-4059-88d5-ba2b0361c3bb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:36:58.003287 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.003217    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f7752f4-c367-4035-be14-79d2a4554421-bundle" (OuterVolumeSpecName: "bundle") pod "0f7752f4-c367-4035-be14-79d2a4554421" (UID: "0f7752f4-c367-4035-be14-79d2a4554421"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:36:58.003451 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.003423    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/011a5c8f-5f61-4334-9392-c3b744b0d9df-bundle" (OuterVolumeSpecName: "bundle") pod "011a5c8f-5f61-4334-9392-c3b744b0d9df" (UID: "011a5c8f-5f61-4334-9392-c3b744b0d9df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:36:58.004985 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.004957    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f7752f4-c367-4035-be14-79d2a4554421-kube-api-access-g2qk2" (OuterVolumeSpecName: "kube-api-access-g2qk2") pod "0f7752f4-c367-4035-be14-79d2a4554421" (UID: "0f7752f4-c367-4035-be14-79d2a4554421"). InnerVolumeSpecName "kube-api-access-g2qk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:36:58.005375 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.005348    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5040d909-28d3-4059-88d5-ba2b0361c3bb-kube-api-access-djf99" (OuterVolumeSpecName: "kube-api-access-djf99") pod "5040d909-28d3-4059-88d5-ba2b0361c3bb" (UID: "5040d909-28d3-4059-88d5-ba2b0361c3bb"). InnerVolumeSpecName "kube-api-access-djf99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:36:58.005504 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.005484    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/011a5c8f-5f61-4334-9392-c3b744b0d9df-kube-api-access-sj52s" (OuterVolumeSpecName: "kube-api-access-sj52s") pod "011a5c8f-5f61-4334-9392-c3b744b0d9df" (UID: "011a5c8f-5f61-4334-9392-c3b744b0d9df"). InnerVolumeSpecName "kube-api-access-sj52s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:36:58.008749 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.008727    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/011a5c8f-5f61-4334-9392-c3b744b0d9df-util" (OuterVolumeSpecName: "util") pod "011a5c8f-5f61-4334-9392-c3b744b0d9df" (UID: "011a5c8f-5f61-4334-9392-c3b744b0d9df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:36:58.009322 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.009303    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5040d909-28d3-4059-88d5-ba2b0361c3bb-util" (OuterVolumeSpecName: "util") pod "5040d909-28d3-4059-88d5-ba2b0361c3bb" (UID: "5040d909-28d3-4059-88d5-ba2b0361c3bb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:36:58.009385 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.009366    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f7752f4-c367-4035-be14-79d2a4554421-util" (OuterVolumeSpecName: "util") pod "0f7752f4-c367-4035-be14-79d2a4554421" (UID: "0f7752f4-c367-4035-be14-79d2a4554421"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:36:58.104010 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.103954    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/011a5c8f-5f61-4334-9392-c3b744b0d9df-util\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:36:58.104010 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.104002    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5040d909-28d3-4059-88d5-ba2b0361c3bb-util\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:36:58.104010 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.104012    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2qk2\" (UniqueName: \"kubernetes.io/projected/0f7752f4-c367-4035-be14-79d2a4554421-kube-api-access-g2qk2\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:36:58.104010 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.104022    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0f7752f4-c367-4035-be14-79d2a4554421-bundle\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:36:58.104257 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.104033    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djf99\" (UniqueName: \"kubernetes.io/projected/5040d909-28d3-4059-88d5-ba2b0361c3bb-kube-api-access-djf99\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:36:58.104257 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.104041    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5040d909-28d3-4059-88d5-ba2b0361c3bb-bundle\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:36:58.104257 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.104049    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sj52s\" (UniqueName: \"kubernetes.io/projected/011a5c8f-5f61-4334-9392-c3b744b0d9df-kube-api-access-sj52s\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:36:58.104257 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.104058    2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/011a5c8f-5f61-4334-9392-c3b744b0d9df-bundle\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:36:58.104257 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.104065    2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0f7752f4-c367-4035-be14-79d2a4554421-util\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:36:58.721340 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.721310    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb"
Sep 11 16:36:58.721340 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.721315    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6zxczb" event={"ID":"0f7752f4-c367-4035-be14-79d2a4554421","Type":"ContainerDied","Data":"01ebc00dbc240db4b40df3a863f6d50a2720b2efe36153f8f44becb8373f4f20"}
Sep 11 16:36:58.721896 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.721369    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01ebc00dbc240db4b40df3a863f6d50a2720b2efe36153f8f44becb8373f4f20"
Sep 11 16:36:58.723324 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.723302    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n"
Sep 11 16:36:58.723440 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.723334    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nv98n" event={"ID":"011a5c8f-5f61-4334-9392-c3b744b0d9df","Type":"ContainerDied","Data":"54eb80be6154fa4abed49392bb13b92d041061dfda9d6407b7217b3b0d497de9"}
Sep 11 16:36:58.723440 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.723379    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54eb80be6154fa4abed49392bb13b92d041061dfda9d6407b7217b3b0d497de9"
Sep 11 16:36:58.725362 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.725342    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q" event={"ID":"5040d909-28d3-4059-88d5-ba2b0361c3bb","Type":"ContainerDied","Data":"76ea9b5bd5d30a5fc5b4b2fb8240d90bc6de11956a0385d1ee0e8b5074660e92"}
Sep 11 16:36:58.725362 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.725366    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ck4z6q"
Sep 11 16:36:58.725509 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:36:58.725379    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76ea9b5bd5d30a5fc5b4b2fb8240d90bc6de11956a0385d1ee0e8b5074660e92"
Sep 11 16:37:01.518856 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.518819    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65d856b777-6d8c8"]
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519066    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5040d909-28d3-4059-88d5-ba2b0361c3bb" containerName="util"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519076    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5040d909-28d3-4059-88d5-ba2b0361c3bb" containerName="util"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519084    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="011a5c8f-5f61-4334-9392-c3b744b0d9df" containerName="pull"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519090    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="011a5c8f-5f61-4334-9392-c3b744b0d9df" containerName="pull"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519098    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f7752f4-c367-4035-be14-79d2a4554421" containerName="util"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519106    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f7752f4-c367-4035-be14-79d2a4554421" containerName="util"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519112    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="011a5c8f-5f61-4334-9392-c3b744b0d9df" containerName="extract"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519118    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="011a5c8f-5f61-4334-9392-c3b744b0d9df" containerName="extract"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519125    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f7752f4-c367-4035-be14-79d2a4554421" containerName="pull"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519130    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f7752f4-c367-4035-be14-79d2a4554421" containerName="pull"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519136    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0" containerName="extract"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519141    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0" containerName="extract"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519148    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0" containerName="pull"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519153    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0" containerName="pull"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519160    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="011a5c8f-5f61-4334-9392-c3b744b0d9df" containerName="util"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519165    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="011a5c8f-5f61-4334-9392-c3b744b0d9df" containerName="util"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519170    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5040d909-28d3-4059-88d5-ba2b0361c3bb" containerName="pull"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519175    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5040d909-28d3-4059-88d5-ba2b0361c3bb" containerName="pull"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519180    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5040d909-28d3-4059-88d5-ba2b0361c3bb" containerName="extract"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519185    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5040d909-28d3-4059-88d5-ba2b0361c3bb" containerName="extract"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519190    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f7752f4-c367-4035-be14-79d2a4554421" containerName="extract"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519195    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f7752f4-c367-4035-be14-79d2a4554421" containerName="extract"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519202    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0" containerName="util"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519208    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0" containerName="util"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519250    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ead9fd1-793d-4b7c-8a4d-72dd6be4f6b0" containerName="extract"
Sep 11 16:37:01.519246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519258    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5040d909-28d3-4059-88d5-ba2b0361c3bb" containerName="extract"
Sep 11 16:37:01.519985 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519264    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f7752f4-c367-4035-be14-79d2a4554421" containerName="extract"
Sep 11 16:37:01.519985 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.519269    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="011a5c8f-5f61-4334-9392-c3b744b0d9df" containerName="extract"
Sep 11 16:37:01.523376 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.523356    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.529921 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.529758    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 16:37:01.529921 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.529758    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 16:37:01.530258 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.530242    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 16:37:01.530838 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.530820    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 16:37:01.530991 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.530973    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-p2f27\""
Sep 11 16:37:01.532171 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.532156    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 16:37:01.532237 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.532202    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 16:37:01.532314 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.532297    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 16:37:01.534777 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.534758    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 16:37:01.542641 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.542600    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d856b777-6d8c8"]
Sep 11 16:37:01.631918 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.631878    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-oauth-serving-cert\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.631918 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.631915    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-service-ca\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.632135 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.631939    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb6zb\" (UniqueName: \"kubernetes.io/projected/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-kube-api-access-zb6zb\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.632135 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.632014    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-console-serving-cert\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.632135 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.632069    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-console-oauth-config\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.632135 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.632091    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-console-config\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.632135 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.632130    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-trusted-ca-bundle\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.732919 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.732868    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-oauth-serving-cert\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.732919 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.732918    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-service-ca\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.733115 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.733036    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb6zb\" (UniqueName: \"kubernetes.io/projected/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-kube-api-access-zb6zb\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.733115 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.733069    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-console-serving-cert\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.733115 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.733107    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-console-oauth-config\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.733214 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.733130    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-console-config\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.733214 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.733168    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-trusted-ca-bundle\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.733722 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.733688    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-oauth-serving-cert\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.733869 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.733733    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-service-ca\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.733939 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.733863    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-console-config\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.734001 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.733981    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-trusted-ca-bundle\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.735655 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.735632    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-console-oauth-config\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.735726 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.735635    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-console-serving-cert\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.743208 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.743181    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb6zb\" (UniqueName: \"kubernetes.io/projected/eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb-kube-api-access-zb6zb\") pod \"console-65d856b777-6d8c8\" (UID: \"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb\") " pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:01.833014 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:01.832917    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:02.117972 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:02.117934    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65d856b777-6d8c8"]
Sep 11 16:37:02.120231 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:37:02.120199    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeecdd074_33d6_4e9a_9c82_d9e1ce6cecbb.slice/crio-aa954f1c40a5247a3361a7505058574adbd5159bc290e4fdfbd4acccdf8972ce WatchSource:0}: Error finding container aa954f1c40a5247a3361a7505058574adbd5159bc290e4fdfbd4acccdf8972ce: Status 404 returned error can't find the container with id aa954f1c40a5247a3361a7505058574adbd5159bc290e4fdfbd4acccdf8972ce
Sep 11 16:37:02.752587 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:02.752548    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d856b777-6d8c8" event={"ID":"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb","Type":"ContainerStarted","Data":"b91dd7b6f3180bbea6a0d6a95589090ad3708c477e322e062260e1301ec735c1"}
Sep 11 16:37:02.753021 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:02.752616    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65d856b777-6d8c8" event={"ID":"eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb","Type":"ContainerStarted","Data":"aa954f1c40a5247a3361a7505058574adbd5159bc290e4fdfbd4acccdf8972ce"}
Sep 11 16:37:02.774768 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:02.774716    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65d856b777-6d8c8" podStartSLOduration=1.774698452 podStartE2EDuration="1.774698452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:37:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:37:02.773119989 +0000 UTC m=+442.391394159" watchObservedRunningTime="2026-09-11 16:37:02.774698452 +0000 UTC m=+442.392972621"
Sep 11 16:37:04.438627 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:04.438573    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hmsq8"]
Sep 11 16:37:04.441564 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:04.441545    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-hmsq8"
Sep 11 16:37:04.444642 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:04.444599    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 16:37:04.444783 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:04.444599    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 16:37:04.444783 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:04.444675    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-n2qc8\""
Sep 11 16:37:04.454835 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:04.454809    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hmsq8"]
Sep 11 16:37:04.557828 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:04.557789    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbgbt\" (UniqueName: \"kubernetes.io/projected/838b3bbe-08e9-4981-9464-11fbc8958f4d-kube-api-access-kbgbt\") pod \"authorino-operator-76b478bd78-hmsq8\" (UID: \"838b3bbe-08e9-4981-9464-11fbc8958f4d\") " pod="kuadrant-system/authorino-operator-76b478bd78-hmsq8"
Sep 11 16:37:04.658934 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:04.658897    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbgbt\" (UniqueName: \"kubernetes.io/projected/838b3bbe-08e9-4981-9464-11fbc8958f4d-kube-api-access-kbgbt\") pod \"authorino-operator-76b478bd78-hmsq8\" (UID: \"838b3bbe-08e9-4981-9464-11fbc8958f4d\") " pod="kuadrant-system/authorino-operator-76b478bd78-hmsq8"
Sep 11 16:37:04.692110 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:04.692028    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbgbt\" (UniqueName: \"kubernetes.io/projected/838b3bbe-08e9-4981-9464-11fbc8958f4d-kube-api-access-kbgbt\") pod \"authorino-operator-76b478bd78-hmsq8\" (UID: \"838b3bbe-08e9-4981-9464-11fbc8958f4d\") " pod="kuadrant-system/authorino-operator-76b478bd78-hmsq8"
Sep 11 16:37:04.752207 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:04.752169    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-hmsq8"
Sep 11 16:37:05.029020 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:05.028993    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hmsq8"]
Sep 11 16:37:05.029884 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:37:05.029854    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod838b3bbe_08e9_4981_9464_11fbc8958f4d.slice/crio-9add154fa839308be69694c057bd65c3a44e1423ce8565aa74f028ee2729c477 WatchSource:0}: Error finding container 9add154fa839308be69694c057bd65c3a44e1423ce8565aa74f028ee2729c477: Status 404 returned error can't find the container with id 9add154fa839308be69694c057bd65c3a44e1423ce8565aa74f028ee2729c477
Sep 11 16:37:05.769218 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:05.769180    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-hmsq8" event={"ID":"838b3bbe-08e9-4981-9464-11fbc8958f4d","Type":"ContainerStarted","Data":"9add154fa839308be69694c057bd65c3a44e1423ce8565aa74f028ee2729c477"}
Sep 11 16:37:08.784823 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:08.784784    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-hmsq8" event={"ID":"838b3bbe-08e9-4981-9464-11fbc8958f4d","Type":"ContainerStarted","Data":"3d9e6149c604dd0a05858cfe8e552487a32f071ce4f6036c598ebb10e38a2a39"}
Sep 11 16:37:08.785172 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:08.784869    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-hmsq8"
Sep 11 16:37:08.871592 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:08.871559    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"]
Sep 11 16:37:08.874754 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:08.874735    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:08.877942 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:08.877917    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hzxn5\""
Sep 11 16:37:08.878567 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:08.878515    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-hmsq8" podStartSLOduration=2.142396968 podStartE2EDuration="4.878499862s" totalImagesPullingTime="2.736102894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:37:08.874532195 +0000 UTC m=+448.492806366" watchObservedRunningTime="2026-09-11 16:37:08.878499862 +0000 UTC m=+448.496774031"
Sep 11 16:37:08.992797 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:08.992762    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51727141-377e-4152-bba2-41507264c0ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-784hj\" (UID: \"51727141-377e-4152-bba2-41507264c0ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:08.992968 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:08.992805    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh95z\" (UniqueName: \"kubernetes.io/projected/51727141-377e-4152-bba2-41507264c0ff-kube-api-access-vh95z\") pod \"kuadrant-operator-controller-manager-76f8f686bf-784hj\" (UID: \"51727141-377e-4152-bba2-41507264c0ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:09.003306 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:09.003269    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"]
Sep 11 16:37:09.093758 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:09.093658    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51727141-377e-4152-bba2-41507264c0ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-784hj\" (UID: \"51727141-377e-4152-bba2-41507264c0ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:09.093758 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:09.093699    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh95z\" (UniqueName: \"kubernetes.io/projected/51727141-377e-4152-bba2-41507264c0ff-kube-api-access-vh95z\") pod \"kuadrant-operator-controller-manager-76f8f686bf-784hj\" (UID: \"51727141-377e-4152-bba2-41507264c0ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:09.094186 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:09.094159    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51727141-377e-4152-bba2-41507264c0ff-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-784hj\" (UID: \"51727141-377e-4152-bba2-41507264c0ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:09.106690 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:09.106664    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh95z\" (UniqueName: \"kubernetes.io/projected/51727141-377e-4152-bba2-41507264c0ff-kube-api-access-vh95z\") pod \"kuadrant-operator-controller-manager-76f8f686bf-784hj\" (UID: \"51727141-377e-4152-bba2-41507264c0ff\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:09.185254 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:09.185200    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:09.479853 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:09.479827    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"]
Sep 11 16:37:09.482198 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:37:09.482169    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51727141_377e_4152_bba2_41507264c0ff.slice/crio-7de7afdcc09ac1f15165a35e0c7b1fa2346b691e0406a5614e696127de51a197 WatchSource:0}: Error finding container 7de7afdcc09ac1f15165a35e0c7b1fa2346b691e0406a5614e696127de51a197: Status 404 returned error can't find the container with id 7de7afdcc09ac1f15165a35e0c7b1fa2346b691e0406a5614e696127de51a197
Sep 11 16:37:09.791087 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:09.791048    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj" event={"ID":"51727141-377e-4152-bba2-41507264c0ff","Type":"ContainerStarted","Data":"7de7afdcc09ac1f15165a35e0c7b1fa2346b691e0406a5614e696127de51a197"}
Sep 11 16:37:11.063598 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:11.063563    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"]
Sep 11 16:37:11.067849 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:11.067830    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"
Sep 11 16:37:11.071559 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:11.071537    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-fsxzn\""
Sep 11 16:37:11.081229 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:11.081197    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"]
Sep 11 16:37:11.212947 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:11.212891    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22rmd\" (UniqueName: \"kubernetes.io/projected/d95b56c8-0489-4a94-ab58-ef0ffa95b654-kube-api-access-22rmd\") pod \"limitador-operator-controller-manager-74495c69f8-xb2tx\" (UID: \"d95b56c8-0489-4a94-ab58-ef0ffa95b654\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"
Sep 11 16:37:11.314313 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:11.314223    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22rmd\" (UniqueName: \"kubernetes.io/projected/d95b56c8-0489-4a94-ab58-ef0ffa95b654-kube-api-access-22rmd\") pod \"limitador-operator-controller-manager-74495c69f8-xb2tx\" (UID: \"d95b56c8-0489-4a94-ab58-ef0ffa95b654\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"
Sep 11 16:37:11.327226 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:11.327185    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22rmd\" (UniqueName: \"kubernetes.io/projected/d95b56c8-0489-4a94-ab58-ef0ffa95b654-kube-api-access-22rmd\") pod \"limitador-operator-controller-manager-74495c69f8-xb2tx\" (UID: \"d95b56c8-0489-4a94-ab58-ef0ffa95b654\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"
Sep 11 16:37:11.378143 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:11.378085    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"
Sep 11 16:37:11.659168 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:11.659142    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"]
Sep 11 16:37:11.661349 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:37:11.661313    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd95b56c8_0489_4a94_ab58_ef0ffa95b654.slice/crio-a5e2e9cd8167beeafa1748fea1795fb2844061dfbda33d806b814b3b51b5c3cd WatchSource:0}: Error finding container a5e2e9cd8167beeafa1748fea1795fb2844061dfbda33d806b814b3b51b5c3cd: Status 404 returned error can't find the container with id a5e2e9cd8167beeafa1748fea1795fb2844061dfbda33d806b814b3b51b5c3cd
Sep 11 16:37:11.801837 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:11.801803    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx" event={"ID":"d95b56c8-0489-4a94-ab58-ef0ffa95b654","Type":"ContainerStarted","Data":"a5e2e9cd8167beeafa1748fea1795fb2844061dfbda33d806b814b3b51b5c3cd"}
Sep 11 16:37:11.834083 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:11.834041    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:11.834272 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:11.834113    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:11.839152 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:11.839126    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:12.810251 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:12.810221    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65d856b777-6d8c8"
Sep 11 16:37:13.495322 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:13.495280    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-b4zpt"]
Sep 11 16:37:13.498639 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:13.498592    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-b4zpt"
Sep 11 16:37:13.502110 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:13.502082    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-fc8cq\""
Sep 11 16:37:13.502239 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:13.502140    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 16:37:13.512222 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:13.512196    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-b4zpt"]
Sep 11 16:37:13.629952 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:13.629896    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdk2c\" (UniqueName: \"kubernetes.io/projected/5b54ecb3-d19b-486d-b037-b9020676abfb-kube-api-access-zdk2c\") pod \"dns-operator-controller-manager-7b84cd7c9c-b4zpt\" (UID: \"5b54ecb3-d19b-486d-b037-b9020676abfb\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-b4zpt"
Sep 11 16:37:13.731178 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:13.731134    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdk2c\" (UniqueName: \"kubernetes.io/projected/5b54ecb3-d19b-486d-b037-b9020676abfb-kube-api-access-zdk2c\") pod \"dns-operator-controller-manager-7b84cd7c9c-b4zpt\" (UID: \"5b54ecb3-d19b-486d-b037-b9020676abfb\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-b4zpt"
Sep 11 16:37:13.742757 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:13.742724    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdk2c\" (UniqueName: \"kubernetes.io/projected/5b54ecb3-d19b-486d-b037-b9020676abfb-kube-api-access-zdk2c\") pod \"dns-operator-controller-manager-7b84cd7c9c-b4zpt\" (UID: \"5b54ecb3-d19b-486d-b037-b9020676abfb\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-b4zpt"
Sep 11 16:37:13.811403 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:13.811341    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-b4zpt"
Sep 11 16:37:14.139043 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:14.139016    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-b4zpt"]
Sep 11 16:37:14.140482 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:37:14.140451    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b54ecb3_d19b_486d_b037_b9020676abfb.slice/crio-bad3dbd1475946a8ab2703282d85568a66508623b7b09ce2c88f768e6680dc3e WatchSource:0}: Error finding container bad3dbd1475946a8ab2703282d85568a66508623b7b09ce2c88f768e6680dc3e: Status 404 returned error can't find the container with id bad3dbd1475946a8ab2703282d85568a66508623b7b09ce2c88f768e6680dc3e
Sep 11 16:37:14.818039 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:14.817998    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-b4zpt" event={"ID":"5b54ecb3-d19b-486d-b037-b9020676abfb","Type":"ContainerStarted","Data":"bad3dbd1475946a8ab2703282d85568a66508623b7b09ce2c88f768e6680dc3e"}
Sep 11 16:37:14.819617 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:14.819587    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx" event={"ID":"d95b56c8-0489-4a94-ab58-ef0ffa95b654","Type":"ContainerStarted","Data":"3ea9c1e966c108fe5bbbdc4d4cff40201149c4409e5141f380ed350cfde6f312"}
Sep 11 16:37:14.819740 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:14.819662    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"
Sep 11 16:37:14.843925 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:14.843875    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx" podStartSLOduration=1.576566493 podStartE2EDuration="3.843857734s" totalImagesPullingTime="2.267291241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:37:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:37:14.842956999 +0000 UTC m=+454.461231168" watchObservedRunningTime="2026-09-11 16:37:14.843857734 +0000 UTC m=+454.462131905"
Sep 11 16:37:16.830545 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:16.830509    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-b4zpt" event={"ID":"5b54ecb3-d19b-486d-b037-b9020676abfb","Type":"ContainerStarted","Data":"05acfd6975e2cb7cfd821f67a165ef795a3778c0203c808c136f9e5d8e52b956"}
Sep 11 16:37:16.830953 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:16.830662    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-b4zpt"
Sep 11 16:37:16.851351 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:16.851299    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-b4zpt" podStartSLOduration=2.154637096 podStartE2EDuration="3.851283471s" totalImagesPullingTime="1.696646375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:37:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:37:16.84974324 +0000 UTC m=+456.468017412" watchObservedRunningTime="2026-09-11 16:37:16.851283471 +0000 UTC m=+456.469557641"
Sep 11 16:37:19.793357 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:19.793324    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-hmsq8"
Sep 11 16:37:23.869420 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:23.869380    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj" event={"ID":"51727141-377e-4152-bba2-41507264c0ff","Type":"ContainerStarted","Data":"e24b781d1a12e4af35c263f02706361e7a706abd725850614eff7043dbe3fec6"}
Sep 11 16:37:23.869954 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:23.869506    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:23.894107 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:23.894053    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj" podStartSLOduration=2.004948435 podStartE2EDuration="15.894034868s" totalImagesPullingTime="13.889086433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:37:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:37:23.891084821 +0000 UTC m=+463.509358982" watchObservedRunningTime="2026-09-11 16:37:23.894034868 +0000 UTC m=+463.512309041"
Sep 11 16:37:25.827409 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:25.827375    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"
Sep 11 16:37:26.483250 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:26.483218    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-ksh97"]
Sep 11 16:37:26.486707 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:26.486684    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ksh97"
Sep 11 16:37:26.490097 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:26.490071    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qmcwz\""
Sep 11 16:37:26.491099 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:26.491073    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 11 16:37:26.491226 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:26.491101    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 11 16:37:26.497435 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:26.497410    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-ksh97"]
Sep 11 16:37:26.642226 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:26.642189    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-ksh97\" (UID: \"c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ksh97"
Sep 11 16:37:26.642226 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:26.642232    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-ksh97\" (UID: \"c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ksh97"
Sep 11 16:37:26.642454 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:26.642252    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92dqg\" (UniqueName: \"kubernetes.io/projected/c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc-kube-api-access-92dqg\") pod \"kuadrant-console-plugin-fbdd4f445-ksh97\" (UID: \"c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ksh97"
Sep 11 16:37:26.743420 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:26.743333    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-ksh97\" (UID: \"c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ksh97"
Sep 11 16:37:26.743420 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:26.743386    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-ksh97\" (UID: \"c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ksh97"
Sep 11 16:37:26.743420 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:26.743417    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92dqg\" (UniqueName: \"kubernetes.io/projected/c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc-kube-api-access-92dqg\") pod \"kuadrant-console-plugin-fbdd4f445-ksh97\" (UID: \"c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ksh97"
Sep 11 16:37:26.744144 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:26.744115    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-ksh97\" (UID: \"c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ksh97"
Sep 11 16:37:26.746260 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:26.746235    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-ksh97\" (UID: \"c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ksh97"
Sep 11 16:37:26.755306 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:26.755281    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92dqg\" (UniqueName: \"kubernetes.io/projected/c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc-kube-api-access-92dqg\") pod \"kuadrant-console-plugin-fbdd4f445-ksh97\" (UID: \"c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ksh97"
Sep 11 16:37:26.796232 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:26.796196    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ksh97"
Sep 11 16:37:27.074074 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:27.074049    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-ksh97"]
Sep 11 16:37:27.075314 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:37:27.075289    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc6fe5d3c_e8c9_4f89_8335_e7a177bcaefc.slice/crio-8f2ba028f0d58635708847c7f9676159d385186c19fba336dd7460548e0182bb WatchSource:0}: Error finding container 8f2ba028f0d58635708847c7f9676159d385186c19fba336dd7460548e0182bb: Status 404 returned error can't find the container with id 8f2ba028f0d58635708847c7f9676159d385186c19fba336dd7460548e0182bb
Sep 11 16:37:27.838075 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:27.838046    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-b4zpt"
Sep 11 16:37:27.888774 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:27.888732    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ksh97" event={"ID":"c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc","Type":"ContainerStarted","Data":"8f2ba028f0d58635708847c7f9676159d385186c19fba336dd7460548e0182bb"}
Sep 11 16:37:32.922062 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:32.921969    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ksh97" event={"ID":"c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc","Type":"ContainerStarted","Data":"25a7cc66d6c83d0f481e3358de51f7a03b51779a8fe010bf875fe10841dda3d5"}
Sep 11 16:37:32.943876 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:32.943820    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-ksh97" podStartSLOduration=1.463798648 podStartE2EDuration="6.943804662s" totalImagesPullingTime="5.480006014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:37:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:37:32.942914459 +0000 UTC m=+472.561188629" watchObservedRunningTime="2026-09-11 16:37:32.943804662 +0000 UTC m=+472.562078832"
Sep 11 16:37:34.876981 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:34.876940    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:37.324256 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.324214    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"]
Sep 11 16:37:37.324734 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.324439    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj" podUID="51727141-377e-4152-bba2-41507264c0ff" containerName="manager" containerID="cri-o://e24b781d1a12e4af35c263f02706361e7a706abd725850614eff7043dbe3fec6" gracePeriod=2
Sep 11 16:37:37.326422 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.326394    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"]
Sep 11 16:37:37.327495 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:37.327459    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-784hj\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="51727141-377e-4152-bba2-41507264c0ff" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:37.336667 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.336639    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"]
Sep 11 16:37:37.336956 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.336904    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx" podUID="d95b56c8-0489-4a94-ab58-ef0ffa95b654" containerName="manager" containerID="cri-o://3ea9c1e966c108fe5bbbdc4d4cff40201149c4409e5141f380ed350cfde6f312" gracePeriod=2
Sep 11 16:37:37.339188 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:37.339053    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-784hj\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="51727141-377e-4152-bba2-41507264c0ff" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:37.345802 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.345661    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"]
Sep 11 16:37:37.346847 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:37.346821    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xb2tx\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="d95b56c8-0489-4a94-ab58-ef0ffa95b654" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"
Sep 11 16:37:37.389333 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.389299    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ph7lp"]
Sep 11 16:37:37.389663 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.389647    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51727141-377e-4152-bba2-41507264c0ff" containerName="manager"
Sep 11 16:37:37.389724 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.389665    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="51727141-377e-4152-bba2-41507264c0ff" containerName="manager"
Sep 11 16:37:37.389724 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.389688    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d95b56c8-0489-4a94-ab58-ef0ffa95b654" containerName="manager"
Sep 11 16:37:37.389724 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.389693    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d95b56c8-0489-4a94-ab58-ef0ffa95b654" containerName="manager"
Sep 11 16:37:37.389816 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.389736    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d95b56c8-0489-4a94-ab58-ef0ffa95b654" containerName="manager"
Sep 11 16:37:37.389816 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.389745    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="51727141-377e-4152-bba2-41507264c0ff" containerName="manager"
Sep 11 16:37:37.392569 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.392549    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ph7lp"
Sep 11 16:37:37.401496 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:37.401452    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-784hj\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="51727141-377e-4152-bba2-41507264c0ff" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:37.407160 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:37.407123    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xb2tx\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="d95b56c8-0489-4a94-ab58-ef0ffa95b654" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"
Sep 11 16:37:37.411433 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.411406    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ph7lp"]
Sep 11 16:37:37.414969 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.414940    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx5sr\" (UniqueName: \"kubernetes.io/projected/96291f61-606e-4691-8b08-03359bb8f1e3-kube-api-access-sx5sr\") pod \"limitador-operator-controller-manager-74495c69f8-ph7lp\" (UID: \"96291f61-606e-4691-8b08-03359bb8f1e3\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ph7lp"
Sep 11 16:37:37.416500 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.416476    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x"]
Sep 11 16:37:37.419513 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.419494    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x"
Sep 11 16:37:37.470691 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:37.470483    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-784hj\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="51727141-377e-4152-bba2-41507264c0ff" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:37.473915 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:37.473678    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xb2tx\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="d95b56c8-0489-4a94-ab58-ef0ffa95b654" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"
Sep 11 16:37:37.474940 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.474915    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x"]
Sep 11 16:37:37.515582 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.515463    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9cv7\" (UniqueName: \"kubernetes.io/projected/35001c42-8650-4dd2-b7ce-61e67961740e-kube-api-access-x9cv7\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lqp8x\" (UID: \"35001c42-8650-4dd2-b7ce-61e67961740e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x"
Sep 11 16:37:37.515582 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.515530    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35001c42-8650-4dd2-b7ce-61e67961740e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lqp8x\" (UID: \"35001c42-8650-4dd2-b7ce-61e67961740e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x"
Sep 11 16:37:37.515942 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.515618    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx5sr\" (UniqueName: \"kubernetes.io/projected/96291f61-606e-4691-8b08-03359bb8f1e3-kube-api-access-sx5sr\") pod \"limitador-operator-controller-manager-74495c69f8-ph7lp\" (UID: \"96291f61-606e-4691-8b08-03359bb8f1e3\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ph7lp"
Sep 11 16:37:37.543797 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.543726    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx5sr\" (UniqueName: \"kubernetes.io/projected/96291f61-606e-4691-8b08-03359bb8f1e3-kube-api-access-sx5sr\") pod \"limitador-operator-controller-manager-74495c69f8-ph7lp\" (UID: \"96291f61-606e-4691-8b08-03359bb8f1e3\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ph7lp"
Sep 11 16:37:37.592469 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.592442    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:37.596686 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:37.596652    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-784hj\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="51727141-377e-4152-bba2-41507264c0ff" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:37.598876 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:37.598844    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xb2tx\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="d95b56c8-0489-4a94-ab58-ef0ffa95b654" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"
Sep 11 16:37:37.602290 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.602272    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"
Sep 11 16:37:37.607065 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:37.607040    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xb2tx\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="d95b56c8-0489-4a94-ab58-ef0ffa95b654" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"
Sep 11 16:37:37.611076 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:37.611055    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-784hj\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="51727141-377e-4152-bba2-41507264c0ff" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:37.616308 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.616291    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh95z\" (UniqueName: \"kubernetes.io/projected/51727141-377e-4152-bba2-41507264c0ff-kube-api-access-vh95z\") pod \"51727141-377e-4152-bba2-41507264c0ff\" (UID: \"51727141-377e-4152-bba2-41507264c0ff\") "
Sep 11 16:37:37.616385 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.616360    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51727141-377e-4152-bba2-41507264c0ff-extensions-socket-volume\") pod \"51727141-377e-4152-bba2-41507264c0ff\" (UID: \"51727141-377e-4152-bba2-41507264c0ff\") "
Sep 11 16:37:37.616385 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.616379    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22rmd\" (UniqueName: \"kubernetes.io/projected/d95b56c8-0489-4a94-ab58-ef0ffa95b654-kube-api-access-22rmd\") pod \"d95b56c8-0489-4a94-ab58-ef0ffa95b654\" (UID: \"d95b56c8-0489-4a94-ab58-ef0ffa95b654\") "
Sep 11 16:37:37.616487 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.616474    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9cv7\" (UniqueName: \"kubernetes.io/projected/35001c42-8650-4dd2-b7ce-61e67961740e-kube-api-access-x9cv7\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lqp8x\" (UID: \"35001c42-8650-4dd2-b7ce-61e67961740e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x"
Sep 11 16:37:37.616537 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.616518    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35001c42-8650-4dd2-b7ce-61e67961740e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lqp8x\" (UID: \"35001c42-8650-4dd2-b7ce-61e67961740e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x"
Sep 11 16:37:37.616884 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.616861    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35001c42-8650-4dd2-b7ce-61e67961740e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lqp8x\" (UID: \"35001c42-8650-4dd2-b7ce-61e67961740e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x"
Sep 11 16:37:37.616983 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.616925    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51727141-377e-4152-bba2-41507264c0ff-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "51727141-377e-4152-bba2-41507264c0ff" (UID: "51727141-377e-4152-bba2-41507264c0ff"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:37:37.618526 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.618505    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d95b56c8-0489-4a94-ab58-ef0ffa95b654-kube-api-access-22rmd" (OuterVolumeSpecName: "kube-api-access-22rmd") pod "d95b56c8-0489-4a94-ab58-ef0ffa95b654" (UID: "d95b56c8-0489-4a94-ab58-ef0ffa95b654"). InnerVolumeSpecName "kube-api-access-22rmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:37:37.618598 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.618533    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51727141-377e-4152-bba2-41507264c0ff-kube-api-access-vh95z" (OuterVolumeSpecName: "kube-api-access-vh95z") pod "51727141-377e-4152-bba2-41507264c0ff" (UID: "51727141-377e-4152-bba2-41507264c0ff"). InnerVolumeSpecName "kube-api-access-vh95z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:37:37.630690 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.630668    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9cv7\" (UniqueName: \"kubernetes.io/projected/35001c42-8650-4dd2-b7ce-61e67961740e-kube-api-access-x9cv7\") pod \"kuadrant-operator-controller-manager-76f8f686bf-lqp8x\" (UID: \"35001c42-8650-4dd2-b7ce-61e67961740e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x"
Sep 11 16:37:37.717390 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.717347    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51727141-377e-4152-bba2-41507264c0ff-extensions-socket-volume\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:37:37.717390 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.717382    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22rmd\" (UniqueName: \"kubernetes.io/projected/d95b56c8-0489-4a94-ab58-ef0ffa95b654-kube-api-access-22rmd\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:37:37.717390 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.717395    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh95z\" (UniqueName: \"kubernetes.io/projected/51727141-377e-4152-bba2-41507264c0ff-kube-api-access-vh95z\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:37:37.744515 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.744481    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ph7lp"
Sep 11 16:37:37.750617 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.750582    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x"
Sep 11 16:37:37.947957 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.947923    2557 generic.go:356] "Generic (PLEG): container finished" podID="d95b56c8-0489-4a94-ab58-ef0ffa95b654" containerID="3ea9c1e966c108fe5bbbdc4d4cff40201149c4409e5141f380ed350cfde6f312" exitCode=0
Sep 11 16:37:37.948124 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.947972    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"
Sep 11 16:37:37.948124 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.948023    2557 scope.go:117] "RemoveContainer" containerID="3ea9c1e966c108fe5bbbdc4d4cff40201149c4409e5141f380ed350cfde6f312"
Sep 11 16:37:37.949708 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.949677    2557 generic.go:356] "Generic (PLEG): container finished" podID="51727141-377e-4152-bba2-41507264c0ff" containerID="e24b781d1a12e4af35c263f02706361e7a706abd725850614eff7043dbe3fec6" exitCode=0
Sep 11 16:37:37.949807 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.949727    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:37.951088 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:37.951061    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-784hj\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="51727141-377e-4152-bba2-41507264c0ff" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:37.957051 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.957031    2557 scope.go:117] "RemoveContainer" containerID="3ea9c1e966c108fe5bbbdc4d4cff40201149c4409e5141f380ed350cfde6f312"
Sep 11 16:37:37.957351 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:37.957329    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ea9c1e966c108fe5bbbdc4d4cff40201149c4409e5141f380ed350cfde6f312\": container with ID starting with 3ea9c1e966c108fe5bbbdc4d4cff40201149c4409e5141f380ed350cfde6f312 not found: ID does not exist" containerID="3ea9c1e966c108fe5bbbdc4d4cff40201149c4409e5141f380ed350cfde6f312"
Sep 11 16:37:37.957434 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.957364    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ea9c1e966c108fe5bbbdc4d4cff40201149c4409e5141f380ed350cfde6f312"} err="failed to get container status \"3ea9c1e966c108fe5bbbdc4d4cff40201149c4409e5141f380ed350cfde6f312\": rpc error: code = NotFound desc = could not find container \"3ea9c1e966c108fe5bbbdc4d4cff40201149c4409e5141f380ed350cfde6f312\": container with ID starting with 3ea9c1e966c108fe5bbbdc4d4cff40201149c4409e5141f380ed350cfde6f312 not found: ID does not exist"
Sep 11 16:37:37.957434 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.957388    2557 scope.go:117] "RemoveContainer" containerID="e24b781d1a12e4af35c263f02706361e7a706abd725850614eff7043dbe3fec6"
Sep 11 16:37:37.959218 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:37.959195    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xb2tx\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="d95b56c8-0489-4a94-ab58-ef0ffa95b654" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"
Sep 11 16:37:37.961333 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:37.961303    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-784hj\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="51727141-377e-4152-bba2-41507264c0ff" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:37.963364 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:37.963338    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xb2tx\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="d95b56c8-0489-4a94-ab58-ef0ffa95b654" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"
Sep 11 16:37:37.965835 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.965816    2557 scope.go:117] "RemoveContainer" containerID="e24b781d1a12e4af35c263f02706361e7a706abd725850614eff7043dbe3fec6"
Sep 11 16:37:37.965935 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:37.965913    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-784hj\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="51727141-377e-4152-bba2-41507264c0ff" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-784hj"
Sep 11 16:37:37.966130 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:37.966111    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e24b781d1a12e4af35c263f02706361e7a706abd725850614eff7043dbe3fec6\": container with ID starting with e24b781d1a12e4af35c263f02706361e7a706abd725850614eff7043dbe3fec6 not found: ID does not exist" containerID="e24b781d1a12e4af35c263f02706361e7a706abd725850614eff7043dbe3fec6"
Sep 11 16:37:37.966175 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:37.966138    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e24b781d1a12e4af35c263f02706361e7a706abd725850614eff7043dbe3fec6"} err="failed to get container status \"e24b781d1a12e4af35c263f02706361e7a706abd725850614eff7043dbe3fec6\": rpc error: code = NotFound desc = could not find container \"e24b781d1a12e4af35c263f02706361e7a706abd725850614eff7043dbe3fec6\": container with ID starting with e24b781d1a12e4af35c263f02706361e7a706abd725850614eff7043dbe3fec6 not found: ID does not exist"
Sep 11 16:37:37.969011 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:37.968988    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-xb2tx\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="d95b56c8-0489-4a94-ab58-ef0ffa95b654" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-xb2tx"
Sep 11 16:37:38.040667 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:38.040623    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ph7lp"]
Sep 11 16:37:38.043002 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:38.042971    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x"]
Sep 11 16:37:38.043100 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:37:38.043052    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96291f61_606e_4691_8b08_03359bb8f1e3.slice/crio-0178011eeef2d50864e89ff4278c3a3976f6ca8cfeb81f893319d06942304386 WatchSource:0}: Error finding container 0178011eeef2d50864e89ff4278c3a3976f6ca8cfeb81f893319d06942304386: Status 404 returned error can't find the container with id 0178011eeef2d50864e89ff4278c3a3976f6ca8cfeb81f893319d06942304386
Sep 11 16:37:38.044427 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:37:38.044405    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35001c42_8650_4dd2_b7ce_61e67961740e.slice/crio-1a2c9bed002ac1505cc4b8ba98dd5976cb551583ed334e33142cc58b40d67a19 WatchSource:0}: Error finding container 1a2c9bed002ac1505cc4b8ba98dd5976cb551583ed334e33142cc58b40d67a19: Status 404 returned error can't find the container with id 1a2c9bed002ac1505cc4b8ba98dd5976cb551583ed334e33142cc58b40d67a19
Sep 11 16:37:38.946323 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:38.946287    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51727141-377e-4152-bba2-41507264c0ff" path="/var/lib/kubelet/pods/51727141-377e-4152-bba2-41507264c0ff/volumes"
Sep 11 16:37:38.946825 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:38.946783    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d95b56c8-0489-4a94-ab58-ef0ffa95b654" path="/var/lib/kubelet/pods/d95b56c8-0489-4a94-ab58-ef0ffa95b654/volumes"
Sep 11 16:37:38.959934 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:38.959902    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ph7lp" event={"ID":"96291f61-606e-4691-8b08-03359bb8f1e3","Type":"ContainerStarted","Data":"b10d3c280c88aec8fc574c310fdcf0c47836b12d8dd3da74b4566aef70c14dca"}
Sep 11 16:37:38.960140 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:38.959958    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ph7lp" event={"ID":"96291f61-606e-4691-8b08-03359bb8f1e3","Type":"ContainerStarted","Data":"0178011eeef2d50864e89ff4278c3a3976f6ca8cfeb81f893319d06942304386"}
Sep 11 16:37:38.960140 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:38.959990    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ph7lp"
Sep 11 16:37:38.961598 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:38.961573    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x" event={"ID":"35001c42-8650-4dd2-b7ce-61e67961740e","Type":"ContainerStarted","Data":"8b238a5e2d67d2fd06a74b511cd2c5f3a64c95a9f6569bdd9b75c5b1f42dc4c4"}
Sep 11 16:37:38.961755 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:38.961643    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x" event={"ID":"35001c42-8650-4dd2-b7ce-61e67961740e","Type":"ContainerStarted","Data":"1a2c9bed002ac1505cc4b8ba98dd5976cb551583ed334e33142cc58b40d67a19"}
Sep 11 16:37:38.961755 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:38.961682    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x"
Sep 11 16:37:38.991924 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:38.991872    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ph7lp" podStartSLOduration=1.991855174 podStartE2EDuration="1.991855174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:37:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:37:38.990743159 +0000 UTC m=+478.609017329" watchObservedRunningTime="2026-09-11 16:37:38.991855174 +0000 UTC m=+478.610129341"
Sep 11 16:37:39.025146 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:39.025089    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x" podStartSLOduration=2.025071953 podStartE2EDuration="2.025071953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:37:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:37:39.022106096 +0000 UTC m=+478.640380266" watchObservedRunningTime="2026-09-11 16:37:39.025071953 +0000 UTC m=+478.643346123"
Sep 11 16:37:49.968816 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:49.968779    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x"
Sep 11 16:37:49.969336 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:49.968867    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ph7lp"
Sep 11 16:37:55.180685 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:55.180644    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x"]
Sep 11 16:37:55.181700 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:55.181644    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x" podUID="35001c42-8650-4dd2-b7ce-61e67961740e" containerName="manager" containerID="cri-o://8b238a5e2d67d2fd06a74b511cd2c5f3a64c95a9f6569bdd9b75c5b1f42dc4c4" gracePeriod=10
Sep 11 16:37:55.431355 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:55.431295    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x"
Sep 11 16:37:55.448510 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:55.448473    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9cv7\" (UniqueName: \"kubernetes.io/projected/35001c42-8650-4dd2-b7ce-61e67961740e-kube-api-access-x9cv7\") pod \"35001c42-8650-4dd2-b7ce-61e67961740e\" (UID: \"35001c42-8650-4dd2-b7ce-61e67961740e\") "
Sep 11 16:37:55.448510 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:55.448512    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35001c42-8650-4dd2-b7ce-61e67961740e-extensions-socket-volume\") pod \"35001c42-8650-4dd2-b7ce-61e67961740e\" (UID: \"35001c42-8650-4dd2-b7ce-61e67961740e\") "
Sep 11 16:37:55.448919 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:55.448894    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35001c42-8650-4dd2-b7ce-61e67961740e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "35001c42-8650-4dd2-b7ce-61e67961740e" (UID: "35001c42-8650-4dd2-b7ce-61e67961740e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:37:55.450524 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:55.450497    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35001c42-8650-4dd2-b7ce-61e67961740e-kube-api-access-x9cv7" (OuterVolumeSpecName: "kube-api-access-x9cv7") pod "35001c42-8650-4dd2-b7ce-61e67961740e" (UID: "35001c42-8650-4dd2-b7ce-61e67961740e"). InnerVolumeSpecName "kube-api-access-x9cv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:37:55.549520 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:55.549476    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9cv7\" (UniqueName: \"kubernetes.io/projected/35001c42-8650-4dd2-b7ce-61e67961740e-kube-api-access-x9cv7\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:37:55.549520 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:55.549510    2557 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35001c42-8650-4dd2-b7ce-61e67961740e-extensions-socket-volume\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:37:56.050797 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:56.050756    2557 generic.go:356] "Generic (PLEG): container finished" podID="35001c42-8650-4dd2-b7ce-61e67961740e" containerID="8b238a5e2d67d2fd06a74b511cd2c5f3a64c95a9f6569bdd9b75c5b1f42dc4c4" exitCode=0
Sep 11 16:37:56.050988 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:56.050803    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x"
Sep 11 16:37:56.050988 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:56.050839    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x" event={"ID":"35001c42-8650-4dd2-b7ce-61e67961740e","Type":"ContainerDied","Data":"8b238a5e2d67d2fd06a74b511cd2c5f3a64c95a9f6569bdd9b75c5b1f42dc4c4"}
Sep 11 16:37:56.050988 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:56.050892    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x" event={"ID":"35001c42-8650-4dd2-b7ce-61e67961740e","Type":"ContainerDied","Data":"1a2c9bed002ac1505cc4b8ba98dd5976cb551583ed334e33142cc58b40d67a19"}
Sep 11 16:37:56.050988 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:56.050914    2557 scope.go:117] "RemoveContainer" containerID="8b238a5e2d67d2fd06a74b511cd2c5f3a64c95a9f6569bdd9b75c5b1f42dc4c4"
Sep 11 16:37:56.059965 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:56.059950    2557 scope.go:117] "RemoveContainer" containerID="8b238a5e2d67d2fd06a74b511cd2c5f3a64c95a9f6569bdd9b75c5b1f42dc4c4"
Sep 11 16:37:56.060232 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:37:56.060214    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b238a5e2d67d2fd06a74b511cd2c5f3a64c95a9f6569bdd9b75c5b1f42dc4c4\": container with ID starting with 8b238a5e2d67d2fd06a74b511cd2c5f3a64c95a9f6569bdd9b75c5b1f42dc4c4 not found: ID does not exist" containerID="8b238a5e2d67d2fd06a74b511cd2c5f3a64c95a9f6569bdd9b75c5b1f42dc4c4"
Sep 11 16:37:56.060280 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:56.060238    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b238a5e2d67d2fd06a74b511cd2c5f3a64c95a9f6569bdd9b75c5b1f42dc4c4"} err="failed to get container status \"8b238a5e2d67d2fd06a74b511cd2c5f3a64c95a9f6569bdd9b75c5b1f42dc4c4\": rpc error: code = NotFound desc = could not find container \"8b238a5e2d67d2fd06a74b511cd2c5f3a64c95a9f6569bdd9b75c5b1f42dc4c4\": container with ID starting with 8b238a5e2d67d2fd06a74b511cd2c5f3a64c95a9f6569bdd9b75c5b1f42dc4c4 not found: ID does not exist"
Sep 11 16:37:56.075357 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:56.075328    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x"]
Sep 11 16:37:56.092997 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:56.092964    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-lqp8x"]
Sep 11 16:37:56.944929 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:37:56.944898    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35001c42-8650-4dd2-b7ce-61e67961740e" path="/var/lib/kubelet/pods/35001c42-8650-4dd2-b7ce-61e67961740e/volumes"
Sep 11 16:38:11.643320 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.643284    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"]
Sep 11 16:38:11.643748 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.643578    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35001c42-8650-4dd2-b7ce-61e67961740e" containerName="manager"
Sep 11 16:38:11.643748 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.643589    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="35001c42-8650-4dd2-b7ce-61e67961740e" containerName="manager"
Sep 11 16:38:11.643748 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.643667    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="35001c42-8650-4dd2-b7ce-61e67961740e" containerName="manager"
Sep 11 16:38:11.659577 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.659544    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.667442 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.667420    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 16:38:11.667552 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.667457    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-mhbrz\""
Sep 11 16:38:11.676868 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.676833    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"]
Sep 11 16:38:11.778120 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.778071    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a86a6cec-b2d2-4385-acc2-6169e537a84f-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.778120 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.778124    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a86a6cec-b2d2-4385-acc2-6169e537a84f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.778361 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.778151    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a86a6cec-b2d2-4385-acc2-6169e537a84f-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.778361 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.778223    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a86a6cec-b2d2-4385-acc2-6169e537a84f-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.778361 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.778267    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a86a6cec-b2d2-4385-acc2-6169e537a84f-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.778361 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.778328    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a86a6cec-b2d2-4385-acc2-6169e537a84f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.778361 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.778343    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a86a6cec-b2d2-4385-acc2-6169e537a84f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.778361 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.778358    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr2q9\" (UniqueName: \"kubernetes.io/projected/a86a6cec-b2d2-4385-acc2-6169e537a84f-kube-api-access-vr2q9\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.778575 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.778380    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a86a6cec-b2d2-4385-acc2-6169e537a84f-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.879306 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.879262    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a86a6cec-b2d2-4385-acc2-6169e537a84f-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.879520 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.879318    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a86a6cec-b2d2-4385-acc2-6169e537a84f-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.879520 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.879355    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a86a6cec-b2d2-4385-acc2-6169e537a84f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.879520 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.879375    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a86a6cec-b2d2-4385-acc2-6169e537a84f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.879520 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.879398    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr2q9\" (UniqueName: \"kubernetes.io/projected/a86a6cec-b2d2-4385-acc2-6169e537a84f-kube-api-access-vr2q9\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.879520 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.879427    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a86a6cec-b2d2-4385-acc2-6169e537a84f-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.879520 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.879481    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a86a6cec-b2d2-4385-acc2-6169e537a84f-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.879520 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.879507    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a86a6cec-b2d2-4385-acc2-6169e537a84f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.879925 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.879534    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a86a6cec-b2d2-4385-acc2-6169e537a84f-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.879925 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.879783    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a86a6cec-b2d2-4385-acc2-6169e537a84f-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.879925 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.879824    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a86a6cec-b2d2-4385-acc2-6169e537a84f-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.879925 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.879872    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a86a6cec-b2d2-4385-acc2-6169e537a84f-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.880126 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.880055    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a86a6cec-b2d2-4385-acc2-6169e537a84f-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.880182 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.880133    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a86a6cec-b2d2-4385-acc2-6169e537a84f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.881960 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.881934    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a86a6cec-b2d2-4385-acc2-6169e537a84f-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.882071 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.881985    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a86a6cec-b2d2-4385-acc2-6169e537a84f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.892736 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.892713    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a86a6cec-b2d2-4385-acc2-6169e537a84f-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.894084 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.894032    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr2q9\" (UniqueName: \"kubernetes.io/projected/a86a6cec-b2d2-4385-acc2-6169e537a84f-kube-api-access-vr2q9\") pod \"maas-default-gateway-openshift-default-5ccb968c66-pxd9m\" (UID: \"a86a6cec-b2d2-4385-acc2-6169e537a84f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:11.970071 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:11.970026    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:12.266635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:12.266364    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"]
Sep 11 16:38:13.134950 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:13.134901    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m" event={"ID":"a86a6cec-b2d2-4385-acc2-6169e537a84f","Type":"ContainerStarted","Data":"0ed43f1f15dc34fd7ec9f77a2b3819dce93034c4413f12c8459a8c9c3eb3488b"}
Sep 11 16:38:14.942938 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:14.942893    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:38:14.943261 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:14.942966    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:38:14.943261 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:14.942994    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:38:15.147851 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:15.147811    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m" event={"ID":"a86a6cec-b2d2-4385-acc2-6169e537a84f","Type":"ContainerStarted","Data":"8d9f79b0074e8254310465d4754e1198eb0f67e24c4020570201193d5ec8cb62"}
Sep 11 16:38:15.174592 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:15.174530    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m" podStartSLOduration=1.503405739 podStartE2EDuration="4.174506444s" totalImagesPullingTime="2.671100705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:38:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:38:15.172067063 +0000 UTC m=+514.790341232" watchObservedRunningTime="2026-09-11 16:38:15.174506444 +0000 UTC m=+514.792780616"
Sep 11 16:38:15.970803 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:15.970772    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:15.975504 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:15.975478    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:16.152767 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:16.152736    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:16.153848 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:16.153825    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:38:16.258967 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:16.258880    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-2t28g"]
Sep 11 16:38:16.262301 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:16.262270    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-2t28g"
Sep 11 16:38:16.266276 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:16.266255    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 16:38:16.271504 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:16.271482    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-2t28g"]
Sep 11 16:38:16.317852 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:16.317817    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r9wc\" (UniqueName: \"kubernetes.io/projected/66d9c740-98a3-4adf-ba94-47ff7ecd8173-kube-api-access-5r9wc\") pod \"limitador-limitador-8588749977-2t28g\" (UID: \"66d9c740-98a3-4adf-ba94-47ff7ecd8173\") " pod="kuadrant-system/limitador-limitador-8588749977-2t28g"
Sep 11 16:38:16.317852 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:16.317858    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66d9c740-98a3-4adf-ba94-47ff7ecd8173-config-file\") pod \"limitador-limitador-8588749977-2t28g\" (UID: \"66d9c740-98a3-4adf-ba94-47ff7ecd8173\") " pod="kuadrant-system/limitador-limitador-8588749977-2t28g"
Sep 11 16:38:16.355782 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:16.355748    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-2t28g"]
Sep 11 16:38:16.419036 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:16.418993    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r9wc\" (UniqueName: \"kubernetes.io/projected/66d9c740-98a3-4adf-ba94-47ff7ecd8173-kube-api-access-5r9wc\") pod \"limitador-limitador-8588749977-2t28g\" (UID: \"66d9c740-98a3-4adf-ba94-47ff7ecd8173\") " pod="kuadrant-system/limitador-limitador-8588749977-2t28g"
Sep 11 16:38:16.419221 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:16.419042    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66d9c740-98a3-4adf-ba94-47ff7ecd8173-config-file\") pod \"limitador-limitador-8588749977-2t28g\" (UID: \"66d9c740-98a3-4adf-ba94-47ff7ecd8173\") " pod="kuadrant-system/limitador-limitador-8588749977-2t28g"
Sep 11 16:38:16.419740 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:16.419721    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66d9c740-98a3-4adf-ba94-47ff7ecd8173-config-file\") pod \"limitador-limitador-8588749977-2t28g\" (UID: \"66d9c740-98a3-4adf-ba94-47ff7ecd8173\") " pod="kuadrant-system/limitador-limitador-8588749977-2t28g"
Sep 11 16:38:16.428516 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:16.428490    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r9wc\" (UniqueName: \"kubernetes.io/projected/66d9c740-98a3-4adf-ba94-47ff7ecd8173-kube-api-access-5r9wc\") pod \"limitador-limitador-8588749977-2t28g\" (UID: \"66d9c740-98a3-4adf-ba94-47ff7ecd8173\") " pod="kuadrant-system/limitador-limitador-8588749977-2t28g"
Sep 11 16:38:16.573834 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:16.573791    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-2t28g"
Sep 11 16:38:16.853174 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:16.853149    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-2t28g"]
Sep 11 16:38:16.854835 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:38:16.854802    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66d9c740_98a3_4adf_ba94_47ff7ecd8173.slice/crio-65f428904ac7f30fad341a9aadfabd3f22f05c7250c294cdf2594352d96a1397 WatchSource:0}: Error finding container 65f428904ac7f30fad341a9aadfabd3f22f05c7250c294cdf2594352d96a1397: Status 404 returned error can't find the container with id 65f428904ac7f30fad341a9aadfabd3f22f05c7250c294cdf2594352d96a1397
Sep 11 16:38:17.158845 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:17.158761    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-2t28g" event={"ID":"66d9c740-98a3-4adf-ba94-47ff7ecd8173","Type":"ContainerStarted","Data":"65f428904ac7f30fad341a9aadfabd3f22f05c7250c294cdf2594352d96a1397"}
Sep 11 16:38:17.233483 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:17.233448    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-fzfxl"]
Sep 11 16:38:17.237901 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:17.237884    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-fzfxl"
Sep 11 16:38:17.241041 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:17.241021    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cjzvb\""
Sep 11 16:38:17.253200 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:17.253175    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-fzfxl"]
Sep 11 16:38:17.326573 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:17.326527    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdz8p\" (UniqueName: \"kubernetes.io/projected/e6e8c016-d7a8-488b-84c1-263f9449d616-kube-api-access-bdz8p\") pod \"authorino-7bcfd8f9cd-fzfxl\" (UID: \"e6e8c016-d7a8-488b-84c1-263f9449d616\") " pod="kuadrant-system/authorino-7bcfd8f9cd-fzfxl"
Sep 11 16:38:17.428017 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:17.427919    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdz8p\" (UniqueName: \"kubernetes.io/projected/e6e8c016-d7a8-488b-84c1-263f9449d616-kube-api-access-bdz8p\") pod \"authorino-7bcfd8f9cd-fzfxl\" (UID: \"e6e8c016-d7a8-488b-84c1-263f9449d616\") " pod="kuadrant-system/authorino-7bcfd8f9cd-fzfxl"
Sep 11 16:38:17.438485 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:17.438461    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdz8p\" (UniqueName: \"kubernetes.io/projected/e6e8c016-d7a8-488b-84c1-263f9449d616-kube-api-access-bdz8p\") pod \"authorino-7bcfd8f9cd-fzfxl\" (UID: \"e6e8c016-d7a8-488b-84c1-263f9449d616\") " pod="kuadrant-system/authorino-7bcfd8f9cd-fzfxl"
Sep 11 16:38:17.512320 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:17.512282    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-2v5qf"]
Sep 11 16:38:17.515750 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:17.515729    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-2v5qf"
Sep 11 16:38:17.524042 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:17.524014    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-2v5qf"]
Sep 11 16:38:17.547287 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:17.547251    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-fzfxl"
Sep 11 16:38:17.629944 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:17.629912    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lccxw\" (UniqueName: \"kubernetes.io/projected/a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3-kube-api-access-lccxw\") pod \"authorino-59c974bd48-2v5qf\" (UID: \"a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3\") " pod="kuadrant-system/authorino-59c974bd48-2v5qf"
Sep 11 16:38:17.731149 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:17.731067    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lccxw\" (UniqueName: \"kubernetes.io/projected/a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3-kube-api-access-lccxw\") pod \"authorino-59c974bd48-2v5qf\" (UID: \"a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3\") " pod="kuadrant-system/authorino-59c974bd48-2v5qf"
Sep 11 16:38:17.741064 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:17.741036    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lccxw\" (UniqueName: \"kubernetes.io/projected/a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3-kube-api-access-lccxw\") pod \"authorino-59c974bd48-2v5qf\" (UID: \"a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3\") " pod="kuadrant-system/authorino-59c974bd48-2v5qf"
Sep 11 16:38:17.821714 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:17.821688    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-fzfxl"]
Sep 11 16:38:17.823351 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:38:17.823323    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6e8c016_d7a8_488b_84c1_263f9449d616.slice/crio-f58faedb4940c1ec89d311dce4cc5206df236ca23d40771a58189ef9a88c4f47 WatchSource:0}: Error finding container f58faedb4940c1ec89d311dce4cc5206df236ca23d40771a58189ef9a88c4f47: Status 404 returned error can't find the container with id f58faedb4940c1ec89d311dce4cc5206df236ca23d40771a58189ef9a88c4f47
Sep 11 16:38:17.825233 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:17.825206    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-2v5qf"
Sep 11 16:38:18.098739 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:18.098714    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-2v5qf"]
Sep 11 16:38:18.166194 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:18.166146    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-fzfxl" event={"ID":"e6e8c016-d7a8-488b-84c1-263f9449d616","Type":"ContainerStarted","Data":"f58faedb4940c1ec89d311dce4cc5206df236ca23d40771a58189ef9a88c4f47"}
Sep 11 16:38:18.273919 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:38:18.273875    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9f0e0f2_8fe5_4a32_a8b3_50a8b1b234a3.slice/crio-e4b86cba2e10f265cbe0c7b9e5773cf071e3b99f29202582aef168eb60b4d122 WatchSource:0}: Error finding container e4b86cba2e10f265cbe0c7b9e5773cf071e3b99f29202582aef168eb60b4d122: Status 404 returned error can't find the container with id e4b86cba2e10f265cbe0c7b9e5773cf071e3b99f29202582aef168eb60b4d122
Sep 11 16:38:19.173079 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:19.173038    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-2v5qf" event={"ID":"a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3","Type":"ContainerStarted","Data":"e4b86cba2e10f265cbe0c7b9e5773cf071e3b99f29202582aef168eb60b4d122"}
Sep 11 16:38:19.174670 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:19.174643    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-2t28g" event={"ID":"66d9c740-98a3-4adf-ba94-47ff7ecd8173","Type":"ContainerStarted","Data":"4032a6de25335addbcba5b0a2f0f1c94beedfc6f645d5f9cf65185ca706995e3"}
Sep 11 16:38:19.174797 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:19.174702    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-2t28g"
Sep 11 16:38:19.196716 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:19.196662    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-2t28g" podStartSLOduration=1.72110395 podStartE2EDuration="3.196646651s" totalImagesPullingTime="1.475542701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:38:19.195184659 +0000 UTC m=+518.813458829" watchObservedRunningTime="2026-09-11 16:38:19.196646651 +0000 UTC m=+518.814920815"
Sep 11 16:38:21.190371 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:21.190331    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-2v5qf" event={"ID":"a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3","Type":"ContainerStarted","Data":"f859c436daf20ec4625a731a81bda21cbb96034127e83f4d7dc6473c637f1ba3"}
Sep 11 16:38:21.217001 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:21.216946    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-2v5qf" podStartSLOduration=2.375410229 podStartE2EDuration="4.216928908s" totalImagesPullingTime="1.841518679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:38:21.216192052 +0000 UTC m=+520.834466221" watchObservedRunningTime="2026-09-11 16:38:21.216928908 +0000 UTC m=+520.835203078"
Sep 11 16:38:21.258443 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:21.258409    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-fzfxl"]
Sep 11 16:38:28.231674 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:28.231635    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-fzfxl" event={"ID":"e6e8c016-d7a8-488b-84c1-263f9449d616","Type":"ContainerStarted","Data":"0c491aed031eaad805d8f3a351100f3a3ec9ac0cc8a88455c1f4735dd755b613"}
Sep 11 16:38:28.232163 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:28.231742    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-fzfxl" podUID="e6e8c016-d7a8-488b-84c1-263f9449d616" containerName="authorino" containerID="cri-o://0c491aed031eaad805d8f3a351100f3a3ec9ac0cc8a88455c1f4735dd755b613" gracePeriod=30
Sep 11 16:38:28.248826 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:28.248755    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-fzfxl" podStartSLOduration=1.744310344 podStartE2EDuration="11.248738999s" totalImagesPullingTime="9.504428655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:38:28.247468015 +0000 UTC m=+527.865742186" watchObservedRunningTime="2026-09-11 16:38:28.248738999 +0000 UTC m=+527.867013169"
Sep 11 16:38:28.479051 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:28.479021    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-fzfxl"
Sep 11 16:38:28.631891 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:28.631847    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdz8p\" (UniqueName: \"kubernetes.io/projected/e6e8c016-d7a8-488b-84c1-263f9449d616-kube-api-access-bdz8p\") pod \"e6e8c016-d7a8-488b-84c1-263f9449d616\" (UID: \"e6e8c016-d7a8-488b-84c1-263f9449d616\") "
Sep 11 16:38:28.633962 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:28.633935    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6e8c016-d7a8-488b-84c1-263f9449d616-kube-api-access-bdz8p" (OuterVolumeSpecName: "kube-api-access-bdz8p") pod "e6e8c016-d7a8-488b-84c1-263f9449d616" (UID: "e6e8c016-d7a8-488b-84c1-263f9449d616"). InnerVolumeSpecName "kube-api-access-bdz8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:38:28.732902 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:28.732855    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdz8p\" (UniqueName: \"kubernetes.io/projected/e6e8c016-d7a8-488b-84c1-263f9449d616-kube-api-access-bdz8p\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:38:29.238409 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:29.238313    2557 generic.go:356] "Generic (PLEG): container finished" podID="e6e8c016-d7a8-488b-84c1-263f9449d616" containerID="0c491aed031eaad805d8f3a351100f3a3ec9ac0cc8a88455c1f4735dd755b613" exitCode=0
Sep 11 16:38:29.238409 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:29.238356    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-fzfxl"
Sep 11 16:38:29.238409 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:29.238355    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-fzfxl" event={"ID":"e6e8c016-d7a8-488b-84c1-263f9449d616","Type":"ContainerDied","Data":"0c491aed031eaad805d8f3a351100f3a3ec9ac0cc8a88455c1f4735dd755b613"}
Sep 11 16:38:29.238409 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:29.238400    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-fzfxl" event={"ID":"e6e8c016-d7a8-488b-84c1-263f9449d616","Type":"ContainerDied","Data":"f58faedb4940c1ec89d311dce4cc5206df236ca23d40771a58189ef9a88c4f47"}
Sep 11 16:38:29.238981 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:29.238422    2557 scope.go:117] "RemoveContainer" containerID="0c491aed031eaad805d8f3a351100f3a3ec9ac0cc8a88455c1f4735dd755b613"
Sep 11 16:38:29.246873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:29.246853    2557 scope.go:117] "RemoveContainer" containerID="0c491aed031eaad805d8f3a351100f3a3ec9ac0cc8a88455c1f4735dd755b613"
Sep 11 16:38:29.247163 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:38:29.247143    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c491aed031eaad805d8f3a351100f3a3ec9ac0cc8a88455c1f4735dd755b613\": container with ID starting with 0c491aed031eaad805d8f3a351100f3a3ec9ac0cc8a88455c1f4735dd755b613 not found: ID does not exist" containerID="0c491aed031eaad805d8f3a351100f3a3ec9ac0cc8a88455c1f4735dd755b613"
Sep 11 16:38:29.247242 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:29.247169    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c491aed031eaad805d8f3a351100f3a3ec9ac0cc8a88455c1f4735dd755b613"} err="failed to get container status \"0c491aed031eaad805d8f3a351100f3a3ec9ac0cc8a88455c1f4735dd755b613\": rpc error: code = NotFound desc = could not find container \"0c491aed031eaad805d8f3a351100f3a3ec9ac0cc8a88455c1f4735dd755b613\": container with ID starting with 0c491aed031eaad805d8f3a351100f3a3ec9ac0cc8a88455c1f4735dd755b613 not found: ID does not exist"
Sep 11 16:38:29.273635 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:29.273588    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-fzfxl"]
Sep 11 16:38:29.280068 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:29.280038    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-fzfxl"]
Sep 11 16:38:30.183425 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:30.183396    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-2t28g"
Sep 11 16:38:30.389551 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:30.389513    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-2t28g"]
Sep 11 16:38:30.389981 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:30.389716    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-2t28g" podUID="66d9c740-98a3-4adf-ba94-47ff7ecd8173" containerName="limitador" containerID="cri-o://4032a6de25335addbcba5b0a2f0f1c94beedfc6f645d5f9cf65185ca706995e3" gracePeriod=30
Sep 11 16:38:30.939247 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:30.939214    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-2t28g"
Sep 11 16:38:30.945453 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:30.945424    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6e8c016-d7a8-488b-84c1-263f9449d616" path="/var/lib/kubelet/pods/e6e8c016-d7a8-488b-84c1-263f9449d616/volumes"
Sep 11 16:38:31.055543 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:31.055508    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66d9c740-98a3-4adf-ba94-47ff7ecd8173-config-file\") pod \"66d9c740-98a3-4adf-ba94-47ff7ecd8173\" (UID: \"66d9c740-98a3-4adf-ba94-47ff7ecd8173\") "
Sep 11 16:38:31.055709 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:31.055651    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5r9wc\" (UniqueName: \"kubernetes.io/projected/66d9c740-98a3-4adf-ba94-47ff7ecd8173-kube-api-access-5r9wc\") pod \"66d9c740-98a3-4adf-ba94-47ff7ecd8173\" (UID: \"66d9c740-98a3-4adf-ba94-47ff7ecd8173\") "
Sep 11 16:38:31.055972 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:31.055942    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66d9c740-98a3-4adf-ba94-47ff7ecd8173-config-file" (OuterVolumeSpecName: "config-file") pod "66d9c740-98a3-4adf-ba94-47ff7ecd8173" (UID: "66d9c740-98a3-4adf-ba94-47ff7ecd8173"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:38:31.057775 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:31.057751    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66d9c740-98a3-4adf-ba94-47ff7ecd8173-kube-api-access-5r9wc" (OuterVolumeSpecName: "kube-api-access-5r9wc") pod "66d9c740-98a3-4adf-ba94-47ff7ecd8173" (UID: "66d9c740-98a3-4adf-ba94-47ff7ecd8173"). InnerVolumeSpecName "kube-api-access-5r9wc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:38:31.156483 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:31.156441    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5r9wc\" (UniqueName: \"kubernetes.io/projected/66d9c740-98a3-4adf-ba94-47ff7ecd8173-kube-api-access-5r9wc\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:38:31.156483 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:31.156475    2557 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/66d9c740-98a3-4adf-ba94-47ff7ecd8173-config-file\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:38:31.249991 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:31.249957    2557 generic.go:356] "Generic (PLEG): container finished" podID="66d9c740-98a3-4adf-ba94-47ff7ecd8173" containerID="4032a6de25335addbcba5b0a2f0f1c94beedfc6f645d5f9cf65185ca706995e3" exitCode=0
Sep 11 16:38:31.250142 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:31.249997    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-2t28g"
Sep 11 16:38:31.250142 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:31.250034    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-2t28g" event={"ID":"66d9c740-98a3-4adf-ba94-47ff7ecd8173","Type":"ContainerDied","Data":"4032a6de25335addbcba5b0a2f0f1c94beedfc6f645d5f9cf65185ca706995e3"}
Sep 11 16:38:31.250142 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:31.250078    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-2t28g" event={"ID":"66d9c740-98a3-4adf-ba94-47ff7ecd8173","Type":"ContainerDied","Data":"65f428904ac7f30fad341a9aadfabd3f22f05c7250c294cdf2594352d96a1397"}
Sep 11 16:38:31.250142 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:31.250100    2557 scope.go:117] "RemoveContainer" containerID="4032a6de25335addbcba5b0a2f0f1c94beedfc6f645d5f9cf65185ca706995e3"
Sep 11 16:38:31.258901 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:31.258881    2557 scope.go:117] "RemoveContainer" containerID="4032a6de25335addbcba5b0a2f0f1c94beedfc6f645d5f9cf65185ca706995e3"
Sep 11 16:38:31.259176 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:38:31.259156    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4032a6de25335addbcba5b0a2f0f1c94beedfc6f645d5f9cf65185ca706995e3\": container with ID starting with 4032a6de25335addbcba5b0a2f0f1c94beedfc6f645d5f9cf65185ca706995e3 not found: ID does not exist" containerID="4032a6de25335addbcba5b0a2f0f1c94beedfc6f645d5f9cf65185ca706995e3"
Sep 11 16:38:31.259251 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:31.259182    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4032a6de25335addbcba5b0a2f0f1c94beedfc6f645d5f9cf65185ca706995e3"} err="failed to get container status \"4032a6de25335addbcba5b0a2f0f1c94beedfc6f645d5f9cf65185ca706995e3\": rpc error: code = NotFound desc = could not find container \"4032a6de25335addbcba5b0a2f0f1c94beedfc6f645d5f9cf65185ca706995e3\": container with ID starting with 4032a6de25335addbcba5b0a2f0f1c94beedfc6f645d5f9cf65185ca706995e3 not found: ID does not exist"
Sep 11 16:38:31.274306 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:31.274279    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-2t28g"]
Sep 11 16:38:31.279216 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:31.279185    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-2t28g"]
Sep 11 16:38:32.834028 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:32.833991    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hvpn8"]
Sep 11 16:38:32.834423 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:32.834325    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66d9c740-98a3-4adf-ba94-47ff7ecd8173" containerName="limitador"
Sep 11 16:38:32.834423 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:32.834340    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="66d9c740-98a3-4adf-ba94-47ff7ecd8173" containerName="limitador"
Sep 11 16:38:32.834423 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:32.834359    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6e8c016-d7a8-488b-84c1-263f9449d616" containerName="authorino"
Sep 11 16:38:32.834423 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:32.834365    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6e8c016-d7a8-488b-84c1-263f9449d616" containerName="authorino"
Sep 11 16:38:32.834423 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:32.834414    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="66d9c740-98a3-4adf-ba94-47ff7ecd8173" containerName="limitador"
Sep 11 16:38:32.834580 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:32.834427    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6e8c016-d7a8-488b-84c1-263f9449d616" containerName="authorino"
Sep 11 16:38:32.838560 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:32.838542    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvpn8"
Sep 11 16:38:32.841167 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:32.841141    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 16:38:32.841432 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:32.841415    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:38:32.841523 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:32.841503    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 11 16:38:32.842347 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:32.842330    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-qgqm5\""
Sep 11 16:38:32.865457 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:32.865427    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hvpn8"]
Sep 11 16:38:32.945568 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:32.945489    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66d9c740-98a3-4adf-ba94-47ff7ecd8173" path="/var/lib/kubelet/pods/66d9c740-98a3-4adf-ba94-47ff7ecd8173/volumes"
Sep 11 16:38:32.971984 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:32.971956    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz9s6\" (UniqueName: \"kubernetes.io/projected/f4f6e02c-775f-4fcf-8b53-164ad8871b5d-kube-api-access-jz9s6\") pod \"postgres-69fb4594cf-hvpn8\" (UID: \"f4f6e02c-775f-4fcf-8b53-164ad8871b5d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvpn8"
Sep 11 16:38:32.972138 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:32.972007    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f4f6e02c-775f-4fcf-8b53-164ad8871b5d-data\") pod \"postgres-69fb4594cf-hvpn8\" (UID: \"f4f6e02c-775f-4fcf-8b53-164ad8871b5d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvpn8"
Sep 11 16:38:33.073305 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:33.073255    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f4f6e02c-775f-4fcf-8b53-164ad8871b5d-data\") pod \"postgres-69fb4594cf-hvpn8\" (UID: \"f4f6e02c-775f-4fcf-8b53-164ad8871b5d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvpn8"
Sep 11 16:38:33.073443 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:33.073350    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz9s6\" (UniqueName: \"kubernetes.io/projected/f4f6e02c-775f-4fcf-8b53-164ad8871b5d-kube-api-access-jz9s6\") pod \"postgres-69fb4594cf-hvpn8\" (UID: \"f4f6e02c-775f-4fcf-8b53-164ad8871b5d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvpn8"
Sep 11 16:38:33.073718 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:33.073699    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f4f6e02c-775f-4fcf-8b53-164ad8871b5d-data\") pod \"postgres-69fb4594cf-hvpn8\" (UID: \"f4f6e02c-775f-4fcf-8b53-164ad8871b5d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvpn8"
Sep 11 16:38:33.083728 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:33.083702    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz9s6\" (UniqueName: \"kubernetes.io/projected/f4f6e02c-775f-4fcf-8b53-164ad8871b5d-kube-api-access-jz9s6\") pod \"postgres-69fb4594cf-hvpn8\" (UID: \"f4f6e02c-775f-4fcf-8b53-164ad8871b5d\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvpn8"
Sep 11 16:38:33.148688 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:33.148577    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvpn8"
Sep 11 16:38:33.424257 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:33.424231    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hvpn8"]
Sep 11 16:38:33.426073 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:38:33.426047    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4f6e02c_775f_4fcf_8b53_164ad8871b5d.slice/crio-78d06e7cf1c6e872ab33e0e04f25f4473108dcce19100d54e764edd1ac1db04c WatchSource:0}: Error finding container 78d06e7cf1c6e872ab33e0e04f25f4473108dcce19100d54e764edd1ac1db04c: Status 404 returned error can't find the container with id 78d06e7cf1c6e872ab33e0e04f25f4473108dcce19100d54e764edd1ac1db04c
Sep 11 16:38:34.271057 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:34.271011    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvpn8" event={"ID":"f4f6e02c-775f-4fcf-8b53-164ad8871b5d","Type":"ContainerStarted","Data":"78d06e7cf1c6e872ab33e0e04f25f4473108dcce19100d54e764edd1ac1db04c"}
Sep 11 16:38:36.284166 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:36.284130    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvpn8" event={"ID":"f4f6e02c-775f-4fcf-8b53-164ad8871b5d","Type":"ContainerStarted","Data":"9143901bf803f7603ddd3f73a5af00f811f9a5b5a096c5dff1f309edc2848257"}
Sep 11 16:38:36.284540 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:36.284208    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvpn8"
Sep 11 16:38:36.318657 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:36.318590    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvpn8" podStartSLOduration=2.201091147 podStartE2EDuration="4.318573772s" totalImagesPullingTime="2.117482625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:38:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:38:36.315930438 +0000 UTC m=+535.934204608" watchObservedRunningTime="2026-09-11 16:38:36.318573772 +0000 UTC m=+535.936847943"
Sep 11 16:38:42.322274 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:42.322242    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvpn8"
Sep 11 16:38:42.956566 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:42.956532    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-8dpwt"]
Sep 11 16:38:42.963078 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:42.963059    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-8dpwt"
Sep 11 16:38:42.968977 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:42.968949    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-8dpwt"]
Sep 11 16:38:43.051889 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.051851    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgzhj\" (UniqueName: \"kubernetes.io/projected/cd8cbfbb-7b1d-4253-b229-820aa5954597-kube-api-access-bgzhj\") pod \"authorino-557f876f69-8dpwt\" (UID: \"cd8cbfbb-7b1d-4253-b229-820aa5954597\") " pod="kuadrant-system/authorino-557f876f69-8dpwt"
Sep 11 16:38:43.083632 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.083570    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-8dpwt"]
Sep 11 16:38:43.083866 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:38:43.083847    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-bgzhj], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-8dpwt" podUID="cd8cbfbb-7b1d-4253-b229-820aa5954597"
Sep 11 16:38:43.114054 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.114019    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-v5q8t"]
Sep 11 16:38:43.118177 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.118154    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-v5q8t"
Sep 11 16:38:43.120885 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.120862    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 11 16:38:43.132841 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.132816    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-v5q8t"]
Sep 11 16:38:43.152430 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.152394    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0327d04f-f889-442e-a345-bc427a12e720-tls-cert\") pod \"authorino-6d4dfc649f-v5q8t\" (UID: \"0327d04f-f889-442e-a345-bc427a12e720\") " pod="kuadrant-system/authorino-6d4dfc649f-v5q8t"
Sep 11 16:38:43.152584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.152473    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxg5f\" (UniqueName: \"kubernetes.io/projected/0327d04f-f889-442e-a345-bc427a12e720-kube-api-access-kxg5f\") pod \"authorino-6d4dfc649f-v5q8t\" (UID: \"0327d04f-f889-442e-a345-bc427a12e720\") " pod="kuadrant-system/authorino-6d4dfc649f-v5q8t"
Sep 11 16:38:43.152681 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.152574    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgzhj\" (UniqueName: \"kubernetes.io/projected/cd8cbfbb-7b1d-4253-b229-820aa5954597-kube-api-access-bgzhj\") pod \"authorino-557f876f69-8dpwt\" (UID: \"cd8cbfbb-7b1d-4253-b229-820aa5954597\") " pod="kuadrant-system/authorino-557f876f69-8dpwt"
Sep 11 16:38:43.163947 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.163920    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgzhj\" (UniqueName: \"kubernetes.io/projected/cd8cbfbb-7b1d-4253-b229-820aa5954597-kube-api-access-bgzhj\") pod \"authorino-557f876f69-8dpwt\" (UID: \"cd8cbfbb-7b1d-4253-b229-820aa5954597\") " pod="kuadrant-system/authorino-557f876f69-8dpwt"
Sep 11 16:38:43.211074 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.210983    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-v5q8t"]
Sep 11 16:38:43.211266 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:38:43.211247    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-kxg5f tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-v5q8t" podUID="0327d04f-f889-442e-a345-bc427a12e720"
Sep 11 16:38:43.253416 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.253378    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0327d04f-f889-442e-a345-bc427a12e720-tls-cert\") pod \"authorino-6d4dfc649f-v5q8t\" (UID: \"0327d04f-f889-442e-a345-bc427a12e720\") " pod="kuadrant-system/authorino-6d4dfc649f-v5q8t"
Sep 11 16:38:43.253579 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.253429    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxg5f\" (UniqueName: \"kubernetes.io/projected/0327d04f-f889-442e-a345-bc427a12e720-kube-api-access-kxg5f\") pod \"authorino-6d4dfc649f-v5q8t\" (UID: \"0327d04f-f889-442e-a345-bc427a12e720\") " pod="kuadrant-system/authorino-6d4dfc649f-v5q8t"
Sep 11 16:38:43.255938 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.255904    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0327d04f-f889-442e-a345-bc427a12e720-tls-cert\") pod \"authorino-6d4dfc649f-v5q8t\" (UID: \"0327d04f-f889-442e-a345-bc427a12e720\") " pod="kuadrant-system/authorino-6d4dfc649f-v5q8t"
Sep 11 16:38:43.259216 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.259187    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-588f7db564-tcnrk"]
Sep 11 16:38:43.263151 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.263126    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-588f7db564-tcnrk"
Sep 11 16:38:43.276253 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.276225    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-588f7db564-tcnrk"]
Sep 11 16:38:43.278117 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.278089    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxg5f\" (UniqueName: \"kubernetes.io/projected/0327d04f-f889-442e-a345-bc427a12e720-kube-api-access-kxg5f\") pod \"authorino-6d4dfc649f-v5q8t\" (UID: \"0327d04f-f889-442e-a345-bc427a12e720\") " pod="kuadrant-system/authorino-6d4dfc649f-v5q8t"
Sep 11 16:38:43.319255 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.319222    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-v5q8t"
Sep 11 16:38:43.319443 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.319226    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-8dpwt"
Sep 11 16:38:43.326949 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.326922    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-v5q8t"
Sep 11 16:38:43.329930 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.329911    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-8dpwt"
Sep 11 16:38:43.353810 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.353777    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgzhj\" (UniqueName: \"kubernetes.io/projected/cd8cbfbb-7b1d-4253-b229-820aa5954597-kube-api-access-bgzhj\") pod \"cd8cbfbb-7b1d-4253-b229-820aa5954597\" (UID: \"cd8cbfbb-7b1d-4253-b229-820aa5954597\") "
Sep 11 16:38:43.353810 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.353814    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxg5f\" (UniqueName: \"kubernetes.io/projected/0327d04f-f889-442e-a345-bc427a12e720-kube-api-access-kxg5f\") pod \"0327d04f-f889-442e-a345-bc427a12e720\" (UID: \"0327d04f-f889-442e-a345-bc427a12e720\") "
Sep 11 16:38:43.354020 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.353854    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0327d04f-f889-442e-a345-bc427a12e720-tls-cert\") pod \"0327d04f-f889-442e-a345-bc427a12e720\" (UID: \"0327d04f-f889-442e-a345-bc427a12e720\") "
Sep 11 16:38:43.354020 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.353982    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw2g8\" (UniqueName: \"kubernetes.io/projected/d8b95b02-d437-45ae-9180-a7c40c8048a6-kube-api-access-jw2g8\") pod \"authorino-588f7db564-tcnrk\" (UID: \"d8b95b02-d437-45ae-9180-a7c40c8048a6\") " pod="kuadrant-system/authorino-588f7db564-tcnrk"
Sep 11 16:38:43.354110 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.354034    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8b95b02-d437-45ae-9180-a7c40c8048a6-tls-cert\") pod \"authorino-588f7db564-tcnrk\" (UID: \"d8b95b02-d437-45ae-9180-a7c40c8048a6\") " pod="kuadrant-system/authorino-588f7db564-tcnrk"
Sep 11 16:38:43.356380 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.356345    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd8cbfbb-7b1d-4253-b229-820aa5954597-kube-api-access-bgzhj" (OuterVolumeSpecName: "kube-api-access-bgzhj") pod "cd8cbfbb-7b1d-4253-b229-820aa5954597" (UID: "cd8cbfbb-7b1d-4253-b229-820aa5954597"). InnerVolumeSpecName "kube-api-access-bgzhj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:38:43.356522 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.356498    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0327d04f-f889-442e-a345-bc427a12e720-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0327d04f-f889-442e-a345-bc427a12e720" (UID: "0327d04f-f889-442e-a345-bc427a12e720"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:38:43.356583 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.356521    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0327d04f-f889-442e-a345-bc427a12e720-kube-api-access-kxg5f" (OuterVolumeSpecName: "kube-api-access-kxg5f") pod "0327d04f-f889-442e-a345-bc427a12e720" (UID: "0327d04f-f889-442e-a345-bc427a12e720"). InnerVolumeSpecName "kube-api-access-kxg5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:38:43.455443 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.455403    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8b95b02-d437-45ae-9180-a7c40c8048a6-tls-cert\") pod \"authorino-588f7db564-tcnrk\" (UID: \"d8b95b02-d437-45ae-9180-a7c40c8048a6\") " pod="kuadrant-system/authorino-588f7db564-tcnrk"
Sep 11 16:38:43.455645 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.455517    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw2g8\" (UniqueName: \"kubernetes.io/projected/d8b95b02-d437-45ae-9180-a7c40c8048a6-kube-api-access-jw2g8\") pod \"authorino-588f7db564-tcnrk\" (UID: \"d8b95b02-d437-45ae-9180-a7c40c8048a6\") " pod="kuadrant-system/authorino-588f7db564-tcnrk"
Sep 11 16:38:43.455645 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.455565    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxg5f\" (UniqueName: \"kubernetes.io/projected/0327d04f-f889-442e-a345-bc427a12e720-kube-api-access-kxg5f\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:38:43.455645 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.455580    2557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0327d04f-f889-442e-a345-bc427a12e720-tls-cert\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:38:43.455645 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.455594    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgzhj\" (UniqueName: \"kubernetes.io/projected/cd8cbfbb-7b1d-4253-b229-820aa5954597-kube-api-access-bgzhj\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:38:43.457990 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.457967    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8b95b02-d437-45ae-9180-a7c40c8048a6-tls-cert\") pod \"authorino-588f7db564-tcnrk\" (UID: \"d8b95b02-d437-45ae-9180-a7c40c8048a6\") " pod="kuadrant-system/authorino-588f7db564-tcnrk"
Sep 11 16:38:43.473061 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.472994    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw2g8\" (UniqueName: \"kubernetes.io/projected/d8b95b02-d437-45ae-9180-a7c40c8048a6-kube-api-access-jw2g8\") pod \"authorino-588f7db564-tcnrk\" (UID: \"d8b95b02-d437-45ae-9180-a7c40c8048a6\") " pod="kuadrant-system/authorino-588f7db564-tcnrk"
Sep 11 16:38:43.572702 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.572660    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-588f7db564-tcnrk"
Sep 11 16:38:43.847889 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:43.847860    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-588f7db564-tcnrk"]
Sep 11 16:38:43.849544 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:38:43.849516    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8b95b02_d437_45ae_9180_a7c40c8048a6.slice/crio-bd2de76663ac5b6c00e0e9f61579ed47fd983a8169c6d8e4b0e81af840f780b4 WatchSource:0}: Error finding container bd2de76663ac5b6c00e0e9f61579ed47fd983a8169c6d8e4b0e81af840f780b4: Status 404 returned error can't find the container with id bd2de76663ac5b6c00e0e9f61579ed47fd983a8169c6d8e4b0e81af840f780b4
Sep 11 16:38:44.325086 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:44.325047    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-588f7db564-tcnrk" event={"ID":"d8b95b02-d437-45ae-9180-a7c40c8048a6","Type":"ContainerStarted","Data":"bd2de76663ac5b6c00e0e9f61579ed47fd983a8169c6d8e4b0e81af840f780b4"}
Sep 11 16:38:44.325086 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:44.325087    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-8dpwt"
Sep 11 16:38:44.325294 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:44.325092    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-v5q8t"
Sep 11 16:38:44.372273 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:44.372240    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-8dpwt"]
Sep 11 16:38:44.378852 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:44.378824    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-8dpwt"]
Sep 11 16:38:44.412300 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:44.412265    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-v5q8t"]
Sep 11 16:38:44.420892 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:44.420862    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-v5q8t"]
Sep 11 16:38:44.945832 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:44.945752    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0327d04f-f889-442e-a345-bc427a12e720" path="/var/lib/kubelet/pods/0327d04f-f889-442e-a345-bc427a12e720/volumes"
Sep 11 16:38:44.945994 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:44.945983    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd8cbfbb-7b1d-4253-b229-820aa5954597" path="/var/lib/kubelet/pods/cd8cbfbb-7b1d-4253-b229-820aa5954597/volumes"
Sep 11 16:38:45.331279 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:45.331240    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-588f7db564-tcnrk" event={"ID":"d8b95b02-d437-45ae-9180-a7c40c8048a6","Type":"ContainerStarted","Data":"7bcaa8585c3c1234107a2d7d0517d55b62e1d31d515c666f1395e54ef4a595c0"}
Sep 11 16:38:45.351152 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:45.351096    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-588f7db564-tcnrk" podStartSLOduration=1.718332132 podStartE2EDuration="2.351080041s" totalImagesPullingTime="632.747909ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:38:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:38:45.350352557 +0000 UTC m=+544.968626730" watchObservedRunningTime="2026-09-11 16:38:45.351080041 +0000 UTC m=+544.969354211"
Sep 11 16:38:45.388509 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:45.388472    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-2v5qf"]
Sep 11 16:38:45.388990 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:45.388743    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-2v5qf" podUID="a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3" containerName="authorino" containerID="cri-o://f859c436daf20ec4625a731a81bda21cbb96034127e83f4d7dc6473c637f1ba3" gracePeriod=30
Sep 11 16:38:45.646059 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:45.646029    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-2v5qf"
Sep 11 16:38:45.673549 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:45.673507    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lccxw\" (UniqueName: \"kubernetes.io/projected/a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3-kube-api-access-lccxw\") pod \"a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3\" (UID: \"a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3\") "
Sep 11 16:38:45.675598 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:45.675568    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3-kube-api-access-lccxw" (OuterVolumeSpecName: "kube-api-access-lccxw") pod "a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3" (UID: "a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3"). InnerVolumeSpecName "kube-api-access-lccxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:38:45.774144 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:45.774104    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lccxw\" (UniqueName: \"kubernetes.io/projected/a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3-kube-api-access-lccxw\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:38:46.337884 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:46.337846    2557 generic.go:356] "Generic (PLEG): container finished" podID="a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3" containerID="f859c436daf20ec4625a731a81bda21cbb96034127e83f4d7dc6473c637f1ba3" exitCode=0
Sep 11 16:38:46.337884 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:46.337886    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-2v5qf"
Sep 11 16:38:46.338156 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:46.337920    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-2v5qf" event={"ID":"a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3","Type":"ContainerDied","Data":"f859c436daf20ec4625a731a81bda21cbb96034127e83f4d7dc6473c637f1ba3"}
Sep 11 16:38:46.338156 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:46.337958    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-2v5qf" event={"ID":"a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3","Type":"ContainerDied","Data":"e4b86cba2e10f265cbe0c7b9e5773cf071e3b99f29202582aef168eb60b4d122"}
Sep 11 16:38:46.338156 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:46.337979    2557 scope.go:117] "RemoveContainer" containerID="f859c436daf20ec4625a731a81bda21cbb96034127e83f4d7dc6473c637f1ba3"
Sep 11 16:38:46.346656 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:46.346633    2557 scope.go:117] "RemoveContainer" containerID="f859c436daf20ec4625a731a81bda21cbb96034127e83f4d7dc6473c637f1ba3"
Sep 11 16:38:46.346949 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:38:46.346926    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f859c436daf20ec4625a731a81bda21cbb96034127e83f4d7dc6473c637f1ba3\": container with ID starting with f859c436daf20ec4625a731a81bda21cbb96034127e83f4d7dc6473c637f1ba3 not found: ID does not exist" containerID="f859c436daf20ec4625a731a81bda21cbb96034127e83f4d7dc6473c637f1ba3"
Sep 11 16:38:46.347017 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:46.346956    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f859c436daf20ec4625a731a81bda21cbb96034127e83f4d7dc6473c637f1ba3"} err="failed to get container status \"f859c436daf20ec4625a731a81bda21cbb96034127e83f4d7dc6473c637f1ba3\": rpc error: code = NotFound desc = could not find container \"f859c436daf20ec4625a731a81bda21cbb96034127e83f4d7dc6473c637f1ba3\": container with ID starting with f859c436daf20ec4625a731a81bda21cbb96034127e83f4d7dc6473c637f1ba3 not found: ID does not exist"
Sep 11 16:38:46.363652 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:46.363625    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-2v5qf"]
Sep 11 16:38:46.369534 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:46.369509    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-2v5qf"]
Sep 11 16:38:46.946058 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:46.946026    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3" path="/var/lib/kubelet/pods/a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3/volumes"
Sep 11 16:38:50.577024 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.576989    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68d84575dd-nrv8w"]
Sep 11 16:38:50.577411 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.577362    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3" containerName="authorino"
Sep 11 16:38:50.577411 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.577376    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3" containerName="authorino"
Sep 11 16:38:50.577500 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.577429    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9f0e0f2-8fe5-4a32-a8b3-50a8b1b234a3" containerName="authorino"
Sep 11 16:38:50.581545 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.581523    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d84575dd-nrv8w"
Sep 11 16:38:50.584916 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.584891    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 16:38:50.588909 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.588740    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 16:38:50.589326 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.589030    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 16:38:50.589326 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.589281    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cg4jx\""
Sep 11 16:38:50.605676 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.605642    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68d84575dd-nrv8w"]
Sep 11 16:38:50.612095 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.612060    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65199a06-4733-4a54-bd3f-42ec9c41bd01-metrics-certs\") pod \"maas-controller-68d84575dd-nrv8w\" (UID: \"65199a06-4733-4a54-bd3f-42ec9c41bd01\") " pod="opendatahub/maas-controller-68d84575dd-nrv8w"
Sep 11 16:38:50.612248 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.612117    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65199a06-4733-4a54-bd3f-42ec9c41bd01-webhook-cert\") pod \"maas-controller-68d84575dd-nrv8w\" (UID: \"65199a06-4733-4a54-bd3f-42ec9c41bd01\") " pod="opendatahub/maas-controller-68d84575dd-nrv8w"
Sep 11 16:38:50.612248 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.612190    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsvnk\" (UniqueName: \"kubernetes.io/projected/65199a06-4733-4a54-bd3f-42ec9c41bd01-kube-api-access-qsvnk\") pod \"maas-controller-68d84575dd-nrv8w\" (UID: \"65199a06-4733-4a54-bd3f-42ec9c41bd01\") " pod="opendatahub/maas-controller-68d84575dd-nrv8w"
Sep 11 16:38:50.713654 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.713583    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65199a06-4733-4a54-bd3f-42ec9c41bd01-metrics-certs\") pod \"maas-controller-68d84575dd-nrv8w\" (UID: \"65199a06-4733-4a54-bd3f-42ec9c41bd01\") " pod="opendatahub/maas-controller-68d84575dd-nrv8w"
Sep 11 16:38:50.713654 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.713659    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65199a06-4733-4a54-bd3f-42ec9c41bd01-webhook-cert\") pod \"maas-controller-68d84575dd-nrv8w\" (UID: \"65199a06-4733-4a54-bd3f-42ec9c41bd01\") " pod="opendatahub/maas-controller-68d84575dd-nrv8w"
Sep 11 16:38:50.713865 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.713683    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsvnk\" (UniqueName: \"kubernetes.io/projected/65199a06-4733-4a54-bd3f-42ec9c41bd01-kube-api-access-qsvnk\") pod \"maas-controller-68d84575dd-nrv8w\" (UID: \"65199a06-4733-4a54-bd3f-42ec9c41bd01\") " pod="opendatahub/maas-controller-68d84575dd-nrv8w"
Sep 11 16:38:50.713865 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:38:50.713731    2557 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 11 16:38:50.713865 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:38:50.713794    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65199a06-4733-4a54-bd3f-42ec9c41bd01-metrics-certs podName:65199a06-4733-4a54-bd3f-42ec9c41bd01 nodeName:}" failed. No retries permitted until 2026-09-11 16:38:51.213776646 +0000 UTC m=+550.832050798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65199a06-4733-4a54-bd3f-42ec9c41bd01-metrics-certs") pod "maas-controller-68d84575dd-nrv8w" (UID: "65199a06-4733-4a54-bd3f-42ec9c41bd01") : secret "maas-controller-metrics-tls" not found
Sep 11 16:38:50.713976 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:38:50.713921    2557 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 11 16:38:50.713976 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:38:50.713945    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65199a06-4733-4a54-bd3f-42ec9c41bd01-webhook-cert podName:65199a06-4733-4a54-bd3f-42ec9c41bd01 nodeName:}" failed. No retries permitted until 2026-09-11 16:38:51.213937566 +0000 UTC m=+550.832211717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/65199a06-4733-4a54-bd3f-42ec9c41bd01-webhook-cert") pod "maas-controller-68d84575dd-nrv8w" (UID: "65199a06-4733-4a54-bd3f-42ec9c41bd01") : secret "maas-controller-webhook-cert" not found
Sep 11 16:38:50.725553 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.725525    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsvnk\" (UniqueName: \"kubernetes.io/projected/65199a06-4733-4a54-bd3f-42ec9c41bd01-kube-api-access-qsvnk\") pod \"maas-controller-68d84575dd-nrv8w\" (UID: \"65199a06-4733-4a54-bd3f-42ec9c41bd01\") " pod="opendatahub/maas-controller-68d84575dd-nrv8w"
Sep 11 16:38:50.791224 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.791186    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78c795f5ff-tj5wx"]
Sep 11 16:38:50.794354 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.794336    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78c795f5ff-tj5wx"
Sep 11 16:38:50.812796 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.812754    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78c795f5ff-tj5wx"]
Sep 11 16:38:50.814373 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.814345    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59190f43-195f-413e-9797-180f8c1c9e2a-metrics-certs\") pod \"maas-controller-78c795f5ff-tj5wx\" (UID: \"59190f43-195f-413e-9797-180f8c1c9e2a\") " pod="opendatahub/maas-controller-78c795f5ff-tj5wx"
Sep 11 16:38:50.814472 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.814381    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc7gd\" (UniqueName: \"kubernetes.io/projected/59190f43-195f-413e-9797-180f8c1c9e2a-kube-api-access-pc7gd\") pod \"maas-controller-78c795f5ff-tj5wx\" (UID: \"59190f43-195f-413e-9797-180f8c1c9e2a\") " pod="opendatahub/maas-controller-78c795f5ff-tj5wx"
Sep 11 16:38:50.814525 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.814480    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59190f43-195f-413e-9797-180f8c1c9e2a-webhook-cert\") pod \"maas-controller-78c795f5ff-tj5wx\" (UID: \"59190f43-195f-413e-9797-180f8c1c9e2a\") " pod="opendatahub/maas-controller-78c795f5ff-tj5wx"
Sep 11 16:38:50.915929 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.915831    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59190f43-195f-413e-9797-180f8c1c9e2a-webhook-cert\") pod \"maas-controller-78c795f5ff-tj5wx\" (UID: \"59190f43-195f-413e-9797-180f8c1c9e2a\") " pod="opendatahub/maas-controller-78c795f5ff-tj5wx"
Sep 11 16:38:50.915929 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.915914    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59190f43-195f-413e-9797-180f8c1c9e2a-metrics-certs\") pod \"maas-controller-78c795f5ff-tj5wx\" (UID: \"59190f43-195f-413e-9797-180f8c1c9e2a\") " pod="opendatahub/maas-controller-78c795f5ff-tj5wx"
Sep 11 16:38:50.915929 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.915934    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc7gd\" (UniqueName: \"kubernetes.io/projected/59190f43-195f-413e-9797-180f8c1c9e2a-kube-api-access-pc7gd\") pod \"maas-controller-78c795f5ff-tj5wx\" (UID: \"59190f43-195f-413e-9797-180f8c1c9e2a\") " pod="opendatahub/maas-controller-78c795f5ff-tj5wx"
Sep 11 16:38:50.916232 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:38:50.915995    2557 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 11 16:38:50.916232 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:38:50.916025    2557 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 11 16:38:50.916232 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:38:50.916072    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59190f43-195f-413e-9797-180f8c1c9e2a-webhook-cert podName:59190f43-195f-413e-9797-180f8c1c9e2a nodeName:}" failed. No retries permitted until 2026-09-11 16:38:51.416048934 +0000 UTC m=+551.034323088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/59190f43-195f-413e-9797-180f8c1c9e2a-webhook-cert") pod "maas-controller-78c795f5ff-tj5wx" (UID: "59190f43-195f-413e-9797-180f8c1c9e2a") : secret "maas-controller-webhook-cert" not found
Sep 11 16:38:50.916232 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:38:50.916091    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59190f43-195f-413e-9797-180f8c1c9e2a-metrics-certs podName:59190f43-195f-413e-9797-180f8c1c9e2a nodeName:}" failed. No retries permitted until 2026-09-11 16:38:51.416082065 +0000 UTC m=+551.034356217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/59190f43-195f-413e-9797-180f8c1c9e2a-metrics-certs") pod "maas-controller-78c795f5ff-tj5wx" (UID: "59190f43-195f-413e-9797-180f8c1c9e2a") : secret "maas-controller-metrics-tls" not found
Sep 11 16:38:50.928452 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:50.928419    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc7gd\" (UniqueName: \"kubernetes.io/projected/59190f43-195f-413e-9797-180f8c1c9e2a-kube-api-access-pc7gd\") pod \"maas-controller-78c795f5ff-tj5wx\" (UID: \"59190f43-195f-413e-9797-180f8c1c9e2a\") " pod="opendatahub/maas-controller-78c795f5ff-tj5wx"
Sep 11 16:38:51.218662 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:51.218528    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65199a06-4733-4a54-bd3f-42ec9c41bd01-metrics-certs\") pod \"maas-controller-68d84575dd-nrv8w\" (UID: \"65199a06-4733-4a54-bd3f-42ec9c41bd01\") " pod="opendatahub/maas-controller-68d84575dd-nrv8w"
Sep 11 16:38:51.218662 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:51.218576    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65199a06-4733-4a54-bd3f-42ec9c41bd01-webhook-cert\") pod \"maas-controller-68d84575dd-nrv8w\" (UID: \"65199a06-4733-4a54-bd3f-42ec9c41bd01\") " pod="opendatahub/maas-controller-68d84575dd-nrv8w"
Sep 11 16:38:51.221142 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:51.221116    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65199a06-4733-4a54-bd3f-42ec9c41bd01-webhook-cert\") pod \"maas-controller-68d84575dd-nrv8w\" (UID: \"65199a06-4733-4a54-bd3f-42ec9c41bd01\") " pod="opendatahub/maas-controller-68d84575dd-nrv8w"
Sep 11 16:38:51.221258 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:51.221116    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65199a06-4733-4a54-bd3f-42ec9c41bd01-metrics-certs\") pod \"maas-controller-68d84575dd-nrv8w\" (UID: \"65199a06-4733-4a54-bd3f-42ec9c41bd01\") " pod="opendatahub/maas-controller-68d84575dd-nrv8w"
Sep 11 16:38:51.420304 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:51.420264    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59190f43-195f-413e-9797-180f8c1c9e2a-metrics-certs\") pod \"maas-controller-78c795f5ff-tj5wx\" (UID: \"59190f43-195f-413e-9797-180f8c1c9e2a\") " pod="opendatahub/maas-controller-78c795f5ff-tj5wx"
Sep 11 16:38:51.420469 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:51.420328    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59190f43-195f-413e-9797-180f8c1c9e2a-webhook-cert\") pod \"maas-controller-78c795f5ff-tj5wx\" (UID: \"59190f43-195f-413e-9797-180f8c1c9e2a\") " pod="opendatahub/maas-controller-78c795f5ff-tj5wx"
Sep 11 16:38:51.422841 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:51.422813    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59190f43-195f-413e-9797-180f8c1c9e2a-webhook-cert\") pod \"maas-controller-78c795f5ff-tj5wx\" (UID: \"59190f43-195f-413e-9797-180f8c1c9e2a\") " pod="opendatahub/maas-controller-78c795f5ff-tj5wx"
Sep 11 16:38:51.422916 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:51.422893    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59190f43-195f-413e-9797-180f8c1c9e2a-metrics-certs\") pod \"maas-controller-78c795f5ff-tj5wx\" (UID: \"59190f43-195f-413e-9797-180f8c1c9e2a\") " pod="opendatahub/maas-controller-78c795f5ff-tj5wx"
Sep 11 16:38:51.494153 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:51.494056    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d84575dd-nrv8w"
Sep 11 16:38:51.704346 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:51.704305    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78c795f5ff-tj5wx"
Sep 11 16:38:51.772689 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:51.772595    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68d84575dd-nrv8w"]
Sep 11 16:38:51.774249 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:38:51.774220    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65199a06_4733_4a54_bd3f_42ec9c41bd01.slice/crio-fce1a29ab05220fa9bec7cdc3427f36819ebb95fcd3dd3003253014d9f59e4ca WatchSource:0}: Error finding container fce1a29ab05220fa9bec7cdc3427f36819ebb95fcd3dd3003253014d9f59e4ca: Status 404 returned error can't find the container with id fce1a29ab05220fa9bec7cdc3427f36819ebb95fcd3dd3003253014d9f59e4ca
Sep 11 16:38:51.983141 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:51.983110    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78c795f5ff-tj5wx"]
Sep 11 16:38:51.984336 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:38:51.984300    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59190f43_195f_413e_9797_180f8c1c9e2a.slice/crio-6e81fbefeeb04e79481c20556c461b72f9cfb609549d8d8e28a98834c3e1f613 WatchSource:0}: Error finding container 6e81fbefeeb04e79481c20556c461b72f9cfb609549d8d8e28a98834c3e1f613: Status 404 returned error can't find the container with id 6e81fbefeeb04e79481c20556c461b72f9cfb609549d8d8e28a98834c3e1f613
Sep 11 16:38:52.370095 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:52.370055    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78c795f5ff-tj5wx" event={"ID":"59190f43-195f-413e-9797-180f8c1c9e2a","Type":"ContainerStarted","Data":"6e81fbefeeb04e79481c20556c461b72f9cfb609549d8d8e28a98834c3e1f613"}
Sep 11 16:38:52.371558 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:52.371529    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d84575dd-nrv8w" event={"ID":"65199a06-4733-4a54-bd3f-42ec9c41bd01","Type":"ContainerStarted","Data":"fce1a29ab05220fa9bec7cdc3427f36819ebb95fcd3dd3003253014d9f59e4ca"}
Sep 11 16:38:55.393015 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:55.392971    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78c795f5ff-tj5wx" event={"ID":"59190f43-195f-413e-9797-180f8c1c9e2a","Type":"ContainerStarted","Data":"a8adbcd4222605ec1e5ec4ff250ab696c3891e81e4baa686740bc73c77687a7a"}
Sep 11 16:38:55.393436 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:55.393144    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78c795f5ff-tj5wx"
Sep 11 16:38:55.394563 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:55.394536    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d84575dd-nrv8w" event={"ID":"65199a06-4733-4a54-bd3f-42ec9c41bd01","Type":"ContainerStarted","Data":"2066e8bc366aeebaea364356daedd1c818ce6a0a4b5137aa7700bf0cde351426"}
Sep 11 16:38:55.394693 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:55.394594    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68d84575dd-nrv8w"
Sep 11 16:38:55.421266 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:55.421212    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-78c795f5ff-tj5wx" podStartSLOduration=3.003709908 podStartE2EDuration="5.421196498s" totalImagesPullingTime="2.41748659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:38:55.418750807 +0000 UTC m=+555.037024979" watchObservedRunningTime="2026-09-11 16:38:55.421196498 +0000 UTC m=+555.039470669"
Sep 11 16:38:55.448286 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:38:55.448230    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68d84575dd-nrv8w" podStartSLOduration=2.828213755 podStartE2EDuration="5.448214146s" totalImagesPullingTime="2.620000391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:38:55.446523115 +0000 UTC m=+555.064797285" watchObservedRunningTime="2026-09-11 16:38:55.448214146 +0000 UTC m=+555.066488315"
Sep 11 16:39:06.402059 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:06.402025    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68d84575dd-nrv8w"
Sep 11 16:39:06.402570 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:06.402098    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78c795f5ff-tj5wx"
Sep 11 16:39:06.479946 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:06.479913    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68d84575dd-nrv8w"]
Sep 11 16:39:06.480421 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:06.480130    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-68d84575dd-nrv8w" podUID="65199a06-4733-4a54-bd3f-42ec9c41bd01" containerName="manager" containerID="cri-o://2066e8bc366aeebaea364356daedd1c818ce6a0a4b5137aa7700bf0cde351426" gracePeriod=30
Sep 11 16:39:06.727731 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:06.727705    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d84575dd-nrv8w"
Sep 11 16:39:06.862376 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:06.862342    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65199a06-4733-4a54-bd3f-42ec9c41bd01-metrics-certs\") pod \"65199a06-4733-4a54-bd3f-42ec9c41bd01\" (UID: \"65199a06-4733-4a54-bd3f-42ec9c41bd01\") "
Sep 11 16:39:06.862588 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:06.862400    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsvnk\" (UniqueName: \"kubernetes.io/projected/65199a06-4733-4a54-bd3f-42ec9c41bd01-kube-api-access-qsvnk\") pod \"65199a06-4733-4a54-bd3f-42ec9c41bd01\" (UID: \"65199a06-4733-4a54-bd3f-42ec9c41bd01\") "
Sep 11 16:39:06.862588 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:06.862466    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65199a06-4733-4a54-bd3f-42ec9c41bd01-webhook-cert\") pod \"65199a06-4733-4a54-bd3f-42ec9c41bd01\" (UID: \"65199a06-4733-4a54-bd3f-42ec9c41bd01\") "
Sep 11 16:39:06.864743 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:06.864710    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65199a06-4733-4a54-bd3f-42ec9c41bd01-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "65199a06-4733-4a54-bd3f-42ec9c41bd01" (UID: "65199a06-4733-4a54-bd3f-42ec9c41bd01"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:39:06.864876 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:06.864764    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65199a06-4733-4a54-bd3f-42ec9c41bd01-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "65199a06-4733-4a54-bd3f-42ec9c41bd01" (UID: "65199a06-4733-4a54-bd3f-42ec9c41bd01"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:39:06.864876 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:06.864789    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65199a06-4733-4a54-bd3f-42ec9c41bd01-kube-api-access-qsvnk" (OuterVolumeSpecName: "kube-api-access-qsvnk") pod "65199a06-4733-4a54-bd3f-42ec9c41bd01" (UID: "65199a06-4733-4a54-bd3f-42ec9c41bd01"). InnerVolumeSpecName "kube-api-access-qsvnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:39:06.963836 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:06.963767    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65199a06-4733-4a54-bd3f-42ec9c41bd01-metrics-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:39:06.963836 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:06.963793    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsvnk\" (UniqueName: \"kubernetes.io/projected/65199a06-4733-4a54-bd3f-42ec9c41bd01-kube-api-access-qsvnk\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:39:06.963836 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:06.963803    2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/65199a06-4733-4a54-bd3f-42ec9c41bd01-webhook-cert\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:39:07.457012 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:07.456970    2557 generic.go:356] "Generic (PLEG): container finished" podID="65199a06-4733-4a54-bd3f-42ec9c41bd01" containerID="2066e8bc366aeebaea364356daedd1c818ce6a0a4b5137aa7700bf0cde351426" exitCode=0
Sep 11 16:39:07.457498 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:07.457039    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68d84575dd-nrv8w"
Sep 11 16:39:07.457498 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:07.457059    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d84575dd-nrv8w" event={"ID":"65199a06-4733-4a54-bd3f-42ec9c41bd01","Type":"ContainerDied","Data":"2066e8bc366aeebaea364356daedd1c818ce6a0a4b5137aa7700bf0cde351426"}
Sep 11 16:39:07.457498 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:07.457159    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68d84575dd-nrv8w" event={"ID":"65199a06-4733-4a54-bd3f-42ec9c41bd01","Type":"ContainerDied","Data":"fce1a29ab05220fa9bec7cdc3427f36819ebb95fcd3dd3003253014d9f59e4ca"}
Sep 11 16:39:07.457498 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:07.457196    2557 scope.go:117] "RemoveContainer" containerID="2066e8bc366aeebaea364356daedd1c818ce6a0a4b5137aa7700bf0cde351426"
Sep 11 16:39:07.465823 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:07.465808    2557 scope.go:117] "RemoveContainer" containerID="2066e8bc366aeebaea364356daedd1c818ce6a0a4b5137aa7700bf0cde351426"
Sep 11 16:39:07.466108 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:39:07.466085    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2066e8bc366aeebaea364356daedd1c818ce6a0a4b5137aa7700bf0cde351426\": container with ID starting with 2066e8bc366aeebaea364356daedd1c818ce6a0a4b5137aa7700bf0cde351426 not found: ID does not exist" containerID="2066e8bc366aeebaea364356daedd1c818ce6a0a4b5137aa7700bf0cde351426"
Sep 11 16:39:07.466226 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:07.466116    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2066e8bc366aeebaea364356daedd1c818ce6a0a4b5137aa7700bf0cde351426"} err="failed to get container status \"2066e8bc366aeebaea364356daedd1c818ce6a0a4b5137aa7700bf0cde351426\": rpc error: code = NotFound desc = could not find container \"2066e8bc366aeebaea364356daedd1c818ce6a0a4b5137aa7700bf0cde351426\": container with ID starting with 2066e8bc366aeebaea364356daedd1c818ce6a0a4b5137aa7700bf0cde351426 not found: ID does not exist"
Sep 11 16:39:07.479850 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:07.479820    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68d84575dd-nrv8w"]
Sep 11 16:39:07.484798 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:07.484767    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68d84575dd-nrv8w"]
Sep 11 16:39:08.946011 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:08.945978    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65199a06-4733-4a54-bd3f-42ec9c41bd01" path="/var/lib/kubelet/pods/65199a06-4733-4a54-bd3f-42ec9c41bd01/volumes"
Sep 11 16:39:28.652220 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.652185    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"]
Sep 11 16:39:28.652697 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.652505    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65199a06-4733-4a54-bd3f-42ec9c41bd01" containerName="manager"
Sep 11 16:39:28.652697 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.652518    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="65199a06-4733-4a54-bd3f-42ec9c41bd01" containerName="manager"
Sep 11 16:39:28.652697 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.652593    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="65199a06-4733-4a54-bd3f-42ec9c41bd01" containerName="manager"
Sep 11 16:39:28.659003 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.658979    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"
Sep 11 16:39:28.662843 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.662821    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 16:39:28.663671 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.663652    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kfp69\""
Sep 11 16:39:28.663775 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.663698    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 16:39:28.675078 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.675036    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"]
Sep 11 16:39:28.757199 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.757158    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17785b6c-ce85-42c8-af89-813bb255ff79-openshift-service-ca\") pod \"maas-api-6b9dddc78b-6hcg2\" (UID: \"17785b6c-ce85-42c8-af89-813bb255ff79\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"
Sep 11 16:39:28.757199 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.757196    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17785b6c-ce85-42c8-af89-813bb255ff79-maas-api-tls\") pod \"maas-api-6b9dddc78b-6hcg2\" (UID: \"17785b6c-ce85-42c8-af89-813bb255ff79\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"
Sep 11 16:39:28.757446 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.757294    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17785b6c-ce85-42c8-af89-813bb255ff79-metrics-certs\") pod \"maas-api-6b9dddc78b-6hcg2\" (UID: \"17785b6c-ce85-42c8-af89-813bb255ff79\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"
Sep 11 16:39:28.757446 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.757370    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjvpx\" (UniqueName: \"kubernetes.io/projected/17785b6c-ce85-42c8-af89-813bb255ff79-kube-api-access-xjvpx\") pod \"maas-api-6b9dddc78b-6hcg2\" (UID: \"17785b6c-ce85-42c8-af89-813bb255ff79\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"
Sep 11 16:39:28.858141 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.858097    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjvpx\" (UniqueName: \"kubernetes.io/projected/17785b6c-ce85-42c8-af89-813bb255ff79-kube-api-access-xjvpx\") pod \"maas-api-6b9dddc78b-6hcg2\" (UID: \"17785b6c-ce85-42c8-af89-813bb255ff79\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"
Sep 11 16:39:28.858350 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.858179    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17785b6c-ce85-42c8-af89-813bb255ff79-openshift-service-ca\") pod \"maas-api-6b9dddc78b-6hcg2\" (UID: \"17785b6c-ce85-42c8-af89-813bb255ff79\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"
Sep 11 16:39:28.858350 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.858202    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17785b6c-ce85-42c8-af89-813bb255ff79-maas-api-tls\") pod \"maas-api-6b9dddc78b-6hcg2\" (UID: \"17785b6c-ce85-42c8-af89-813bb255ff79\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"
Sep 11 16:39:28.858350 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.858229    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17785b6c-ce85-42c8-af89-813bb255ff79-metrics-certs\") pod \"maas-api-6b9dddc78b-6hcg2\" (UID: \"17785b6c-ce85-42c8-af89-813bb255ff79\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"
Sep 11 16:39:28.858946 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.858921    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17785b6c-ce85-42c8-af89-813bb255ff79-openshift-service-ca\") pod \"maas-api-6b9dddc78b-6hcg2\" (UID: \"17785b6c-ce85-42c8-af89-813bb255ff79\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"
Sep 11 16:39:28.860757 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.860726    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17785b6c-ce85-42c8-af89-813bb255ff79-maas-api-tls\") pod \"maas-api-6b9dddc78b-6hcg2\" (UID: \"17785b6c-ce85-42c8-af89-813bb255ff79\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"
Sep 11 16:39:28.860854 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.860783    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17785b6c-ce85-42c8-af89-813bb255ff79-metrics-certs\") pod \"maas-api-6b9dddc78b-6hcg2\" (UID: \"17785b6c-ce85-42c8-af89-813bb255ff79\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"
Sep 11 16:39:28.870373 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.870350    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjvpx\" (UniqueName: \"kubernetes.io/projected/17785b6c-ce85-42c8-af89-813bb255ff79-kube-api-access-xjvpx\") pod \"maas-api-6b9dddc78b-6hcg2\" (UID: \"17785b6c-ce85-42c8-af89-813bb255ff79\") " pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"
Sep 11 16:39:28.968951 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:28.968872    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"
Sep 11 16:39:29.264858 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.264827    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"]
Sep 11 16:39:29.266911 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:39:29.266881    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17785b6c_ce85_42c8_af89_813bb255ff79.slice/crio-6a41be64e4e92dbf75c71473becd0f545c224adff71ecee82059edbb2ee515d2 WatchSource:0}: Error finding container 6a41be64e4e92dbf75c71473becd0f545c224adff71ecee82059edbb2ee515d2: Status 404 returned error can't find the container with id 6a41be64e4e92dbf75c71473becd0f545c224adff71ecee82059edbb2ee515d2
Sep 11 16:39:29.569007 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.568916    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2" event={"ID":"17785b6c-ce85-42c8-af89-813bb255ff79","Type":"ContainerStarted","Data":"6a41be64e4e92dbf75c71473becd0f545c224adff71ecee82059edbb2ee515d2"}
Sep 11 16:39:29.624347 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.624306    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-2tbqw"]
Sep 11 16:39:29.628813 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.628791    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2tbqw"
Sep 11 16:39:29.635409 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.635298    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-rk5jv\""
Sep 11 16:39:29.635817 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.635799    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 16:39:29.644969 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.644942    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-2tbqw"]
Sep 11 16:39:29.664026 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.663990    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae1cb97c-6f84-47cc-b9c8-2fd310ef96a0-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-2tbqw\" (UID: \"ae1cb97c-6f84-47cc-b9c8-2fd310ef96a0\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2tbqw"
Sep 11 16:39:29.664393 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.664056    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrq9d\" (UniqueName: \"kubernetes.io/projected/ae1cb97c-6f84-47cc-b9c8-2fd310ef96a0-kube-api-access-hrq9d\") pod \"payload-pre-processing-59fbc47bf8-2tbqw\" (UID: \"ae1cb97c-6f84-47cc-b9c8-2fd310ef96a0\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2tbqw"
Sep 11 16:39:29.718697 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.718660    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9qcfd"]
Sep 11 16:39:29.722001 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.721981    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-9qcfd"
Sep 11 16:39:29.737006 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.736970    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9qcfd"]
Sep 11 16:39:29.765798 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.765752    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/891ff581-1fa1-42ca-96be-ea2b43e402ac-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9qcfd\" (UID: \"891ff581-1fa1-42ca-96be-ea2b43e402ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9qcfd"
Sep 11 16:39:29.765994 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.765832    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwbtb\" (UniqueName: \"kubernetes.io/projected/891ff581-1fa1-42ca-96be-ea2b43e402ac-kube-api-access-vwbtb\") pod \"payload-processing-5b54b7fbb7-9qcfd\" (UID: \"891ff581-1fa1-42ca-96be-ea2b43e402ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9qcfd"
Sep 11 16:39:29.765994 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.765873    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrq9d\" (UniqueName: \"kubernetes.io/projected/ae1cb97c-6f84-47cc-b9c8-2fd310ef96a0-kube-api-access-hrq9d\") pod \"payload-pre-processing-59fbc47bf8-2tbqw\" (UID: \"ae1cb97c-6f84-47cc-b9c8-2fd310ef96a0\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2tbqw"
Sep 11 16:39:29.765994 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.765958    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae1cb97c-6f84-47cc-b9c8-2fd310ef96a0-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-2tbqw\" (UID: \"ae1cb97c-6f84-47cc-b9c8-2fd310ef96a0\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2tbqw"
Sep 11 16:39:29.766754 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.766730    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae1cb97c-6f84-47cc-b9c8-2fd310ef96a0-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-2tbqw\" (UID: \"ae1cb97c-6f84-47cc-b9c8-2fd310ef96a0\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2tbqw"
Sep 11 16:39:29.777551 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.777515    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrq9d\" (UniqueName: \"kubernetes.io/projected/ae1cb97c-6f84-47cc-b9c8-2fd310ef96a0-kube-api-access-hrq9d\") pod \"payload-pre-processing-59fbc47bf8-2tbqw\" (UID: \"ae1cb97c-6f84-47cc-b9c8-2fd310ef96a0\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2tbqw"
Sep 11 16:39:29.866638 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.866526    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/891ff581-1fa1-42ca-96be-ea2b43e402ac-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9qcfd\" (UID: \"891ff581-1fa1-42ca-96be-ea2b43e402ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9qcfd"
Sep 11 16:39:29.866638 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.866597    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwbtb\" (UniqueName: \"kubernetes.io/projected/891ff581-1fa1-42ca-96be-ea2b43e402ac-kube-api-access-vwbtb\") pod \"payload-processing-5b54b7fbb7-9qcfd\" (UID: \"891ff581-1fa1-42ca-96be-ea2b43e402ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9qcfd"
Sep 11 16:39:29.867901 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.867868    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/891ff581-1fa1-42ca-96be-ea2b43e402ac-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9qcfd\" (UID: \"891ff581-1fa1-42ca-96be-ea2b43e402ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9qcfd"
Sep 11 16:39:29.877724 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.877695    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwbtb\" (UniqueName: \"kubernetes.io/projected/891ff581-1fa1-42ca-96be-ea2b43e402ac-kube-api-access-vwbtb\") pod \"payload-processing-5b54b7fbb7-9qcfd\" (UID: \"891ff581-1fa1-42ca-96be-ea2b43e402ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9qcfd"
Sep 11 16:39:29.939446 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:29.939406    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2tbqw"
Sep 11 16:39:30.034762 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:30.033315    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-9qcfd"
Sep 11 16:39:30.235949 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:30.235915    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-2tbqw"]
Sep 11 16:39:30.236123 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:39:30.236089    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae1cb97c_6f84_47cc_b9c8_2fd310ef96a0.slice/crio-9185da4b7a0e2845ef05b6d53d6de53b623f8c9198847efbcc2a249c125b8f44 WatchSource:0}: Error finding container 9185da4b7a0e2845ef05b6d53d6de53b623f8c9198847efbcc2a249c125b8f44: Status 404 returned error can't find the container with id 9185da4b7a0e2845ef05b6d53d6de53b623f8c9198847efbcc2a249c125b8f44
Sep 11 16:39:30.343798 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:30.343755    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9qcfd"]
Sep 11 16:39:30.345453 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:39:30.345423    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod891ff581_1fa1_42ca_96be_ea2b43e402ac.slice/crio-d61f02410885ec8c7afa87998b06a22a0e7bdaa843497686feea66922c221320 WatchSource:0}: Error finding container d61f02410885ec8c7afa87998b06a22a0e7bdaa843497686feea66922c221320: Status 404 returned error can't find the container with id d61f02410885ec8c7afa87998b06a22a0e7bdaa843497686feea66922c221320
Sep 11 16:39:30.576212 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:30.576168    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2tbqw" event={"ID":"ae1cb97c-6f84-47cc-b9c8-2fd310ef96a0","Type":"ContainerStarted","Data":"9185da4b7a0e2845ef05b6d53d6de53b623f8c9198847efbcc2a249c125b8f44"}
Sep 11 16:39:30.577548 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:30.577520    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-9qcfd" event={"ID":"891ff581-1fa1-42ca-96be-ea2b43e402ac","Type":"ContainerStarted","Data":"d61f02410885ec8c7afa87998b06a22a0e7bdaa843497686feea66922c221320"}
Sep 11 16:39:31.590623 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:31.590327    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2" event={"ID":"17785b6c-ce85-42c8-af89-813bb255ff79","Type":"ContainerStarted","Data":"a9d25a6ce8b45ba1a6a0b710810d752faec7c90d5096cf7b69e74e7b515061ec"}
Sep 11 16:39:31.590623 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:31.590575    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"
Sep 11 16:39:31.612114 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:31.612044    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2" podStartSLOduration=1.725457952 podStartE2EDuration="3.612019908s" totalImagesPullingTime="1.886561956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:39:31.610801459 +0000 UTC m=+591.229075630" watchObservedRunningTime="2026-09-11 16:39:31.612019908 +0000 UTC m=+591.230294080"
Sep 11 16:39:33.603909 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:33.603873    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2tbqw" event={"ID":"ae1cb97c-6f84-47cc-b9c8-2fd310ef96a0","Type":"ContainerStarted","Data":"64f54a98f4ec98c1217520873d3ce5438d990125bd2b6e461c2c07fb08bef979"}
Sep 11 16:39:33.604389 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:33.604066    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2tbqw"
Sep 11 16:39:33.605671 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:33.605648    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-9qcfd" event={"ID":"891ff581-1fa1-42ca-96be-ea2b43e402ac","Type":"ContainerStarted","Data":"75e13d2dc8f27029a5464296cbfe31bc248579aeb36bf3ebe5444079b51d9960"}
Sep 11 16:39:33.605823 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:33.605700    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-9qcfd"
Sep 11 16:39:33.634335 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:33.634275    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2tbqw" podStartSLOduration=1.949419871 podStartE2EDuration="4.634258979s" totalImagesPullingTime="2.684839108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:39:33.631882167 +0000 UTC m=+593.250156337" watchObservedRunningTime="2026-09-11 16:39:33.634258979 +0000 UTC m=+593.252533149"
Sep 11 16:39:33.673424 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:33.673355    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-9qcfd" podStartSLOduration=2.103934076 podStartE2EDuration="4.67333131s" totalImagesPullingTime="2.569397234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:39:33.66999533 +0000 UTC m=+593.288269503" watchObservedRunningTime="2026-09-11 16:39:33.67333131 +0000 UTC m=+593.291605481"
Sep 11 16:39:37.602321 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:37.602289    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"
Sep 11 16:39:39.636943 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:39.636907    2557 generic.go:356] "Generic (PLEG): container finished" podID="a86a6cec-b2d2-4385-acc2-6169e537a84f" containerID="8d9f79b0074e8254310465d4754e1198eb0f67e24c4020570201193d5ec8cb62" exitCode=0
Sep 11 16:39:39.637374 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:39.636969    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m" event={"ID":"a86a6cec-b2d2-4385-acc2-6169e537a84f","Type":"ContainerDied","Data":"8d9f79b0074e8254310465d4754e1198eb0f67e24c4020570201193d5ec8cb62"}
Sep 11 16:39:39.637374 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:39.637339    2557 scope.go:117] "RemoveContainer" containerID="8d9f79b0074e8254310465d4754e1198eb0f67e24c4020570201193d5ec8cb62"
Sep 11 16:39:39.638317 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:39.638287    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:39:39.638416 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:39.638371    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:39:39.638480 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:39.638420    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:39:40.646092 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:40.645767    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m" event={"ID":"a86a6cec-b2d2-4385-acc2-6169e537a84f","Type":"ContainerStarted","Data":"690af8c763ec96a89c0779c79c915d8fab511a3aa8c3ff1337cec066f2e244f0"}
Sep 11 16:39:40.970599 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:40.970516    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:39:40.970814 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:40.970796    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-pxd9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 11 16:39:40.970869 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:40.970851    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m" podUID="a86a6cec-b2d2-4385-acc2-6169e537a84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 11 16:39:41.970813 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:41.970763    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-pxd9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 11 16:39:41.971224 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:41.970835    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m" podUID="a86a6cec-b2d2-4385-acc2-6169e537a84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 11 16:39:42.971021 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:42.970970    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-pxd9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 11 16:39:42.971537 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:42.971060    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m" podUID="a86a6cec-b2d2-4385-acc2-6169e537a84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 11 16:39:43.970875 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:43.970834    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-pxd9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 11 16:39:43.971079 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:43.970894    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m" podUID="a86a6cec-b2d2-4385-acc2-6169e537a84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 11 16:39:44.612227 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:44.612187    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-9qcfd"
Sep 11 16:39:44.612403 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:44.612257    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-2tbqw"
Sep 11 16:39:44.971502 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:44.971416    2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-pxd9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body=
Sep 11 16:39:44.971502 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:44.971475    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m" podUID="a86a6cec-b2d2-4385-acc2-6169e537a84f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused"
Sep 11 16:39:45.975036 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:45.975000    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:39:45.975429 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:45.975302    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:39:45.976042 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:45.976027    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-pxd9m"
Sep 11 16:39:49.031765 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.031722    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"]
Sep 11 16:39:49.036838 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.036813    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.041244 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.041199    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-47mg7\""
Sep 11 16:39:49.041394 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.041225    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 16:39:49.041458 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.041225    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 11 16:39:49.041622 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.041584    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 16:39:49.058865 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.058837    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"]
Sep 11 16:39:49.148489 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.148456    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec1f9318-4047-4dfd-b561-fb59802346ef-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w\" (UID: \"ec1f9318-4047-4dfd-b561-fb59802346ef\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.148489 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.148494    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec1f9318-4047-4dfd-b561-fb59802346ef-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w\" (UID: \"ec1f9318-4047-4dfd-b561-fb59802346ef\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.148781 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.148629    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec1f9318-4047-4dfd-b561-fb59802346ef-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w\" (UID: \"ec1f9318-4047-4dfd-b561-fb59802346ef\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.148781 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.148674    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l995\" (UniqueName: \"kubernetes.io/projected/ec1f9318-4047-4dfd-b561-fb59802346ef-kube-api-access-4l995\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w\" (UID: \"ec1f9318-4047-4dfd-b561-fb59802346ef\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.148781 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.148702    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec1f9318-4047-4dfd-b561-fb59802346ef-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w\" (UID: \"ec1f9318-4047-4dfd-b561-fb59802346ef\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.148781 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.148728    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec1f9318-4047-4dfd-b561-fb59802346ef-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w\" (UID: \"ec1f9318-4047-4dfd-b561-fb59802346ef\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.249787 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.249747    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec1f9318-4047-4dfd-b561-fb59802346ef-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w\" (UID: \"ec1f9318-4047-4dfd-b561-fb59802346ef\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.249987 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.249795    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec1f9318-4047-4dfd-b561-fb59802346ef-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w\" (UID: \"ec1f9318-4047-4dfd-b561-fb59802346ef\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.249987 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.249837    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec1f9318-4047-4dfd-b561-fb59802346ef-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w\" (UID: \"ec1f9318-4047-4dfd-b561-fb59802346ef\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.249987 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.249855    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l995\" (UniqueName: \"kubernetes.io/projected/ec1f9318-4047-4dfd-b561-fb59802346ef-kube-api-access-4l995\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w\" (UID: \"ec1f9318-4047-4dfd-b561-fb59802346ef\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.249987 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.249873    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec1f9318-4047-4dfd-b561-fb59802346ef-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w\" (UID: \"ec1f9318-4047-4dfd-b561-fb59802346ef\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.249987 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.249889    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec1f9318-4047-4dfd-b561-fb59802346ef-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w\" (UID: \"ec1f9318-4047-4dfd-b561-fb59802346ef\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.250280 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.250240    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec1f9318-4047-4dfd-b561-fb59802346ef-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w\" (UID: \"ec1f9318-4047-4dfd-b561-fb59802346ef\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.250348 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.250307    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec1f9318-4047-4dfd-b561-fb59802346ef-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w\" (UID: \"ec1f9318-4047-4dfd-b561-fb59802346ef\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.250415 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.250385    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec1f9318-4047-4dfd-b561-fb59802346ef-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w\" (UID: \"ec1f9318-4047-4dfd-b561-fb59802346ef\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.252240 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.252210    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec1f9318-4047-4dfd-b561-fb59802346ef-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w\" (UID: \"ec1f9318-4047-4dfd-b561-fb59802346ef\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.252355 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.252326    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec1f9318-4047-4dfd-b561-fb59802346ef-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w\" (UID: \"ec1f9318-4047-4dfd-b561-fb59802346ef\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.262123 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.262094    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l995\" (UniqueName: \"kubernetes.io/projected/ec1f9318-4047-4dfd-b561-fb59802346ef-kube-api-access-4l995\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w\" (UID: \"ec1f9318-4047-4dfd-b561-fb59802346ef\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.348152 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.348062    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:49.631347 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.631316    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"]
Sep 11 16:39:49.632523 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:39:49.632495    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec1f9318_4047_4dfd_b561_fb59802346ef.slice/crio-986386fc7f56fae725aa598725e7a0be54d93df6d0f20e60435d5e9ab389f022 WatchSource:0}: Error finding container 986386fc7f56fae725aa598725e7a0be54d93df6d0f20e60435d5e9ab389f022: Status 404 returned error can't find the container with id 986386fc7f56fae725aa598725e7a0be54d93df6d0f20e60435d5e9ab389f022
Sep 11 16:39:49.633909 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.633889    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:39:49.710032 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:49.709994    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w" event={"ID":"ec1f9318-4047-4dfd-b561-fb59802346ef","Type":"ContainerStarted","Data":"986386fc7f56fae725aa598725e7a0be54d93df6d0f20e60435d5e9ab389f022"}
Sep 11 16:39:51.725101 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:51.725063    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w" event={"ID":"ec1f9318-4047-4dfd-b561-fb59802346ef","Type":"ContainerStarted","Data":"db2999b525c4959eab4e32079e6ab44a1166bdf075b3492946721e06dc4bc105"}
Sep 11 16:39:51.752350 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:51.752284    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w" podStartSLOduration=1.5204148769999999 podStartE2EDuration="2.752261556s" totalImagesPullingTime="1.231846679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:39:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:39:51.750257574 +0000 UTC m=+611.368531742" watchObservedRunningTime="2026-09-11 16:39:51.752261556 +0000 UTC m=+611.370535728"
Sep 11 16:39:59.349093 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:59.349051    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:59.349519 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:59.349125    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:59.361853 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:59.361827    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:39:59.779107 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:39:59.779076    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w"
Sep 11 16:40:22.403575 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.403539    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"]
Sep 11 16:40:22.407212 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.407189    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.412320 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.412293    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 11 16:40:22.424735 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.424701    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"]
Sep 11 16:40:22.445218 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.445185    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6643fdbf-2d04-4f05-9c9f-e5b7988ae44e-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44\" (UID: \"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.445382 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.445286    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6643fdbf-2d04-4f05-9c9f-e5b7988ae44e-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44\" (UID: \"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.445382 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.445331    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6643fdbf-2d04-4f05-9c9f-e5b7988ae44e-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44\" (UID: \"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.445460 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.445432    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6643fdbf-2d04-4f05-9c9f-e5b7988ae44e-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44\" (UID: \"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.445509 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.445491    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6643fdbf-2d04-4f05-9c9f-e5b7988ae44e-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44\" (UID: \"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.445546 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.445520    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfm5g\" (UniqueName: \"kubernetes.io/projected/6643fdbf-2d04-4f05-9c9f-e5b7988ae44e-kube-api-access-cfm5g\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44\" (UID: \"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.546580 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.546545    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6643fdbf-2d04-4f05-9c9f-e5b7988ae44e-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44\" (UID: \"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.546768 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.546701    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6643fdbf-2d04-4f05-9c9f-e5b7988ae44e-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44\" (UID: \"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.546768 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.546731    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6643fdbf-2d04-4f05-9c9f-e5b7988ae44e-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44\" (UID: \"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.546768 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.546747    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfm5g\" (UniqueName: \"kubernetes.io/projected/6643fdbf-2d04-4f05-9c9f-e5b7988ae44e-kube-api-access-cfm5g\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44\" (UID: \"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.546905 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.546801    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6643fdbf-2d04-4f05-9c9f-e5b7988ae44e-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44\" (UID: \"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.546905 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.546834    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6643fdbf-2d04-4f05-9c9f-e5b7988ae44e-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44\" (UID: \"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.547007 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.546984    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6643fdbf-2d04-4f05-9c9f-e5b7988ae44e-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44\" (UID: \"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.547063 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.547030    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6643fdbf-2d04-4f05-9c9f-e5b7988ae44e-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44\" (UID: \"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.547182 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.547150    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6643fdbf-2d04-4f05-9c9f-e5b7988ae44e-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44\" (UID: \"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.549182 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.549155    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6643fdbf-2d04-4f05-9c9f-e5b7988ae44e-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44\" (UID: \"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.549407 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.549386    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6643fdbf-2d04-4f05-9c9f-e5b7988ae44e-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44\" (UID: \"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.555755 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.555736    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfm5g\" (UniqueName: \"kubernetes.io/projected/6643fdbf-2d04-4f05-9c9f-e5b7988ae44e-kube-api-access-cfm5g\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44\" (UID: \"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.723948 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.723855    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:22.998224 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:22.998195    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"]
Sep 11 16:40:22.999569 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:40:22.999544    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6643fdbf_2d04_4f05_9c9f_e5b7988ae44e.slice/crio-dc002d5508f5cd6e24d4c71e7b0448200e401f2d7a79f282dfc72f25d37f0614 WatchSource:0}: Error finding container dc002d5508f5cd6e24d4c71e7b0448200e401f2d7a79f282dfc72f25d37f0614: Status 404 returned error can't find the container with id dc002d5508f5cd6e24d4c71e7b0448200e401f2d7a79f282dfc72f25d37f0614
Sep 11 16:40:23.904307 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:23.904266    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44" event={"ID":"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e","Type":"ContainerStarted","Data":"b50127a95624f90bc06d8ddeef958c09a7211b32f2edf18008e701c2ae1ff2b0"}
Sep 11 16:40:23.904897 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:23.904336    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44" event={"ID":"6643fdbf-2d04-4f05-9c9f-e5b7988ae44e","Type":"ContainerStarted","Data":"dc002d5508f5cd6e24d4c71e7b0448200e401f2d7a79f282dfc72f25d37f0614"}
Sep 11 16:40:23.936387 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:23.936331    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44" podStartSLOduration=1.732141664 podStartE2EDuration="1.936313518s" totalImagesPullingTime="204.171854ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:40:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:40:23.934097147 +0000 UTC m=+643.552371319" watchObservedRunningTime="2026-09-11 16:40:23.936313518 +0000 UTC m=+643.554587688"
Sep 11 16:40:32.724916 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:32.724870    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:32.725416 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:32.724937    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:32.740596 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:32.740560    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:32.968054 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:32.968017    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44"
Sep 11 16:40:34.410878 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.410825    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"]
Sep 11 16:40:34.415551 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.415528    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:34.418520 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.418503    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 11 16:40:34.428719 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.428692    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"]
Sep 11 16:40:34.457639 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.457595    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxlfb\" (UniqueName: \"kubernetes.io/projected/28092de8-d4f7-408e-8e22-b546a1822f90-kube-api-access-qxlfb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7\" (UID: \"28092de8-d4f7-408e-8e22-b546a1822f90\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:34.457822 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.457687    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28092de8-d4f7-408e-8e22-b546a1822f90-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7\" (UID: \"28092de8-d4f7-408e-8e22-b546a1822f90\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:34.457822 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.457729    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28092de8-d4f7-408e-8e22-b546a1822f90-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7\" (UID: \"28092de8-d4f7-408e-8e22-b546a1822f90\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:34.457822 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.457805    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28092de8-d4f7-408e-8e22-b546a1822f90-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7\" (UID: \"28092de8-d4f7-408e-8e22-b546a1822f90\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:34.457998 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.457839    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28092de8-d4f7-408e-8e22-b546a1822f90-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7\" (UID: \"28092de8-d4f7-408e-8e22-b546a1822f90\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:34.457998 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.457909    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28092de8-d4f7-408e-8e22-b546a1822f90-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7\" (UID: \"28092de8-d4f7-408e-8e22-b546a1822f90\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:34.558940 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.558901    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28092de8-d4f7-408e-8e22-b546a1822f90-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7\" (UID: \"28092de8-d4f7-408e-8e22-b546a1822f90\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:34.559127 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.558953    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxlfb\" (UniqueName: \"kubernetes.io/projected/28092de8-d4f7-408e-8e22-b546a1822f90-kube-api-access-qxlfb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7\" (UID: \"28092de8-d4f7-408e-8e22-b546a1822f90\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:34.559127 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.558975    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28092de8-d4f7-408e-8e22-b546a1822f90-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7\" (UID: \"28092de8-d4f7-408e-8e22-b546a1822f90\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:34.559127 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.558999    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28092de8-d4f7-408e-8e22-b546a1822f90-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7\" (UID: \"28092de8-d4f7-408e-8e22-b546a1822f90\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:34.559127 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.559029    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28092de8-d4f7-408e-8e22-b546a1822f90-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7\" (UID: \"28092de8-d4f7-408e-8e22-b546a1822f90\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:34.559127 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.559051    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28092de8-d4f7-408e-8e22-b546a1822f90-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7\" (UID: \"28092de8-d4f7-408e-8e22-b546a1822f90\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:34.559441 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.559413    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28092de8-d4f7-408e-8e22-b546a1822f90-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7\" (UID: \"28092de8-d4f7-408e-8e22-b546a1822f90\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:34.559520 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.559422    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28092de8-d4f7-408e-8e22-b546a1822f90-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7\" (UID: \"28092de8-d4f7-408e-8e22-b546a1822f90\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:34.559572 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.559508    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28092de8-d4f7-408e-8e22-b546a1822f90-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7\" (UID: \"28092de8-d4f7-408e-8e22-b546a1822f90\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:34.561451 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.561427    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28092de8-d4f7-408e-8e22-b546a1822f90-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7\" (UID: \"28092de8-d4f7-408e-8e22-b546a1822f90\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:34.561598 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.561580    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28092de8-d4f7-408e-8e22-b546a1822f90-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7\" (UID: \"28092de8-d4f7-408e-8e22-b546a1822f90\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:34.568676 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.568649    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxlfb\" (UniqueName: \"kubernetes.io/projected/28092de8-d4f7-408e-8e22-b546a1822f90-kube-api-access-qxlfb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7\" (UID: \"28092de8-d4f7-408e-8e22-b546a1822f90\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:34.727194 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:34.727081    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:35.005399 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:35.005367    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"]
Sep 11 16:40:35.006480 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:40:35.006454    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28092de8_d4f7_408e_8e22_b546a1822f90.slice/crio-3fe3879750cce6a182573e07e21b06b43509977f11ef0598f2bc6a0838b74017 WatchSource:0}: Error finding container 3fe3879750cce6a182573e07e21b06b43509977f11ef0598f2bc6a0838b74017: Status 404 returned error can't find the container with id 3fe3879750cce6a182573e07e21b06b43509977f11ef0598f2bc6a0838b74017
Sep 11 16:40:35.975740 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:35.975704    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7" event={"ID":"28092de8-d4f7-408e-8e22-b546a1822f90","Type":"ContainerStarted","Data":"8ed3bb658aa287dd7e040b0d59dd095746117338666e36447183874e71ffe221"}
Sep 11 16:40:35.976148 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:35.975769    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7" event={"ID":"28092de8-d4f7-408e-8e22-b546a1822f90","Type":"ContainerStarted","Data":"3fe3879750cce6a182573e07e21b06b43509977f11ef0598f2bc6a0838b74017"}
Sep 11 16:40:36.003824 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:36.003757    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7" podStartSLOduration=1.807783459 podStartE2EDuration="2.003740619s" totalImagesPullingTime="195.95716ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:40:36.001734719 +0000 UTC m=+655.620008890" watchObservedRunningTime="2026-09-11 16:40:36.003740619 +0000 UTC m=+655.622014788"
Sep 11 16:40:44.727474 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:44.727427    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:44.728069 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:44.727531    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:44.740303 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:44.740274    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:40:45.034276 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:40:45.034247    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7"
Sep 11 16:42:15.159217 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:15.159128    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c7d987cd5-cktdr"]
Sep 11 16:42:15.162492 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:15.162469    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c7d987cd5-cktdr"
Sep 11 16:42:15.175730 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:15.175700    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c7d987cd5-cktdr"]
Sep 11 16:42:15.269554 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:15.269510    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dbdc609d-0175-406f-8a6a-9d7c2ec98a66-tls-cert\") pod \"authorino-7c7d987cd5-cktdr\" (UID: \"dbdc609d-0175-406f-8a6a-9d7c2ec98a66\") " pod="kuadrant-system/authorino-7c7d987cd5-cktdr"
Sep 11 16:42:15.269769 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:15.269596    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw7gj\" (UniqueName: \"kubernetes.io/projected/dbdc609d-0175-406f-8a6a-9d7c2ec98a66-kube-api-access-xw7gj\") pod \"authorino-7c7d987cd5-cktdr\" (UID: \"dbdc609d-0175-406f-8a6a-9d7c2ec98a66\") " pod="kuadrant-system/authorino-7c7d987cd5-cktdr"
Sep 11 16:42:15.370946 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:15.370905    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dbdc609d-0175-406f-8a6a-9d7c2ec98a66-tls-cert\") pod \"authorino-7c7d987cd5-cktdr\" (UID: \"dbdc609d-0175-406f-8a6a-9d7c2ec98a66\") " pod="kuadrant-system/authorino-7c7d987cd5-cktdr"
Sep 11 16:42:15.371138 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:15.370983    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw7gj\" (UniqueName: \"kubernetes.io/projected/dbdc609d-0175-406f-8a6a-9d7c2ec98a66-kube-api-access-xw7gj\") pod \"authorino-7c7d987cd5-cktdr\" (UID: \"dbdc609d-0175-406f-8a6a-9d7c2ec98a66\") " pod="kuadrant-system/authorino-7c7d987cd5-cktdr"
Sep 11 16:42:15.373420 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:15.373394    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dbdc609d-0175-406f-8a6a-9d7c2ec98a66-tls-cert\") pod \"authorino-7c7d987cd5-cktdr\" (UID: \"dbdc609d-0175-406f-8a6a-9d7c2ec98a66\") " pod="kuadrant-system/authorino-7c7d987cd5-cktdr"
Sep 11 16:42:15.384830 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:15.384806    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw7gj\" (UniqueName: \"kubernetes.io/projected/dbdc609d-0175-406f-8a6a-9d7c2ec98a66-kube-api-access-xw7gj\") pod \"authorino-7c7d987cd5-cktdr\" (UID: \"dbdc609d-0175-406f-8a6a-9d7c2ec98a66\") " pod="kuadrant-system/authorino-7c7d987cd5-cktdr"
Sep 11 16:42:15.471114 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:15.471031    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c7d987cd5-cktdr"
Sep 11 16:42:15.744339 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:15.744305    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c7d987cd5-cktdr"]
Sep 11 16:42:15.745800 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:42:15.745770    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbdc609d_0175_406f_8a6a_9d7c2ec98a66.slice/crio-03314a428ebbe09faa29ccdb505d26bbe55cf41f24bb924a1d32bb3096926fb4 WatchSource:0}: Error finding container 03314a428ebbe09faa29ccdb505d26bbe55cf41f24bb924a1d32bb3096926fb4: Status 404 returned error can't find the container with id 03314a428ebbe09faa29ccdb505d26bbe55cf41f24bb924a1d32bb3096926fb4
Sep 11 16:42:16.505519 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:16.505476    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c7d987cd5-cktdr" event={"ID":"dbdc609d-0175-406f-8a6a-9d7c2ec98a66","Type":"ContainerStarted","Data":"03314a428ebbe09faa29ccdb505d26bbe55cf41f24bb924a1d32bb3096926fb4"}
Sep 11 16:42:20.530365 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:20.530323    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c7d987cd5-cktdr" event={"ID":"dbdc609d-0175-406f-8a6a-9d7c2ec98a66","Type":"ContainerStarted","Data":"6e20031756f9ac467de129b1f302dd417f105d123dcb016001a1ef7ffde57bdc"}
Sep 11 16:42:20.573295 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:20.573228    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c7d987cd5-cktdr" podStartSLOduration=1.254244979 podStartE2EDuration="5.573207631s" totalImagesPullingTime="4.318962652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:42:20.571959722 +0000 UTC m=+760.190233895" watchObservedRunningTime="2026-09-11 16:42:20.573207631 +0000 UTC m=+760.191481801"
Sep 11 16:42:20.649774 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:20.649732    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-588f7db564-tcnrk"]
Sep 11 16:42:20.650065 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:20.649939    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-588f7db564-tcnrk" podUID="d8b95b02-d437-45ae-9180-a7c40c8048a6" containerName="authorino" containerID="cri-o://7bcaa8585c3c1234107a2d7d0517d55b62e1d31d515c666f1395e54ef4a595c0" gracePeriod=30
Sep 11 16:42:20.901321 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:20.901288    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-588f7db564-tcnrk"
Sep 11 16:42:21.021100 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:21.021067    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jw2g8\" (UniqueName: \"kubernetes.io/projected/d8b95b02-d437-45ae-9180-a7c40c8048a6-kube-api-access-jw2g8\") pod \"d8b95b02-d437-45ae-9180-a7c40c8048a6\" (UID: \"d8b95b02-d437-45ae-9180-a7c40c8048a6\") "
Sep 11 16:42:21.021100 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:21.021105    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8b95b02-d437-45ae-9180-a7c40c8048a6-tls-cert\") pod \"d8b95b02-d437-45ae-9180-a7c40c8048a6\" (UID: \"d8b95b02-d437-45ae-9180-a7c40c8048a6\") "
Sep 11 16:42:21.023236 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:21.023201    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8b95b02-d437-45ae-9180-a7c40c8048a6-kube-api-access-jw2g8" (OuterVolumeSpecName: "kube-api-access-jw2g8") pod "d8b95b02-d437-45ae-9180-a7c40c8048a6" (UID: "d8b95b02-d437-45ae-9180-a7c40c8048a6"). InnerVolumeSpecName "kube-api-access-jw2g8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:42:21.034525 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:21.034487    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8b95b02-d437-45ae-9180-a7c40c8048a6-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d8b95b02-d437-45ae-9180-a7c40c8048a6" (UID: "d8b95b02-d437-45ae-9180-a7c40c8048a6"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:42:21.122467 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:21.122426    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw2g8\" (UniqueName: \"kubernetes.io/projected/d8b95b02-d437-45ae-9180-a7c40c8048a6-kube-api-access-jw2g8\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:42:21.122467 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:21.122456    2557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d8b95b02-d437-45ae-9180-a7c40c8048a6-tls-cert\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:42:21.538894 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:21.538853    2557 generic.go:356] "Generic (PLEG): container finished" podID="d8b95b02-d437-45ae-9180-a7c40c8048a6" containerID="7bcaa8585c3c1234107a2d7d0517d55b62e1d31d515c666f1395e54ef4a595c0" exitCode=0
Sep 11 16:42:21.539318 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:21.538913    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-588f7db564-tcnrk"
Sep 11 16:42:21.539318 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:21.538938    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-588f7db564-tcnrk" event={"ID":"d8b95b02-d437-45ae-9180-a7c40c8048a6","Type":"ContainerDied","Data":"7bcaa8585c3c1234107a2d7d0517d55b62e1d31d515c666f1395e54ef4a595c0"}
Sep 11 16:42:21.539318 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:21.538985    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-588f7db564-tcnrk" event={"ID":"d8b95b02-d437-45ae-9180-a7c40c8048a6","Type":"ContainerDied","Data":"bd2de76663ac5b6c00e0e9f61579ed47fd983a8169c6d8e4b0e81af840f780b4"}
Sep 11 16:42:21.539318 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:21.539007    2557 scope.go:117] "RemoveContainer" containerID="7bcaa8585c3c1234107a2d7d0517d55b62e1d31d515c666f1395e54ef4a595c0"
Sep 11 16:42:21.550880 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:21.550861    2557 scope.go:117] "RemoveContainer" containerID="7bcaa8585c3c1234107a2d7d0517d55b62e1d31d515c666f1395e54ef4a595c0"
Sep 11 16:42:21.551275 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:42:21.551254    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bcaa8585c3c1234107a2d7d0517d55b62e1d31d515c666f1395e54ef4a595c0\": container with ID starting with 7bcaa8585c3c1234107a2d7d0517d55b62e1d31d515c666f1395e54ef4a595c0 not found: ID does not exist" containerID="7bcaa8585c3c1234107a2d7d0517d55b62e1d31d515c666f1395e54ef4a595c0"
Sep 11 16:42:21.551325 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:21.551285    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bcaa8585c3c1234107a2d7d0517d55b62e1d31d515c666f1395e54ef4a595c0"} err="failed to get container status \"7bcaa8585c3c1234107a2d7d0517d55b62e1d31d515c666f1395e54ef4a595c0\": rpc error: code = NotFound desc = could not find container \"7bcaa8585c3c1234107a2d7d0517d55b62e1d31d515c666f1395e54ef4a595c0\": container with ID starting with 7bcaa8585c3c1234107a2d7d0517d55b62e1d31d515c666f1395e54ef4a595c0 not found: ID does not exist"
Sep 11 16:42:21.572843 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:21.572808    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-588f7db564-tcnrk"]
Sep 11 16:42:21.577011 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:21.576982    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-588f7db564-tcnrk"]
Sep 11 16:42:22.946727 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:22.946685    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8b95b02-d437-45ae-9180-a7c40c8048a6" path="/var/lib/kubelet/pods/d8b95b02-d437-45ae-9180-a7c40c8048a6/volumes"
Sep 11 16:42:38.430705 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.430668    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"]
Sep 11 16:42:38.431110 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.431066    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b95b02-d437-45ae-9180-a7c40c8048a6" containerName="authorino"
Sep 11 16:42:38.431110 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.431078    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b95b02-d437-45ae-9180-a7c40c8048a6" containerName="authorino"
Sep 11 16:42:38.431185 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.431143    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8b95b02-d437-45ae-9180-a7c40c8048a6" containerName="authorino"
Sep 11 16:42:38.434852 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.434829    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.437808 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.437778    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-4264bf-openshift-default-dockercfg-hxt8t\""
Sep 11 16:42:38.449281 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.449249    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"]
Sep 11 16:42:38.479787 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.479752    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-workload-certs\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.479787 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.479790    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-podinfo\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.480060 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.479814    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-token\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.480060 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.479884    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-data\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.480060 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.479971    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-envoy\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.480060 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.480045    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-workload-socket\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.480240 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.480085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwqpb\" (UniqueName: \"kubernetes.io/projected/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-kube-api-access-zwqpb\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.480240 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.480144    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istiod-ca-cert\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.480240 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.480177    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-credential-socket\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.580849 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.580808    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-workload-certs\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.581043 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.580857    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-podinfo\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.581043 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.580880    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-token\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.581043 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.580904    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-data\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.581043 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.581026    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-envoy\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.581315 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.581104    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-workload-socket\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.581315 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.581147    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwqpb\" (UniqueName: \"kubernetes.io/projected/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-kube-api-access-zwqpb\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.581315 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.581189    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istiod-ca-cert\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.581315 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.581264    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-workload-certs\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.581525 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.581341    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-data\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.581525 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.581405    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-credential-socket\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.581525 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.581521    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-workload-socket\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.581763 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.581742    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-credential-socket\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.581954 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.581930    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istiod-ca-cert\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.583501 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.583475    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-envoy\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.583636 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.583599    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-podinfo\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.591213 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.591178    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-token\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.594165 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.594133    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwqpb\" (UniqueName: \"kubernetes.io/projected/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-kube-api-access-zwqpb\") pod \"e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") " pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:38.750886 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:38.750787    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:39.041263 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:39.041221    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"]
Sep 11 16:42:39.041751 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:42:39.041715    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9bebf44_14c6_4d31_adaa_2ce9e71b5125.slice/crio-ce491f4c1d272de4147e5170ba03a68f53081e2fed0188a795f2aee5539359fd WatchSource:0}: Error finding container ce491f4c1d272de4147e5170ba03a68f53081e2fed0188a795f2aee5539359fd: Status 404 returned error can't find the container with id ce491f4c1d272de4147e5170ba03a68f53081e2fed0188a795f2aee5539359fd
Sep 11 16:42:39.044511 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:39.044477    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:42:39.044585 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:39.044543    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:42:39.044585 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:39.044571    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:42:39.643558 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:39.643510    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf" event={"ID":"b9bebf44-14c6-4d31-adaa-2ce9e71b5125","Type":"ContainerStarted","Data":"dc23f6cadaaf6e5831f99c9471b135bf326acc02266b6ff198851b870df90ea6"}
Sep 11 16:42:39.644082 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:39.643682    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf" event={"ID":"b9bebf44-14c6-4d31-adaa-2ce9e71b5125","Type":"ContainerStarted","Data":"ce491f4c1d272de4147e5170ba03a68f53081e2fed0188a795f2aee5539359fd"}
Sep 11 16:42:39.690512 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:39.690459    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf" podStartSLOduration=1.690442922 podStartE2EDuration="1.690442922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:42:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:42:39.687018306 +0000 UTC m=+779.305292477" watchObservedRunningTime="2026-09-11 16:42:39.690442922 +0000 UTC m=+779.308717091"
Sep 11 16:42:39.751891 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:39.751844    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:40.756938 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:40.756906    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:41.655460 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:41.655416    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:41.656419 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:41.656395    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:42:42.836860 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:42.836818    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"]
Sep 11 16:42:42.841759 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:42.841730    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"
Sep 11 16:42:42.844621 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:42.844586    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-4264bf-serving-cert\""
Sep 11 16:42:42.851382 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:42.851357    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"]
Sep 11 16:42:42.921165 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:42.921121    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw8v7\" (UniqueName: \"kubernetes.io/projected/b599286d-184b-4db1-8b88-dd782f726857-kube-api-access-gw8v7\") pod \"maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z\" (UID: \"b599286d-184b-4db1-8b88-dd782f726857\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"
Sep 11 16:42:42.921328 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:42.921188    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b599286d-184b-4db1-8b88-dd782f726857-metrics-certs\") pod \"maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z\" (UID: \"b599286d-184b-4db1-8b88-dd782f726857\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"
Sep 11 16:42:42.921328 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:42.921307    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b599286d-184b-4db1-8b88-dd782f726857-maas-api-tls\") pod \"maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z\" (UID: \"b599286d-184b-4db1-8b88-dd782f726857\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"
Sep 11 16:42:42.921438 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:42.921340    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b599286d-184b-4db1-8b88-dd782f726857-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z\" (UID: \"b599286d-184b-4db1-8b88-dd782f726857\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"
Sep 11 16:42:43.022198 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.022148    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw8v7\" (UniqueName: \"kubernetes.io/projected/b599286d-184b-4db1-8b88-dd782f726857-kube-api-access-gw8v7\") pod \"maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z\" (UID: \"b599286d-184b-4db1-8b88-dd782f726857\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"
Sep 11 16:42:43.022414 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.022222    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b599286d-184b-4db1-8b88-dd782f726857-metrics-certs\") pod \"maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z\" (UID: \"b599286d-184b-4db1-8b88-dd782f726857\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"
Sep 11 16:42:43.022414 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.022299    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b599286d-184b-4db1-8b88-dd782f726857-maas-api-tls\") pod \"maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z\" (UID: \"b599286d-184b-4db1-8b88-dd782f726857\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"
Sep 11 16:42:43.022414 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.022327    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b599286d-184b-4db1-8b88-dd782f726857-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z\" (UID: \"b599286d-184b-4db1-8b88-dd782f726857\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"
Sep 11 16:42:43.022593 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:42:43.022421    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-serving-cert: secret "maas-api-e2e-inf-a-4264bf-serving-cert" not found
Sep 11 16:42:43.022593 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:42:43.022491    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b599286d-184b-4db1-8b88-dd782f726857-maas-api-tls podName:b599286d-184b-4db1-8b88-dd782f726857 nodeName:}" failed. No retries permitted until 2026-09-11 16:42:43.522468157 +0000 UTC m=+783.140742323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b599286d-184b-4db1-8b88-dd782f726857-maas-api-tls") pod "maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z" (UID: "b599286d-184b-4db1-8b88-dd782f726857") : secret "maas-api-e2e-inf-a-4264bf-serving-cert" not found
Sep 11 16:42:43.023262 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.023233    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b599286d-184b-4db1-8b88-dd782f726857-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z\" (UID: \"b599286d-184b-4db1-8b88-dd782f726857\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"
Sep 11 16:42:43.024926 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.024905    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b599286d-184b-4db1-8b88-dd782f726857-metrics-certs\") pod \"maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z\" (UID: \"b599286d-184b-4db1-8b88-dd782f726857\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"
Sep 11 16:42:43.037853 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.037818    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw8v7\" (UniqueName: \"kubernetes.io/projected/b599286d-184b-4db1-8b88-dd782f726857-kube-api-access-gw8v7\") pod \"maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z\" (UID: \"b599286d-184b-4db1-8b88-dd782f726857\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"
Sep 11 16:42:43.526723 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.526688    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b599286d-184b-4db1-8b88-dd782f726857-maas-api-tls\") pod \"maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z\" (UID: \"b599286d-184b-4db1-8b88-dd782f726857\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"
Sep 11 16:42:43.529251 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.529216    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b599286d-184b-4db1-8b88-dd782f726857-maas-api-tls\") pod \"maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z\" (UID: \"b599286d-184b-4db1-8b88-dd782f726857\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"
Sep 11 16:42:43.571421 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.571380    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26"]
Sep 11 16:42:43.582737 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.582701    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26"
Sep 11 16:42:43.585136 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.585105    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26"]
Sep 11 16:42:43.586321 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.586296    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-4264bf\""
Sep 11 16:42:43.628104 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.628067    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68n8d\" (UniqueName: \"kubernetes.io/projected/f641af03-346a-47cb-b87a-e2d705a018ef-kube-api-access-68n8d\") pod \"payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26\" (UID: \"f641af03-346a-47cb-b87a-e2d705a018ef\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26"
Sep 11 16:42:43.628343 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.628120    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f641af03-346a-47cb-b87a-e2d705a018ef-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26\" (UID: \"f641af03-346a-47cb-b87a-e2d705a018ef\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26"
Sep 11 16:42:43.633667 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.633633    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv"]
Sep 11 16:42:43.637806 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.637780    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv"
Sep 11 16:42:43.641126 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.641081    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-4264bf-dockercfg-frd5m\""
Sep 11 16:42:43.652602 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.652573    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv"]
Sep 11 16:42:43.728982 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.728938    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2lnl\" (UniqueName: \"kubernetes.io/projected/74a4203d-3c62-4b23-88f4-f99c88456baa-kube-api-access-v2lnl\") pod \"payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv\" (UID: \"74a4203d-3c62-4b23-88f4-f99c88456baa\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv"
Sep 11 16:42:43.729170 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.729006    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68n8d\" (UniqueName: \"kubernetes.io/projected/f641af03-346a-47cb-b87a-e2d705a018ef-kube-api-access-68n8d\") pod \"payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26\" (UID: \"f641af03-346a-47cb-b87a-e2d705a018ef\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26"
Sep 11 16:42:43.729170 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.729048    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f641af03-346a-47cb-b87a-e2d705a018ef-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26\" (UID: \"f641af03-346a-47cb-b87a-e2d705a018ef\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26"
Sep 11 16:42:43.729170 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.729134    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74a4203d-3c62-4b23-88f4-f99c88456baa-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv\" (UID: \"74a4203d-3c62-4b23-88f4-f99c88456baa\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv"
Sep 11 16:42:43.729809 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.729786    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f641af03-346a-47cb-b87a-e2d705a018ef-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26\" (UID: \"f641af03-346a-47cb-b87a-e2d705a018ef\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26"
Sep 11 16:42:43.743429 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.743401    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68n8d\" (UniqueName: \"kubernetes.io/projected/f641af03-346a-47cb-b87a-e2d705a018ef-kube-api-access-68n8d\") pod \"payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26\" (UID: \"f641af03-346a-47cb-b87a-e2d705a018ef\") " pod="openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26"
Sep 11 16:42:43.757304 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.757265    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"
Sep 11 16:42:43.830850 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.830432    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74a4203d-3c62-4b23-88f4-f99c88456baa-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv\" (UID: \"74a4203d-3c62-4b23-88f4-f99c88456baa\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv"
Sep 11 16:42:43.830850 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.830478    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2lnl\" (UniqueName: \"kubernetes.io/projected/74a4203d-3c62-4b23-88f4-f99c88456baa-kube-api-access-v2lnl\") pod \"payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv\" (UID: \"74a4203d-3c62-4b23-88f4-f99c88456baa\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv"
Sep 11 16:42:43.831464 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.831432    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74a4203d-3c62-4b23-88f4-f99c88456baa-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv\" (UID: \"74a4203d-3c62-4b23-88f4-f99c88456baa\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv"
Sep 11 16:42:43.842064 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.841981    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2lnl\" (UniqueName: \"kubernetes.io/projected/74a4203d-3c62-4b23-88f4-f99c88456baa-kube-api-access-v2lnl\") pod \"payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv\" (UID: \"74a4203d-3c62-4b23-88f4-f99c88456baa\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv"
Sep 11 16:42:43.896668 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.896593    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26"
Sep 11 16:42:43.951396 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:43.951346    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv"
Sep 11 16:42:44.047668 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:44.046234    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"]
Sep 11 16:42:44.047668 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:42:44.046818    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb599286d_184b_4db1_8b88_dd782f726857.slice/crio-7d14ee50e82fa479922a0fa07f9b8e9cd8d1b96be3a55d4cd1b01c9adcfbb309 WatchSource:0}: Error finding container 7d14ee50e82fa479922a0fa07f9b8e9cd8d1b96be3a55d4cd1b01c9adcfbb309: Status 404 returned error can't find the container with id 7d14ee50e82fa479922a0fa07f9b8e9cd8d1b96be3a55d4cd1b01c9adcfbb309
Sep 11 16:42:44.173886 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:44.173856    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26"]
Sep 11 16:42:44.175330 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:42:44.175300    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf641af03_346a_47cb_b87a_e2d705a018ef.slice/crio-3e6b3474b240e9a319550d9697b3059cce2f90d856b1609a1cc7f73ee2b145bd WatchSource:0}: Error finding container 3e6b3474b240e9a319550d9697b3059cce2f90d856b1609a1cc7f73ee2b145bd: Status 404 returned error can't find the container with id 3e6b3474b240e9a319550d9697b3059cce2f90d856b1609a1cc7f73ee2b145bd
Sep 11 16:42:44.250054 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:44.250019    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv"]
Sep 11 16:42:44.251297 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:42:44.251273    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74a4203d_3c62_4b23_88f4_f99c88456baa.slice/crio-fd0ae4b375a3ead7590b30f583eb1c67d0a40f89f31df3b017b9b00b36236b1a WatchSource:0}: Error finding container fd0ae4b375a3ead7590b30f583eb1c67d0a40f89f31df3b017b9b00b36236b1a: Status 404 returned error can't find the container with id fd0ae4b375a3ead7590b30f583eb1c67d0a40f89f31df3b017b9b00b36236b1a
Sep 11 16:42:44.678292 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:44.678252    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv" event={"ID":"74a4203d-3c62-4b23-88f4-f99c88456baa","Type":"ContainerStarted","Data":"40ec7270e4fc3fb1765af484f79cdbde13c239f1f663e20d3d5a87d87f28866a"}
Sep 11 16:42:44.678473 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:44.678442    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv"
Sep 11 16:42:44.678553 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:44.678485    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv" event={"ID":"74a4203d-3c62-4b23-88f4-f99c88456baa","Type":"ContainerStarted","Data":"fd0ae4b375a3ead7590b30f583eb1c67d0a40f89f31df3b017b9b00b36236b1a"}
Sep 11 16:42:44.679649 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:44.679623    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z" event={"ID":"b599286d-184b-4db1-8b88-dd782f726857","Type":"ContainerStarted","Data":"7d14ee50e82fa479922a0fa07f9b8e9cd8d1b96be3a55d4cd1b01c9adcfbb309"}
Sep 11 16:42:44.681155 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:44.681131    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26" event={"ID":"f641af03-346a-47cb-b87a-e2d705a018ef","Type":"ContainerStarted","Data":"5de0307b67746770cdb63afff42da724dc2abb23006c397ad1a9c3549a491c44"}
Sep 11 16:42:44.681259 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:44.681169    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26" event={"ID":"f641af03-346a-47cb-b87a-e2d705a018ef","Type":"ContainerStarted","Data":"3e6b3474b240e9a319550d9697b3059cce2f90d856b1609a1cc7f73ee2b145bd"}
Sep 11 16:42:44.681259 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:44.681199    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26"
Sep 11 16:42:44.701969 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:44.701908    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv" podStartSLOduration=1.701891399 podStartE2EDuration="1.701891399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:42:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:42:44.699317375 +0000 UTC m=+784.317591546" watchObservedRunningTime="2026-09-11 16:42:44.701891399 +0000 UTC m=+784.320165569"
Sep 11 16:42:44.721411 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:44.721367    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26" podStartSLOduration=1.721345057 podStartE2EDuration="1.721345057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:42:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:42:44.719701075 +0000 UTC m=+784.337975245" watchObservedRunningTime="2026-09-11 16:42:44.721345057 +0000 UTC m=+784.339619221"
Sep 11 16:42:45.688989 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:45.688947    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z" event={"ID":"b599286d-184b-4db1-8b88-dd782f726857","Type":"ContainerStarted","Data":"ff41a42f199cf7714f7d279529d86e3221dad90657eb4477ec724ee6a3f83fdd"}
Sep 11 16:42:45.689518 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:45.689327    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"
Sep 11 16:42:45.709950 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:45.709894    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z" podStartSLOduration=3.054173162 podStartE2EDuration="3.70987791s" totalImagesPullingTime="655.704748ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:42:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:42:45.707128569 +0000 UTC m=+785.325402740" watchObservedRunningTime="2026-09-11 16:42:45.70987791 +0000 UTC m=+785.328152237"
Sep 11 16:42:51.639711 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:51.639665    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp"]
Sep 11 16:42:51.651197 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:51.651160    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp"
Sep 11 16:42:51.657568 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:51.657536    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp"]
Sep 11 16:42:51.659027 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:51.658029    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-42752c\""
Sep 11 16:42:51.711442 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:51.711408    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gslwv\" (UniqueName: \"kubernetes.io/projected/102075ae-74e0-4472-a8d0-2e5e3fa811b7-kube-api-access-gslwv\") pod \"payload-processing-e2e-autores-42752c-6877fd584c-8wklp\" (UID: \"102075ae-74e0-4472-a8d0-2e5e3fa811b7\") " pod="openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp"
Sep 11 16:42:51.711676 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:51.711467    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/102075ae-74e0-4472-a8d0-2e5e3fa811b7-plugins-config-volume\") pod \"payload-processing-e2e-autores-42752c-6877fd584c-8wklp\" (UID: \"102075ae-74e0-4472-a8d0-2e5e3fa811b7\") " pod="openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp"
Sep 11 16:42:51.812753 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:51.812714    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gslwv\" (UniqueName: \"kubernetes.io/projected/102075ae-74e0-4472-a8d0-2e5e3fa811b7-kube-api-access-gslwv\") pod \"payload-processing-e2e-autores-42752c-6877fd584c-8wklp\" (UID: \"102075ae-74e0-4472-a8d0-2e5e3fa811b7\") " pod="openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp"
Sep 11 16:42:51.812937 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:51.812781    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/102075ae-74e0-4472-a8d0-2e5e3fa811b7-plugins-config-volume\") pod \"payload-processing-e2e-autores-42752c-6877fd584c-8wklp\" (UID: \"102075ae-74e0-4472-a8d0-2e5e3fa811b7\") " pod="openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp"
Sep 11 16:42:51.813554 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:51.813534    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/102075ae-74e0-4472-a8d0-2e5e3fa811b7-plugins-config-volume\") pod \"payload-processing-e2e-autores-42752c-6877fd584c-8wklp\" (UID: \"102075ae-74e0-4472-a8d0-2e5e3fa811b7\") " pod="openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp"
Sep 11 16:42:51.825505 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:51.825473    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gslwv\" (UniqueName: \"kubernetes.io/projected/102075ae-74e0-4472-a8d0-2e5e3fa811b7-kube-api-access-gslwv\") pod \"payload-processing-e2e-autores-42752c-6877fd584c-8wklp\" (UID: \"102075ae-74e0-4472-a8d0-2e5e3fa811b7\") " pod="openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp"
Sep 11 16:42:51.981446 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:51.981347    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp"
Sep 11 16:42:52.174907 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.174873    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"]
Sep 11 16:42:52.179809 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.179778    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"
Sep 11 16:42:52.182452 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.182428    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-845e25d3-serving-cert\""
Sep 11 16:42:52.183875 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.183848    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"]
Sep 11 16:42:52.217582 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.217550    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccfde982-dbe0-46d3-9baa-d3d47332e662-metrics-certs\") pod \"maas-api-e2e-ait-845e25d3-8464997545-9bkv7\" (UID: \"ccfde982-dbe0-46d3-9baa-d3d47332e662\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"
Sep 11 16:42:52.217768 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.217590    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmhsv\" (UniqueName: \"kubernetes.io/projected/ccfde982-dbe0-46d3-9baa-d3d47332e662-kube-api-access-cmhsv\") pod \"maas-api-e2e-ait-845e25d3-8464997545-9bkv7\" (UID: \"ccfde982-dbe0-46d3-9baa-d3d47332e662\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"
Sep 11 16:42:52.217768 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.217691    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccfde982-dbe0-46d3-9baa-d3d47332e662-maas-api-tls\") pod \"maas-api-e2e-ait-845e25d3-8464997545-9bkv7\" (UID: \"ccfde982-dbe0-46d3-9baa-d3d47332e662\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"
Sep 11 16:42:52.217768 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.217747    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccfde982-dbe0-46d3-9baa-d3d47332e662-openshift-service-ca\") pod \"maas-api-e2e-ait-845e25d3-8464997545-9bkv7\" (UID: \"ccfde982-dbe0-46d3-9baa-d3d47332e662\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"
Sep 11 16:42:52.273222 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.273172    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp"]
Sep 11 16:42:52.280075 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:42:52.280044    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod102075ae_74e0_4472_a8d0_2e5e3fa811b7.slice/crio-14ef2c7e31a1bfcccfff2fca90fe810e982e159d91dd657ade3dda905d93e9e7 WatchSource:0}: Error finding container 14ef2c7e31a1bfcccfff2fca90fe810e982e159d91dd657ade3dda905d93e9e7: Status 404 returned error can't find the container with id 14ef2c7e31a1bfcccfff2fca90fe810e982e159d91dd657ade3dda905d93e9e7
Sep 11 16:42:52.319185 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.319151    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccfde982-dbe0-46d3-9baa-d3d47332e662-openshift-service-ca\") pod \"maas-api-e2e-ait-845e25d3-8464997545-9bkv7\" (UID: \"ccfde982-dbe0-46d3-9baa-d3d47332e662\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"
Sep 11 16:42:52.319332 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.319241    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccfde982-dbe0-46d3-9baa-d3d47332e662-metrics-certs\") pod \"maas-api-e2e-ait-845e25d3-8464997545-9bkv7\" (UID: \"ccfde982-dbe0-46d3-9baa-d3d47332e662\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"
Sep 11 16:42:52.319332 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.319274    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmhsv\" (UniqueName: \"kubernetes.io/projected/ccfde982-dbe0-46d3-9baa-d3d47332e662-kube-api-access-cmhsv\") pod \"maas-api-e2e-ait-845e25d3-8464997545-9bkv7\" (UID: \"ccfde982-dbe0-46d3-9baa-d3d47332e662\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"
Sep 11 16:42:52.319409 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.319328    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccfde982-dbe0-46d3-9baa-d3d47332e662-maas-api-tls\") pod \"maas-api-e2e-ait-845e25d3-8464997545-9bkv7\" (UID: \"ccfde982-dbe0-46d3-9baa-d3d47332e662\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"
Sep 11 16:42:52.319464 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:42:52.319446    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-serving-cert: secret "maas-api-e2e-ait-845e25d3-serving-cert" not found
Sep 11 16:42:52.319538 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:42:52.319526    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccfde982-dbe0-46d3-9baa-d3d47332e662-maas-api-tls podName:ccfde982-dbe0-46d3-9baa-d3d47332e662 nodeName:}" failed. No retries permitted until 2026-09-11 16:42:52.819504887 +0000 UTC m=+792.437779048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ccfde982-dbe0-46d3-9baa-d3d47332e662-maas-api-tls") pod "maas-api-e2e-ait-845e25d3-8464997545-9bkv7" (UID: "ccfde982-dbe0-46d3-9baa-d3d47332e662") : secret "maas-api-e2e-ait-845e25d3-serving-cert" not found
Sep 11 16:42:52.319900 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.319876    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccfde982-dbe0-46d3-9baa-d3d47332e662-openshift-service-ca\") pod \"maas-api-e2e-ait-845e25d3-8464997545-9bkv7\" (UID: \"ccfde982-dbe0-46d3-9baa-d3d47332e662\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"
Sep 11 16:42:52.321734 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.321705    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccfde982-dbe0-46d3-9baa-d3d47332e662-metrics-certs\") pod \"maas-api-e2e-ait-845e25d3-8464997545-9bkv7\" (UID: \"ccfde982-dbe0-46d3-9baa-d3d47332e662\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"
Sep 11 16:42:52.331899 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.331874    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmhsv\" (UniqueName: \"kubernetes.io/projected/ccfde982-dbe0-46d3-9baa-d3d47332e662-kube-api-access-cmhsv\") pod \"maas-api-e2e-ait-845e25d3-8464997545-9bkv7\" (UID: \"ccfde982-dbe0-46d3-9baa-d3d47332e662\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"
Sep 11 16:42:52.706197 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.706101    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"
Sep 11 16:42:52.733783 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.733744    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp" event={"ID":"102075ae-74e0-4472-a8d0-2e5e3fa811b7","Type":"ContainerStarted","Data":"eb59cfe80b75459710f343bc0a2c5862d315284f81bffe641ee05c53458eadf2"}
Sep 11 16:42:52.733978 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.733806    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp" event={"ID":"102075ae-74e0-4472-a8d0-2e5e3fa811b7","Type":"ContainerStarted","Data":"14ef2c7e31a1bfcccfff2fca90fe810e982e159d91dd657ade3dda905d93e9e7"}
Sep 11 16:42:52.734098 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.734073    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp"
Sep 11 16:42:52.825540 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.825509    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccfde982-dbe0-46d3-9baa-d3d47332e662-maas-api-tls\") pod \"maas-api-e2e-ait-845e25d3-8464997545-9bkv7\" (UID: \"ccfde982-dbe0-46d3-9baa-d3d47332e662\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"
Sep 11 16:42:52.828142 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:52.828106    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccfde982-dbe0-46d3-9baa-d3d47332e662-maas-api-tls\") pod \"maas-api-e2e-ait-845e25d3-8464997545-9bkv7\" (UID: \"ccfde982-dbe0-46d3-9baa-d3d47332e662\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"
Sep 11 16:42:53.094309 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:53.094270    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"
Sep 11 16:42:53.399215 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:53.399119    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp" podStartSLOduration=2.3991007189999998 podStartE2EDuration="2.399100719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:42:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:42:52.757752857 +0000 UTC m=+792.376027028" watchObservedRunningTime="2026-09-11 16:42:53.399100719 +0000 UTC m=+793.017374950"
Sep 11 16:42:53.402118 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:53.402095    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"]
Sep 11 16:42:53.404212 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:42:53.404179    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccfde982_dbe0_46d3_9baa_d3d47332e662.slice/crio-5dca39643d42395cee9f6413f82cd69142263716a4d2e67344484a859f099687 WatchSource:0}: Error finding container 5dca39643d42395cee9f6413f82cd69142263716a4d2e67344484a859f099687: Status 404 returned error can't find the container with id 5dca39643d42395cee9f6413f82cd69142263716a4d2e67344484a859f099687
Sep 11 16:42:53.740101 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:53.740067    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7" event={"ID":"ccfde982-dbe0-46d3-9baa-d3d47332e662","Type":"ContainerStarted","Data":"5dca39643d42395cee9f6413f82cd69142263716a4d2e67344484a859f099687"}
Sep 11 16:42:54.748885 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:54.748846    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7" event={"ID":"ccfde982-dbe0-46d3-9baa-d3d47332e662","Type":"ContainerStarted","Data":"ac3b58a63b1d66df569236d26e470d7be21bf3f6477acd6282df3fb6720b2e59"}
Sep 11 16:42:54.749354 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:54.748976    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"
Sep 11 16:42:54.769465 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:54.769406    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7" podStartSLOduration=2.448298135 podStartE2EDuration="2.769388463s" totalImagesPullingTime="321.090328ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:42:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:42:54.767241667 +0000 UTC m=+794.385515865" watchObservedRunningTime="2026-09-11 16:42:54.769388463 +0000 UTC m=+794.387662669"
Sep 11 16:42:55.691756 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:55.691719    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv"
Sep 11 16:42:55.691963 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:55.691810    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26"
Sep 11 16:42:57.697825 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:57.697780    2557 patch_prober.go:28] interesting pod/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 16:42:57.698233 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:57.697852    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf" podUID="b9bebf44-14c6-4d31-adaa-2ce9e71b5125" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 16:42:58.777758 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:58.777722    2557 generic.go:356] "Generic (PLEG): container finished" podID="b9bebf44-14c6-4d31-adaa-2ce9e71b5125" containerID="dc23f6cadaaf6e5831f99c9471b135bf326acc02266b6ff198851b870df90ea6" exitCode=0
Sep 11 16:42:58.778202 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:58.777776    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf" event={"ID":"b9bebf44-14c6-4d31-adaa-2ce9e71b5125","Type":"ContainerDied","Data":"dc23f6cadaaf6e5831f99c9471b135bf326acc02266b6ff198851b870df90ea6"}
Sep 11 16:42:58.778246 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:58.778226    2557 scope.go:117] "RemoveContainer" containerID="dc23f6cadaaf6e5831f99c9471b135bf326acc02266b6ff198851b870df90ea6"
Sep 11 16:42:58.779315 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:58.779287    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:42:58.779384 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:58.779355    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:42:58.779421 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:58.779385    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:42:59.785870 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:42:59.785833    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf" event={"ID":"b9bebf44-14c6-4d31-adaa-2ce9e71b5125","Type":"ContainerStarted","Data":"deab7f26a845fe136af07caa296f8b522b72d73b43970b097f61624438e60424"}
Sep 11 16:43:00.751136 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:00.751091    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:43:00.751877 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:00.751844    2557 patch_prober.go:28] interesting pod/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 16:43:00.752087 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:00.752062    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf" podUID="b9bebf44-14c6-4d31-adaa-2ce9e71b5125" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 16:43:00.766838 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:00.766799    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"
Sep 11 16:43:01.751892 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:01.751845    2557 patch_prober.go:28] interesting pod/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 16:43:01.752515 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:01.752481    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf" podUID="b9bebf44-14c6-4d31-adaa-2ce9e71b5125" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 16:43:02.752312 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:02.752270    2557 patch_prober.go:28] interesting pod/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 16:43:02.752963 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:02.752925    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf" podUID="b9bebf44-14c6-4d31-adaa-2ce9e71b5125" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 16:43:03.742863 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:03.742822    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp"
Sep 11 16:43:03.751977 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:03.751931    2557 patch_prober.go:28] interesting pod/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 16:43:03.752176 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:03.752012    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf" podUID="b9bebf44-14c6-4d31-adaa-2ce9e71b5125" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 16:43:04.751450 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:04.751406    2557 patch_prober.go:28] interesting pod/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 16:43:04.752111 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:04.752077    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf" podUID="b9bebf44-14c6-4d31-adaa-2ce9e71b5125" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 16:43:05.755583 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:05.755545    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:43:05.756093 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:05.756074    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:43:05.756752 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:05.756730    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:43:32.161439 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.161404    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"]
Sep 11 16:43:32.161978 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.161628    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7" podUID="ccfde982-dbe0-46d3-9baa-d3d47332e662" containerName="maas-api" containerID="cri-o://ac3b58a63b1d66df569236d26e470d7be21bf3f6477acd6282df3fb6720b2e59" gracePeriod=30
Sep 11 16:43:32.431730 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.431702    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"
Sep 11 16:43:32.511877 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.511841    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmhsv\" (UniqueName: \"kubernetes.io/projected/ccfde982-dbe0-46d3-9baa-d3d47332e662-kube-api-access-cmhsv\") pod \"ccfde982-dbe0-46d3-9baa-d3d47332e662\" (UID: \"ccfde982-dbe0-46d3-9baa-d3d47332e662\") "
Sep 11 16:43:32.512068 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.511888    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccfde982-dbe0-46d3-9baa-d3d47332e662-metrics-certs\") pod \"ccfde982-dbe0-46d3-9baa-d3d47332e662\" (UID: \"ccfde982-dbe0-46d3-9baa-d3d47332e662\") "
Sep 11 16:43:32.512068 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.511916    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccfde982-dbe0-46d3-9baa-d3d47332e662-maas-api-tls\") pod \"ccfde982-dbe0-46d3-9baa-d3d47332e662\" (UID: \"ccfde982-dbe0-46d3-9baa-d3d47332e662\") "
Sep 11 16:43:32.512068 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.512048    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccfde982-dbe0-46d3-9baa-d3d47332e662-openshift-service-ca\") pod \"ccfde982-dbe0-46d3-9baa-d3d47332e662\" (UID: \"ccfde982-dbe0-46d3-9baa-d3d47332e662\") "
Sep 11 16:43:32.512408 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.512374    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccfde982-dbe0-46d3-9baa-d3d47332e662-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ccfde982-dbe0-46d3-9baa-d3d47332e662" (UID: "ccfde982-dbe0-46d3-9baa-d3d47332e662"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:43:32.514143 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.514118    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccfde982-dbe0-46d3-9baa-d3d47332e662-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ccfde982-dbe0-46d3-9baa-d3d47332e662" (UID: "ccfde982-dbe0-46d3-9baa-d3d47332e662"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:43:32.514226 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.514133    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccfde982-dbe0-46d3-9baa-d3d47332e662-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ccfde982-dbe0-46d3-9baa-d3d47332e662" (UID: "ccfde982-dbe0-46d3-9baa-d3d47332e662"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:43:32.514265 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.514226    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccfde982-dbe0-46d3-9baa-d3d47332e662-kube-api-access-cmhsv" (OuterVolumeSpecName: "kube-api-access-cmhsv") pod "ccfde982-dbe0-46d3-9baa-d3d47332e662" (UID: "ccfde982-dbe0-46d3-9baa-d3d47332e662"). InnerVolumeSpecName "kube-api-access-cmhsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:43:32.613618 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.613561    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ccfde982-dbe0-46d3-9baa-d3d47332e662-openshift-service-ca\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:43:32.613618 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.613589    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmhsv\" (UniqueName: \"kubernetes.io/projected/ccfde982-dbe0-46d3-9baa-d3d47332e662-kube-api-access-cmhsv\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:43:32.613618 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.613601    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccfde982-dbe0-46d3-9baa-d3d47332e662-metrics-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:43:32.613618 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.613626    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ccfde982-dbe0-46d3-9baa-d3d47332e662-maas-api-tls\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:43:32.981166 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.981125    2557 generic.go:356] "Generic (PLEG): container finished" podID="ccfde982-dbe0-46d3-9baa-d3d47332e662" containerID="ac3b58a63b1d66df569236d26e470d7be21bf3f6477acd6282df3fb6720b2e59" exitCode=0
Sep 11 16:43:32.981366 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.981170    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"
Sep 11 16:43:32.981366 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.981208    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7" event={"ID":"ccfde982-dbe0-46d3-9baa-d3d47332e662","Type":"ContainerDied","Data":"ac3b58a63b1d66df569236d26e470d7be21bf3f6477acd6282df3fb6720b2e59"}
Sep 11 16:43:32.981366 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.981271    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7" event={"ID":"ccfde982-dbe0-46d3-9baa-d3d47332e662","Type":"ContainerDied","Data":"5dca39643d42395cee9f6413f82cd69142263716a4d2e67344484a859f099687"}
Sep 11 16:43:32.981366 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.981302    2557 scope.go:117] "RemoveContainer" containerID="ac3b58a63b1d66df569236d26e470d7be21bf3f6477acd6282df3fb6720b2e59"
Sep 11 16:43:32.991361 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.991343    2557 scope.go:117] "RemoveContainer" containerID="ac3b58a63b1d66df569236d26e470d7be21bf3f6477acd6282df3fb6720b2e59"
Sep 11 16:43:32.991678 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:43:32.991647    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac3b58a63b1d66df569236d26e470d7be21bf3f6477acd6282df3fb6720b2e59\": container with ID starting with ac3b58a63b1d66df569236d26e470d7be21bf3f6477acd6282df3fb6720b2e59 not found: ID does not exist" containerID="ac3b58a63b1d66df569236d26e470d7be21bf3f6477acd6282df3fb6720b2e59"
Sep 11 16:43:32.991764 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:32.991686    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac3b58a63b1d66df569236d26e470d7be21bf3f6477acd6282df3fb6720b2e59"} err="failed to get container status \"ac3b58a63b1d66df569236d26e470d7be21bf3f6477acd6282df3fb6720b2e59\": rpc error: code = NotFound desc = could not find container \"ac3b58a63b1d66df569236d26e470d7be21bf3f6477acd6282df3fb6720b2e59\": container with ID starting with ac3b58a63b1d66df569236d26e470d7be21bf3f6477acd6282df3fb6720b2e59 not found: ID does not exist"
Sep 11 16:43:33.013883 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:33.013850    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"]
Sep 11 16:43:33.018372 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:33.018346    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-845e25d3-8464997545-9bkv7"]
Sep 11 16:43:34.946513 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:34.946476    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccfde982-dbe0-46d3-9baa-d3d47332e662" path="/var/lib/kubelet/pods/ccfde982-dbe0-46d3-9baa-d3d47332e662/volumes"
Sep 11 16:43:36.639411 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.639377    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"]
Sep 11 16:43:36.639841 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.639828    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccfde982-dbe0-46d3-9baa-d3d47332e662" containerName="maas-api"
Sep 11 16:43:36.639889 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.639843    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccfde982-dbe0-46d3-9baa-d3d47332e662" containerName="maas-api"
Sep 11 16:43:36.639924 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.639905    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccfde982-dbe0-46d3-9baa-d3d47332e662" containerName="maas-api"
Sep 11 16:43:36.643166 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.643142    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"
Sep 11 16:43:36.646678 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.646644    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-983a9aee-serving-cert\""
Sep 11 16:43:36.655641 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.655597    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"]
Sep 11 16:43:36.755434 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.755390    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klwnj\" (UniqueName: \"kubernetes.io/projected/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-kube-api-access-klwnj\") pod \"maas-api-e2e-migrate-983a9aee-755997778c-6497z\" (UID: \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"
Sep 11 16:43:36.755597 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.755446    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-maas-api-tls\") pod \"maas-api-e2e-migrate-983a9aee-755997778c-6497z\" (UID: \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"
Sep 11 16:43:36.755684 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.755593    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-openshift-service-ca\") pod \"maas-api-e2e-migrate-983a9aee-755997778c-6497z\" (UID: \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"
Sep 11 16:43:36.755814 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.755769    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-metrics-certs\") pod \"maas-api-e2e-migrate-983a9aee-755997778c-6497z\" (UID: \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"
Sep 11 16:43:36.856572 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.856534    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-maas-api-tls\") pod \"maas-api-e2e-migrate-983a9aee-755997778c-6497z\" (UID: \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"
Sep 11 16:43:36.856791 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.856590    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-openshift-service-ca\") pod \"maas-api-e2e-migrate-983a9aee-755997778c-6497z\" (UID: \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"
Sep 11 16:43:36.856791 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.856653    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-metrics-certs\") pod \"maas-api-e2e-migrate-983a9aee-755997778c-6497z\" (UID: \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"
Sep 11 16:43:36.856791 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.856696    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klwnj\" (UniqueName: \"kubernetes.io/projected/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-kube-api-access-klwnj\") pod \"maas-api-e2e-migrate-983a9aee-755997778c-6497z\" (UID: \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"
Sep 11 16:43:36.857362 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.857332    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-openshift-service-ca\") pod \"maas-api-e2e-migrate-983a9aee-755997778c-6497z\" (UID: \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"
Sep 11 16:43:36.859091 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.859067    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-maas-api-tls\") pod \"maas-api-e2e-migrate-983a9aee-755997778c-6497z\" (UID: \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"
Sep 11 16:43:36.859222 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.859104    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-metrics-certs\") pod \"maas-api-e2e-migrate-983a9aee-755997778c-6497z\" (UID: \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"
Sep 11 16:43:36.869141 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.869114    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klwnj\" (UniqueName: \"kubernetes.io/projected/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-kube-api-access-klwnj\") pod \"maas-api-e2e-migrate-983a9aee-755997778c-6497z\" (UID: \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"
Sep 11 16:43:36.956337 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:36.956252    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"
Sep 11 16:43:37.236042 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:37.236012    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"]
Sep 11 16:43:37.237945 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:43:37.237909    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02c00a13_b0fb_4bf9_bb02_e6bc6a83e2c0.slice/crio-fc5b0154534c1088f44699df0c41554501dd663c87ba6aa5c4a59a41024054c9 WatchSource:0}: Error finding container fc5b0154534c1088f44699df0c41554501dd663c87ba6aa5c4a59a41024054c9: Status 404 returned error can't find the container with id fc5b0154534c1088f44699df0c41554501dd663c87ba6aa5c4a59a41024054c9
Sep 11 16:43:38.015324 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:38.015280    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z" event={"ID":"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0","Type":"ContainerStarted","Data":"a1c108ad98199783cb195b328e1718831322c88c304de772ed971094ca36eeb7"}
Sep 11 16:43:38.015831 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:38.015358    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z" event={"ID":"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0","Type":"ContainerStarted","Data":"fc5b0154534c1088f44699df0c41554501dd663c87ba6aa5c4a59a41024054c9"}
Sep 11 16:43:38.015831 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:38.015534    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"
Sep 11 16:43:38.054069 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:38.054013    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z" podStartSLOduration=1.705453289 podStartE2EDuration="2.053990731s" totalImagesPullingTime="348.537442ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:43:38.052857742 +0000 UTC m=+837.671131912" watchObservedRunningTime="2026-09-11 16:43:38.053990731 +0000 UTC m=+837.672264902"
Sep 11 16:43:44.028376 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:43:44.028338    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"
Sep 11 16:44:08.110000 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:08.109952    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"]
Sep 11 16:44:08.110584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:08.110231    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z" podUID="02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0" containerName="maas-api" containerID="cri-o://a1c108ad98199783cb195b328e1718831322c88c304de772ed971094ca36eeb7" gracePeriod=30
Sep 11 16:44:08.372802 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:08.372728    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"
Sep 11 16:44:08.456892 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:08.456851    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-maas-api-tls\") pod \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\" (UID: \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\") "
Sep 11 16:44:08.456892 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:08.456893    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-metrics-certs\") pod \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\" (UID: \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\") "
Sep 11 16:44:08.457102 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:08.456924    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-openshift-service-ca\") pod \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\" (UID: \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\") "
Sep 11 16:44:08.457102 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:08.456958    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klwnj\" (UniqueName: \"kubernetes.io/projected/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-kube-api-access-klwnj\") pod \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\" (UID: \"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0\") "
Sep 11 16:44:08.457311 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:08.457288    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0" (UID: "02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:44:08.459140 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:08.459108    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0" (UID: "02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:44:08.459140 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:08.459127    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0" (UID: "02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:44:08.459309 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:08.459208    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-kube-api-access-klwnj" (OuterVolumeSpecName: "kube-api-access-klwnj") pod "02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0" (UID: "02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0"). InnerVolumeSpecName "kube-api-access-klwnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:44:08.558694 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:08.558595    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-openshift-service-ca\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:44:08.558694 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:08.558687    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klwnj\" (UniqueName: \"kubernetes.io/projected/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-kube-api-access-klwnj\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:44:08.558694 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:08.558698    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-maas-api-tls\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:44:08.558928 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:08.558706    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0-metrics-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:44:09.203509 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:09.203470    2557 generic.go:356] "Generic (PLEG): container finished" podID="02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0" containerID="a1c108ad98199783cb195b328e1718831322c88c304de772ed971094ca36eeb7" exitCode=0
Sep 11 16:44:09.203941 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:09.203516    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"
Sep 11 16:44:09.203941 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:09.203543    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z" event={"ID":"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0","Type":"ContainerDied","Data":"a1c108ad98199783cb195b328e1718831322c88c304de772ed971094ca36eeb7"}
Sep 11 16:44:09.203941 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:09.203591    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z" event={"ID":"02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0","Type":"ContainerDied","Data":"fc5b0154534c1088f44699df0c41554501dd663c87ba6aa5c4a59a41024054c9"}
Sep 11 16:44:09.203941 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:09.203651    2557 scope.go:117] "RemoveContainer" containerID="a1c108ad98199783cb195b328e1718831322c88c304de772ed971094ca36eeb7"
Sep 11 16:44:09.213078 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:09.213028    2557 scope.go:117] "RemoveContainer" containerID="a1c108ad98199783cb195b328e1718831322c88c304de772ed971094ca36eeb7"
Sep 11 16:44:09.213567 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:44:09.213533    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1c108ad98199783cb195b328e1718831322c88c304de772ed971094ca36eeb7\": container with ID starting with a1c108ad98199783cb195b328e1718831322c88c304de772ed971094ca36eeb7 not found: ID does not exist" containerID="a1c108ad98199783cb195b328e1718831322c88c304de772ed971094ca36eeb7"
Sep 11 16:44:09.213713 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:09.213578    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1c108ad98199783cb195b328e1718831322c88c304de772ed971094ca36eeb7"} err="failed to get container status \"a1c108ad98199783cb195b328e1718831322c88c304de772ed971094ca36eeb7\": rpc error: code = NotFound desc = could not find container \"a1c108ad98199783cb195b328e1718831322c88c304de772ed971094ca36eeb7\": container with ID starting with a1c108ad98199783cb195b328e1718831322c88c304de772ed971094ca36eeb7 not found: ID does not exist"
Sep 11 16:44:09.229953 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:09.229921    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"]
Sep 11 16:44:09.237221 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:09.237185    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-983a9aee-755997778c-6497z"]
Sep 11 16:44:10.946214 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:10.946171    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0" path="/var/lib/kubelet/pods/02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0/volumes"
Sep 11 16:44:13.691410 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:13.691372    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9"]
Sep 11 16:44:13.691811 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:13.691789    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0" containerName="maas-api"
Sep 11 16:44:13.691811 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:13.691804    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0" containerName="maas-api"
Sep 11 16:44:13.691886 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:13.691877    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="02c00a13-b0fb-4bf9-bb02-e6bc6a83e2c0" containerName="maas-api"
Sep 11 16:44:13.695968 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:13.695947    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9"
Sep 11 16:44:13.698787 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:13.698764    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-83625e23\""
Sep 11 16:44:13.709713 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:13.709687    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9"]
Sep 11 16:44:13.814814 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:13.814777    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0-plugins-config-volume\") pod \"payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9\" (UID: \"2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0\") " pod="openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9"
Sep 11 16:44:13.815018 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:13.814822    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbb9l\" (UniqueName: \"kubernetes.io/projected/2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0-kube-api-access-fbb9l\") pod \"payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9\" (UID: \"2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0\") " pod="openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9"
Sep 11 16:44:13.915916 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:13.915875    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0-plugins-config-volume\") pod \"payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9\" (UID: \"2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0\") " pod="openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9"
Sep 11 16:44:13.916101 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:13.915921    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbb9l\" (UniqueName: \"kubernetes.io/projected/2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0-kube-api-access-fbb9l\") pod \"payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9\" (UID: \"2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0\") " pod="openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9"
Sep 11 16:44:13.916672 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:13.916650    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0-plugins-config-volume\") pod \"payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9\" (UID: \"2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0\") " pod="openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9"
Sep 11 16:44:13.928153 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:13.928119    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbb9l\" (UniqueName: \"kubernetes.io/projected/2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0-kube-api-access-fbb9l\") pod \"payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9\" (UID: \"2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0\") " pod="openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9"
Sep 11 16:44:14.006812 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:14.006721    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9"
Sep 11 16:44:14.289077 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:14.289051    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9"]
Sep 11 16:44:14.291212 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:44:14.291186    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e07cd0a_bf9c_4332_b5c3_aac0bc0d81c0.slice/crio-cdd15f52fc742d97e52721ef17ae45c18f97fb78dfb443e3258bc04aef1cfc46 WatchSource:0}: Error finding container cdd15f52fc742d97e52721ef17ae45c18f97fb78dfb443e3258bc04aef1cfc46: Status 404 returned error can't find the container with id cdd15f52fc742d97e52721ef17ae45c18f97fb78dfb443e3258bc04aef1cfc46
Sep 11 16:44:15.240515 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:15.240482    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9" event={"ID":"2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0","Type":"ContainerStarted","Data":"f4bb22fb9c1d14aa7389ceda0add39ec86d8918f5392955d1d8f7a673dcdd45d"}
Sep 11 16:44:15.241049 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:15.240533    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9" event={"ID":"2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0","Type":"ContainerStarted","Data":"cdd15f52fc742d97e52721ef17ae45c18f97fb78dfb443e3258bc04aef1cfc46"}
Sep 11 16:44:15.241049 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:15.240560    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9"
Sep 11 16:44:15.278056 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:15.277990    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9" podStartSLOduration=2.277967678 podStartE2EDuration="2.277967678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:44:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:15.275599972 +0000 UTC m=+874.893874143" watchObservedRunningTime="2026-09-11 16:44:15.277967678 +0000 UTC m=+874.896241849"
Sep 11 16:44:26.249492 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:26.249458    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9"
Sep 11 16:44:43.408038 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:43.408002    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9"]
Sep 11 16:44:43.408538 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:43.408257    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9" podUID="2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0" containerName="payload-processing" containerID="cri-o://f4bb22fb9c1d14aa7389ceda0add39ec86d8918f5392955d1d8f7a673dcdd45d" gracePeriod=30
Sep 11 16:44:43.663770 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:43.663701    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9"
Sep 11 16:44:43.704189 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:43.704154    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0-plugins-config-volume\") pod \"2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0\" (UID: \"2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0\") "
Sep 11 16:44:43.704356 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:43.704319    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbb9l\" (UniqueName: \"kubernetes.io/projected/2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0-kube-api-access-fbb9l\") pod \"2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0\" (UID: \"2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0\") "
Sep 11 16:44:43.704511 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:43.704484    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0" (UID: "2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:44:43.704681 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:43.704599    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0-plugins-config-volume\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:44:43.706409 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:43.706387    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0-kube-api-access-fbb9l" (OuterVolumeSpecName: "kube-api-access-fbb9l") pod "2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0" (UID: "2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0"). InnerVolumeSpecName "kube-api-access-fbb9l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:44:43.805390 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:43.805337    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbb9l\" (UniqueName: \"kubernetes.io/projected/2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0-kube-api-access-fbb9l\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:44:44.408310 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:44.408270    2557 generic.go:356] "Generic (PLEG): container finished" podID="2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0" containerID="f4bb22fb9c1d14aa7389ceda0add39ec86d8918f5392955d1d8f7a673dcdd45d" exitCode=0
Sep 11 16:44:44.408805 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:44.408316    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9"
Sep 11 16:44:44.408805 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:44.408359    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9" event={"ID":"2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0","Type":"ContainerDied","Data":"f4bb22fb9c1d14aa7389ceda0add39ec86d8918f5392955d1d8f7a673dcdd45d"}
Sep 11 16:44:44.408805 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:44.408411    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9" event={"ID":"2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0","Type":"ContainerDied","Data":"cdd15f52fc742d97e52721ef17ae45c18f97fb78dfb443e3258bc04aef1cfc46"}
Sep 11 16:44:44.408805 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:44.408440    2557 scope.go:117] "RemoveContainer" containerID="f4bb22fb9c1d14aa7389ceda0add39ec86d8918f5392955d1d8f7a673dcdd45d"
Sep 11 16:44:44.417858 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:44.417840    2557 scope.go:117] "RemoveContainer" containerID="f4bb22fb9c1d14aa7389ceda0add39ec86d8918f5392955d1d8f7a673dcdd45d"
Sep 11 16:44:44.418140 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:44:44.418121    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4bb22fb9c1d14aa7389ceda0add39ec86d8918f5392955d1d8f7a673dcdd45d\": container with ID starting with f4bb22fb9c1d14aa7389ceda0add39ec86d8918f5392955d1d8f7a673dcdd45d not found: ID does not exist" containerID="f4bb22fb9c1d14aa7389ceda0add39ec86d8918f5392955d1d8f7a673dcdd45d"
Sep 11 16:44:44.418179 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:44.418151    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4bb22fb9c1d14aa7389ceda0add39ec86d8918f5392955d1d8f7a673dcdd45d"} err="failed to get container status \"f4bb22fb9c1d14aa7389ceda0add39ec86d8918f5392955d1d8f7a673dcdd45d\": rpc error: code = NotFound desc = could not find container \"f4bb22fb9c1d14aa7389ceda0add39ec86d8918f5392955d1d8f7a673dcdd45d\": container with ID starting with f4bb22fb9c1d14aa7389ceda0add39ec86d8918f5392955d1d8f7a673dcdd45d not found: ID does not exist"
Sep 11 16:44:44.434003 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:44.433972    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9"]
Sep 11 16:44:44.438229 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:44.438206    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-83625e23-6c8d7f95dc-tn5h9"]
Sep 11 16:44:44.947141 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:44.947100    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0" path="/var/lib/kubelet/pods/2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0/volumes"
Sep 11 16:44:45.483758 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.483722    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"]
Sep 11 16:44:45.484335 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.484316    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0" containerName="payload-processing"
Sep 11 16:44:45.484381 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.484339    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0" containerName="payload-processing"
Sep 11 16:44:45.484467 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.484447    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e07cd0a-bf9c-4332-b5c3-aac0bc0d81c0" containerName="payload-processing"
Sep 11 16:44:45.489292 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.489269    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.491984 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.491965    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-4bf042d5-openshift-default-dockercfg-6f7nc\""
Sep 11 16:44:45.501988 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.501963    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"]
Sep 11 16:44:45.516675 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.516644    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l9rk\" (UniqueName: \"kubernetes.io/projected/ded93d86-f728-4128-956c-d35ee366889d-kube-api-access-5l9rk\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.516871 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.516696    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-credential-socket\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.516871 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.516755    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-istio-envoy\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.516871 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.516801    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-istio-data\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.516871 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.516826    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ded93d86-f728-4128-956c-d35ee366889d-istio-token\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.517020 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.516869    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ded93d86-f728-4128-956c-d35ee366889d-istiod-ca-cert\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.517020 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.516938    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-workload-certs\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.517020 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.516965    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ded93d86-f728-4128-956c-d35ee366889d-istio-podinfo\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.517020 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.516982    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-workload-socket\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.618048 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.618008    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l9rk\" (UniqueName: \"kubernetes.io/projected/ded93d86-f728-4128-956c-d35ee366889d-kube-api-access-5l9rk\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.618279 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.618154    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-credential-socket\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.618279 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.618193    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-istio-envoy\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.618279 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.618230    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-istio-data\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.618279 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.618253    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ded93d86-f728-4128-956c-d35ee366889d-istio-token\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.618527 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.618290    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ded93d86-f728-4128-956c-d35ee366889d-istiod-ca-cert\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.618527 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.618344    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-workload-certs\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.618527 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.618385    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ded93d86-f728-4128-956c-d35ee366889d-istio-podinfo\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.618527 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.618413    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-workload-socket\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.618766 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.618596    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-credential-socket\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.618913 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.618889    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-workload-certs\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.619037 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.619005    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-workload-socket\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.619159 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.619037    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-istio-data\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.619467 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.619439    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ded93d86-f728-4128-956c-d35ee366889d-istiod-ca-cert\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.621075 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.621056    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-istio-envoy\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.621420 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.621393    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ded93d86-f728-4128-956c-d35ee366889d-istio-podinfo\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.629368 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.629339    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l9rk\" (UniqueName: \"kubernetes.io/projected/ded93d86-f728-4128-956c-d35ee366889d-kube-api-access-5l9rk\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.629521 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.629439    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ded93d86-f728-4128-956c-d35ee366889d-istio-token\") pod \"e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") " pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:45.801546 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:45.801493    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:46.098672 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:46.098645    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"]
Sep 11 16:44:46.100393 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:44:46.100356    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podded93d86_f728_4128_956c_d35ee366889d.slice/crio-2e650b33d4c2bd95b3ccbd77d942178d975252725e04c5fde5a4fa9c5aa49ce2 WatchSource:0}: Error finding container 2e650b33d4c2bd95b3ccbd77d942178d975252725e04c5fde5a4fa9c5aa49ce2: Status 404 returned error can't find the container with id 2e650b33d4c2bd95b3ccbd77d942178d975252725e04c5fde5a4fa9c5aa49ce2
Sep 11 16:44:46.102667 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:46.102633    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:44:46.102751 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:46.102700    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:44:46.102751 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:46.102731    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:44:46.427319 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:46.427229    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n" event={"ID":"ded93d86-f728-4128-956c-d35ee366889d","Type":"ContainerStarted","Data":"35d8bbb691173b9ddc14b6ac3a6d9fd8bece16ed306f12aafde22160bb70063e"}
Sep 11 16:44:46.427319 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:46.427292    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n" event={"ID":"ded93d86-f728-4128-956c-d35ee366889d","Type":"ContainerStarted","Data":"2e650b33d4c2bd95b3ccbd77d942178d975252725e04c5fde5a4fa9c5aa49ce2"}
Sep 11 16:44:46.471211 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:46.471142    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n" podStartSLOduration=1.471116469 podStartE2EDuration="1.471116469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:44:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:46.467811591 +0000 UTC m=+906.086085765" watchObservedRunningTime="2026-09-11 16:44:46.471116469 +0000 UTC m=+906.089390639"
Sep 11 16:44:46.802081 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:46.802036    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:47.807474 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:47.807441    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:48.438932 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:48.438901    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:44:48.440039 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:44:48.440014    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:45:00.215899 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:00.215856    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-587a17-29819085-7srcr"]
Sep 11 16:45:00.219554 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:00.219533    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-587a17-29819085-7srcr"
Sep 11 16:45:00.223712 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:00.223687    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7xqmx\""
Sep 11 16:45:00.229657 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:00.229637    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-587a17-29819085-7srcr"
Sep 11 16:45:00.240058 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:00.240030    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-587a17-29819085-7srcr"]
Sep 11 16:45:00.536696 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:00.536660    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-587a17-29819085-7srcr"]
Sep 11 16:45:00.537181 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:45:00.537131    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda660c310_7ec1_4726_8984_5b3da9e94ada.slice/crio-0d2a177e94a7cde532bb45dd790cb3ad8cd55131fa2d5f63910a80b8a34d916d WatchSource:0}: Error finding container 0d2a177e94a7cde532bb45dd790cb3ad8cd55131fa2d5f63910a80b8a34d916d: Status 404 returned error can't find the container with id 0d2a177e94a7cde532bb45dd790cb3ad8cd55131fa2d5f63910a80b8a34d916d
Sep 11 16:45:00.538997 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:00.538980    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:45:01.514966 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:01.514925    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-587a17-29819085-7srcr" event={"ID":"a660c310-7ec1-4726-8984-5b3da9e94ada","Type":"ContainerStarted","Data":"0d2a177e94a7cde532bb45dd790cb3ad8cd55131fa2d5f63910a80b8a34d916d"}
Sep 11 16:45:04.537419 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:04.537378    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-587a17-29819085-7srcr" event={"ID":"a660c310-7ec1-4726-8984-5b3da9e94ada","Type":"ContainerStarted","Data":"22f97501788090123053083a1b2a63120cfc71540559e6addab928d774d42352"}
Sep 11 16:45:04.558044 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:04.557994    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-587a17-29819085-7srcr" podStartSLOduration=1.6608994369999999 podStartE2EDuration="4.55797492s" totalImagesPullingTime="2.897075483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:45:04.555511066 +0000 UTC m=+924.173785237" watchObservedRunningTime="2026-09-11 16:45:04.55797492 +0000 UTC m=+924.176249118"
Sep 11 16:45:05.544881 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:05.544832    2557 generic.go:356] "Generic (PLEG): container finished" podID="a660c310-7ec1-4726-8984-5b3da9e94ada" containerID="22f97501788090123053083a1b2a63120cfc71540559e6addab928d774d42352" exitCode=0
Sep 11 16:45:05.545272 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:05.544925    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-587a17-29819085-7srcr" event={"ID":"a660c310-7ec1-4726-8984-5b3da9e94ada","Type":"ContainerDied","Data":"22f97501788090123053083a1b2a63120cfc71540559e6addab928d774d42352"}
Sep 11 16:45:06.744532 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:06.744497    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-587a17-29819085-7srcr"
Sep 11 16:45:07.562351 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:07.562313    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-587a17-29819085-7srcr"
Sep 11 16:45:07.562351 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:07.562338    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-587a17-29819085-7srcr" event={"ID":"a660c310-7ec1-4726-8984-5b3da9e94ada","Type":"ContainerDied","Data":"0d2a177e94a7cde532bb45dd790cb3ad8cd55131fa2d5f63910a80b8a34d916d"}
Sep 11 16:45:07.562596 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:07.562429    2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d2a177e94a7cde532bb45dd790cb3ad8cd55131fa2d5f63910a80b8a34d916d"
Sep 11 16:45:07.564447 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:07.564420    2557 generic.go:356] "Generic (PLEG): container finished" podID="ded93d86-f728-4128-956c-d35ee366889d" containerID="35d8bbb691173b9ddc14b6ac3a6d9fd8bece16ed306f12aafde22160bb70063e" exitCode=0
Sep 11 16:45:07.564590 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:07.564483    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n" event={"ID":"ded93d86-f728-4128-956c-d35ee366889d","Type":"ContainerDied","Data":"35d8bbb691173b9ddc14b6ac3a6d9fd8bece16ed306f12aafde22160bb70063e"}
Sep 11 16:45:07.564953 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:07.564932    2557 scope.go:117] "RemoveContainer" containerID="35d8bbb691173b9ddc14b6ac3a6d9fd8bece16ed306f12aafde22160bb70063e"
Sep 11 16:45:07.566017 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:07.565987    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:45:07.566100 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:07.566054    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:45:07.566100 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:07.566085    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:45:08.572361 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:08.572327    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n" event={"ID":"ded93d86-f728-4128-956c-d35ee366889d","Type":"ContainerStarted","Data":"6888e145a4d6cb0974c3c42a70b320000860741560da7e744e2cd229302c5b7a"}
Sep 11 16:45:08.801691 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:08.801650    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:45:08.801943 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:08.801915    2557 patch_prober.go:28] interesting pod/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 16:45:08.802008 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:08.801980    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n" podUID="ded93d86-f728-4128-956c-d35ee366889d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 16:45:09.802095 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:09.802056    2557 patch_prober.go:28] interesting pod/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 16:45:09.802494 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:09.802125    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n" podUID="ded93d86-f728-4128-956c-d35ee366889d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 16:45:10.802107 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:10.802068    2557 patch_prober.go:28] interesting pod/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 16:45:10.802523 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:10.802130    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n" podUID="ded93d86-f728-4128-956c-d35ee366889d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 16:45:11.802699 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:11.802660    2557 patch_prober.go:28] interesting pod/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 16:45:11.803174 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:11.802727    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n" podUID="ded93d86-f728-4128-956c-d35ee366889d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 16:45:12.802698 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:12.802658    2557 patch_prober.go:28] interesting pod/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 16:45:12.802881 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:12.802733    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n" podUID="ded93d86-f728-4128-956c-d35ee366889d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 16:45:13.802506 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:13.802466    2557 patch_prober.go:28] interesting pod/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 16:45:13.802794 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:13.802768    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n" podUID="ded93d86-f728-4128-956c-d35ee366889d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 16:45:14.806599 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:14.806564    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:45:14.807022 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:14.806973    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:45:14.807736 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:14.807715    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:45:20.397192 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:20.397150    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"]
Sep 11 16:45:20.397661 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:20.397345    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n" podUID="ded93d86-f728-4128-956c-d35ee366889d" containerName="istio-proxy" containerID="cri-o://6888e145a4d6cb0974c3c42a70b320000860741560da7e744e2cd229302c5b7a" gracePeriod=30
Sep 11 16:45:25.665314 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.665244    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:45:25.675531 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.675498    2557 generic.go:356] "Generic (PLEG): container finished" podID="ded93d86-f728-4128-956c-d35ee366889d" containerID="6888e145a4d6cb0974c3c42a70b320000860741560da7e744e2cd229302c5b7a" exitCode=0
Sep 11 16:45:25.675699 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.675539    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"
Sep 11 16:45:25.675699 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.675564    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n" event={"ID":"ded93d86-f728-4128-956c-d35ee366889d","Type":"ContainerDied","Data":"6888e145a4d6cb0974c3c42a70b320000860741560da7e744e2cd229302c5b7a"}
Sep 11 16:45:25.675699 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.675624    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n" event={"ID":"ded93d86-f728-4128-956c-d35ee366889d","Type":"ContainerDied","Data":"2e650b33d4c2bd95b3ccbd77d942178d975252725e04c5fde5a4fa9c5aa49ce2"}
Sep 11 16:45:25.675699 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.675650    2557 scope.go:117] "RemoveContainer" containerID="6888e145a4d6cb0974c3c42a70b320000860741560da7e744e2cd229302c5b7a"
Sep 11 16:45:25.684799 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.684780    2557 scope.go:117] "RemoveContainer" containerID="35d8bbb691173b9ddc14b6ac3a6d9fd8bece16ed306f12aafde22160bb70063e"
Sep 11 16:45:25.693847 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.693801    2557 scope.go:117] "RemoveContainer" containerID="6888e145a4d6cb0974c3c42a70b320000860741560da7e744e2cd229302c5b7a"
Sep 11 16:45:25.694147 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:45:25.694114    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6888e145a4d6cb0974c3c42a70b320000860741560da7e744e2cd229302c5b7a\": container with ID starting with 6888e145a4d6cb0974c3c42a70b320000860741560da7e744e2cd229302c5b7a not found: ID does not exist" containerID="6888e145a4d6cb0974c3c42a70b320000860741560da7e744e2cd229302c5b7a"
Sep 11 16:45:25.694255 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.694161    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6888e145a4d6cb0974c3c42a70b320000860741560da7e744e2cd229302c5b7a"} err="failed to get container status \"6888e145a4d6cb0974c3c42a70b320000860741560da7e744e2cd229302c5b7a\": rpc error: code = NotFound desc = could not find container \"6888e145a4d6cb0974c3c42a70b320000860741560da7e744e2cd229302c5b7a\": container with ID starting with 6888e145a4d6cb0974c3c42a70b320000860741560da7e744e2cd229302c5b7a not found: ID does not exist"
Sep 11 16:45:25.694255 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.694187    2557 scope.go:117] "RemoveContainer" containerID="35d8bbb691173b9ddc14b6ac3a6d9fd8bece16ed306f12aafde22160bb70063e"
Sep 11 16:45:25.694549 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:45:25.694515    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35d8bbb691173b9ddc14b6ac3a6d9fd8bece16ed306f12aafde22160bb70063e\": container with ID starting with 35d8bbb691173b9ddc14b6ac3a6d9fd8bece16ed306f12aafde22160bb70063e not found: ID does not exist" containerID="35d8bbb691173b9ddc14b6ac3a6d9fd8bece16ed306f12aafde22160bb70063e"
Sep 11 16:45:25.694686 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.694554    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35d8bbb691173b9ddc14b6ac3a6d9fd8bece16ed306f12aafde22160bb70063e"} err="failed to get container status \"35d8bbb691173b9ddc14b6ac3a6d9fd8bece16ed306f12aafde22160bb70063e\": rpc error: code = NotFound desc = could not find container \"35d8bbb691173b9ddc14b6ac3a6d9fd8bece16ed306f12aafde22160bb70063e\": container with ID starting with 35d8bbb691173b9ddc14b6ac3a6d9fd8bece16ed306f12aafde22160bb70063e not found: ID does not exist"
Sep 11 16:45:25.723073 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.723043    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-workload-certs\") pod \"ded93d86-f728-4128-956c-d35ee366889d\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") "
Sep 11 16:45:25.723273 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.723091    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ded93d86-f728-4128-956c-d35ee366889d-istiod-ca-cert\") pod \"ded93d86-f728-4128-956c-d35ee366889d\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") "
Sep 11 16:45:25.723273 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.723128    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l9rk\" (UniqueName: \"kubernetes.io/projected/ded93d86-f728-4128-956c-d35ee366889d-kube-api-access-5l9rk\") pod \"ded93d86-f728-4128-956c-d35ee366889d\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") "
Sep 11 16:45:25.723273 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.723154    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ded93d86-f728-4128-956c-d35ee366889d-istio-podinfo\") pod \"ded93d86-f728-4128-956c-d35ee366889d\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") "
Sep 11 16:45:25.723273 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.723180    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-workload-socket\") pod \"ded93d86-f728-4128-956c-d35ee366889d\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") "
Sep 11 16:45:25.723273 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.723209    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-istio-envoy\") pod \"ded93d86-f728-4128-956c-d35ee366889d\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") "
Sep 11 16:45:25.723273 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.723237    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-credential-socket\") pod \"ded93d86-f728-4128-956c-d35ee366889d\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") "
Sep 11 16:45:25.723621 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.723347    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ded93d86-f728-4128-956c-d35ee366889d-istio-token\") pod \"ded93d86-f728-4128-956c-d35ee366889d\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") "
Sep 11 16:45:25.723621 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.723365    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ded93d86-f728-4128-956c-d35ee366889d" (UID: "ded93d86-f728-4128-956c-d35ee366889d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:45:25.723621 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.723463    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ded93d86-f728-4128-956c-d35ee366889d" (UID: "ded93d86-f728-4128-956c-d35ee366889d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:45:25.723621 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.723546    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ded93d86-f728-4128-956c-d35ee366889d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ded93d86-f728-4128-956c-d35ee366889d" (UID: "ded93d86-f728-4128-956c-d35ee366889d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:45:25.723850 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.723620    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ded93d86-f728-4128-956c-d35ee366889d" (UID: "ded93d86-f728-4128-956c-d35ee366889d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:45:25.723850 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.723789    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-istio-data\") pod \"ded93d86-f728-4128-956c-d35ee366889d\" (UID: \"ded93d86-f728-4128-956c-d35ee366889d\") "
Sep 11 16:45:25.724083 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.724044    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-istio-data" (OuterVolumeSpecName: "istio-data") pod "ded93d86-f728-4128-956c-d35ee366889d" (UID: "ded93d86-f728-4128-956c-d35ee366889d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:45:25.724313 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.724288    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-workload-socket\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:45:25.724393 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.724319    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-credential-socket\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:45:25.724393 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.724334    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-istio-data\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:45:25.724393 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.724350    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-workload-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:45:25.724393 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.724363    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ded93d86-f728-4128-956c-d35ee366889d-istiod-ca-cert\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:45:25.725408 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.725379    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ded93d86-f728-4128-956c-d35ee366889d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ded93d86-f728-4128-956c-d35ee366889d" (UID: "ded93d86-f728-4128-956c-d35ee366889d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:45:25.725408 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.725388    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ded93d86-f728-4128-956c-d35ee366889d-kube-api-access-5l9rk" (OuterVolumeSpecName: "kube-api-access-5l9rk") pod "ded93d86-f728-4128-956c-d35ee366889d" (UID: "ded93d86-f728-4128-956c-d35ee366889d"). InnerVolumeSpecName "kube-api-access-5l9rk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:45:25.725581 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.725565    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ded93d86-f728-4128-956c-d35ee366889d-istio-token" (OuterVolumeSpecName: "istio-token") pod "ded93d86-f728-4128-956c-d35ee366889d" (UID: "ded93d86-f728-4128-956c-d35ee366889d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:45:25.725659 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.725575    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ded93d86-f728-4128-956c-d35ee366889d" (UID: "ded93d86-f728-4128-956c-d35ee366889d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:45:25.825741 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.825696    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l9rk\" (UniqueName: \"kubernetes.io/projected/ded93d86-f728-4128-956c-d35ee366889d-kube-api-access-5l9rk\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:45:25.825741 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.825733    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ded93d86-f728-4128-956c-d35ee366889d-istio-podinfo\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:45:25.825741 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.825742    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ded93d86-f728-4128-956c-d35ee366889d-istio-envoy\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:45:25.825741 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:25.825752    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ded93d86-f728-4128-956c-d35ee366889d-istio-token\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:45:26.001803 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:26.001769    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"]
Sep 11 16:45:26.006777 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:26.006749    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-4bf042d5-openshift-default-5bd9598656-c859n"]
Sep 11 16:45:26.946907 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:26.946869    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ded93d86-f728-4128-956c-d35ee366889d" path="/var/lib/kubelet/pods/ded93d86-f728-4128-956c-d35ee366889d/volumes"
Sep 11 16:45:27.762069 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.762032    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"]
Sep 11 16:45:27.762520 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.762495    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ded93d86-f728-4128-956c-d35ee366889d" containerName="istio-proxy"
Sep 11 16:45:27.762699 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.762537    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ded93d86-f728-4128-956c-d35ee366889d" containerName="istio-proxy"
Sep 11 16:45:27.762699 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.762572    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a660c310-7ec1-4726-8984-5b3da9e94ada" containerName="cleanup"
Sep 11 16:45:27.762699 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.762580    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a660c310-7ec1-4726-8984-5b3da9e94ada" containerName="cleanup"
Sep 11 16:45:27.762849 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.762709    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ded93d86-f728-4128-956c-d35ee366889d" containerName="istio-proxy"
Sep 11 16:45:27.762849 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.762724    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ded93d86-f728-4128-956c-d35ee366889d" containerName="istio-proxy"
Sep 11 16:45:27.762849 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.762737    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a660c310-7ec1-4726-8984-5b3da9e94ada" containerName="cleanup"
Sep 11 16:45:27.768197 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.768171    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:27.771498 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.771475    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4264bf\"/\"kube-root-ca.crt\""
Sep 11 16:45:27.772924 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.772898    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4264bf\"/\"openshift-service-ca.crt\""
Sep 11 16:45:27.773353 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.773103    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4264bf\"/\"test-model-4264bf-kserve-self-signed-certs\""
Sep 11 16:45:27.773353 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.773172    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4264bf\"/\"default-dockercfg-zgjv5\""
Sep 11 16:45:27.777265 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.777237    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"]
Sep 11 16:45:27.844310 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.844265    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-home\") pod \"test-model-4264bf-kserve-d77b94c6f-64jpt\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") " pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:27.844487 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.844323    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-tmp-dir\") pod \"test-model-4264bf-kserve-d77b94c6f-64jpt\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") " pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:27.844487 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.844357    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkj4z\" (UniqueName: \"kubernetes.io/projected/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-kube-api-access-zkj4z\") pod \"test-model-4264bf-kserve-d77b94c6f-64jpt\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") " pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:27.844487 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.844471    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-model-cache\") pod \"test-model-4264bf-kserve-d77b94c6f-64jpt\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") " pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:27.844598 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.844538    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-tls-certs\") pod \"test-model-4264bf-kserve-d77b94c6f-64jpt\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") " pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:27.844666 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.844588    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-dshm\") pod \"test-model-4264bf-kserve-d77b94c6f-64jpt\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") " pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:27.945759 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.945723    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-model-cache\") pod \"test-model-4264bf-kserve-d77b94c6f-64jpt\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") " pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:27.945923 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.945786    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-tls-certs\") pod \"test-model-4264bf-kserve-d77b94c6f-64jpt\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") " pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:27.945923 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.945814    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-dshm\") pod \"test-model-4264bf-kserve-d77b94c6f-64jpt\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") " pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:27.945923 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.945870    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-home\") pod \"test-model-4264bf-kserve-d77b94c6f-64jpt\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") " pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:27.945923 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.945898    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-tmp-dir\") pod \"test-model-4264bf-kserve-d77b94c6f-64jpt\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") " pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:27.946185 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.945936    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkj4z\" (UniqueName: \"kubernetes.io/projected/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-kube-api-access-zkj4z\") pod \"test-model-4264bf-kserve-d77b94c6f-64jpt\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") " pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:27.946245 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.946194    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-model-cache\") pod \"test-model-4264bf-kserve-d77b94c6f-64jpt\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") " pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:27.946317 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.946252    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-home\") pod \"test-model-4264bf-kserve-d77b94c6f-64jpt\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") " pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:27.946369 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.946356    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-tmp-dir\") pod \"test-model-4264bf-kserve-d77b94c6f-64jpt\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") " pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:27.948195 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.948171    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-dshm\") pod \"test-model-4264bf-kserve-d77b94c6f-64jpt\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") " pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:27.948499 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.948274    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-tls-certs\") pod \"test-model-4264bf-kserve-d77b94c6f-64jpt\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") " pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:27.955907 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:27.955883    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkj4z\" (UniqueName: \"kubernetes.io/projected/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-kube-api-access-zkj4z\") pod \"test-model-4264bf-kserve-d77b94c6f-64jpt\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") " pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:28.080193 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:28.080094    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:28.359066 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:28.359040    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"]
Sep 11 16:45:28.360063 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:45:28.360038    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a28e49e_fa6b_4034_8dbf_1cce490f47ee.slice/crio-90719f5d38c77d59a5be1cb0a2c22771a83ebe8af923f3fe9e50e8104e0dc6b0 WatchSource:0}: Error finding container 90719f5d38c77d59a5be1cb0a2c22771a83ebe8af923f3fe9e50e8104e0dc6b0: Status 404 returned error can't find the container with id 90719f5d38c77d59a5be1cb0a2c22771a83ebe8af923f3fe9e50e8104e0dc6b0
Sep 11 16:45:28.704221 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:28.704118    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt" event={"ID":"0a28e49e-fa6b-4034-8dbf-1cce490f47ee","Type":"ContainerStarted","Data":"024c5769e7785ef797a3142f35aa629554dec9d5fd81344c5462e18ba6850bbf"}
Sep 11 16:45:28.704221 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:28.704174    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt" event={"ID":"0a28e49e-fa6b-4034-8dbf-1cce490f47ee","Type":"ContainerStarted","Data":"90719f5d38c77d59a5be1cb0a2c22771a83ebe8af923f3fe9e50e8104e0dc6b0"}
Sep 11 16:45:28.725033 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:28.724975    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt" podStartSLOduration=1.724955434 podStartE2EDuration="1.724955434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:45:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:45:28.724660566 +0000 UTC m=+948.342934738" watchObservedRunningTime="2026-09-11 16:45:28.724955434 +0000 UTC m=+948.343229604"
Sep 11 16:45:38.080870 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:38.080818    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:38.081385 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:38.080895    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:38.093479 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:38.093448    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:38.778047 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:38.778004    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:45:42.933717 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:42.933672    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp"]
Sep 11 16:45:42.934219 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:42.933956    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp" podUID="102075ae-74e0-4472-a8d0-2e5e3fa811b7" containerName="payload-processing" containerID="cri-o://eb59cfe80b75459710f343bc0a2c5862d315284f81bffe641ee05c53458eadf2" gracePeriod=30
Sep 11 16:45:43.212450 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:43.212423    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp"
Sep 11 16:45:43.298822 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:43.298773    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gslwv\" (UniqueName: \"kubernetes.io/projected/102075ae-74e0-4472-a8d0-2e5e3fa811b7-kube-api-access-gslwv\") pod \"102075ae-74e0-4472-a8d0-2e5e3fa811b7\" (UID: \"102075ae-74e0-4472-a8d0-2e5e3fa811b7\") "
Sep 11 16:45:43.299048 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:43.298835    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/102075ae-74e0-4472-a8d0-2e5e3fa811b7-plugins-config-volume\") pod \"102075ae-74e0-4472-a8d0-2e5e3fa811b7\" (UID: \"102075ae-74e0-4472-a8d0-2e5e3fa811b7\") "
Sep 11 16:45:43.299226 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:43.299201    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/102075ae-74e0-4472-a8d0-2e5e3fa811b7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "102075ae-74e0-4472-a8d0-2e5e3fa811b7" (UID: "102075ae-74e0-4472-a8d0-2e5e3fa811b7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:45:43.301084 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:43.301064    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/102075ae-74e0-4472-a8d0-2e5e3fa811b7-kube-api-access-gslwv" (OuterVolumeSpecName: "kube-api-access-gslwv") pod "102075ae-74e0-4472-a8d0-2e5e3fa811b7" (UID: "102075ae-74e0-4472-a8d0-2e5e3fa811b7"). InnerVolumeSpecName "kube-api-access-gslwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:45:43.400399 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:43.400356    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gslwv\" (UniqueName: \"kubernetes.io/projected/102075ae-74e0-4472-a8d0-2e5e3fa811b7-kube-api-access-gslwv\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:45:43.400399 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:43.400392    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/102075ae-74e0-4472-a8d0-2e5e3fa811b7-plugins-config-volume\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:45:43.796177 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:43.796140    2557 generic.go:356] "Generic (PLEG): container finished" podID="102075ae-74e0-4472-a8d0-2e5e3fa811b7" containerID="eb59cfe80b75459710f343bc0a2c5862d315284f81bffe641ee05c53458eadf2" exitCode=0
Sep 11 16:45:43.796386 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:43.796182    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp"
Sep 11 16:45:43.796386 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:43.796221    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp" event={"ID":"102075ae-74e0-4472-a8d0-2e5e3fa811b7","Type":"ContainerDied","Data":"eb59cfe80b75459710f343bc0a2c5862d315284f81bffe641ee05c53458eadf2"}
Sep 11 16:45:43.796386 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:43.796273    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp" event={"ID":"102075ae-74e0-4472-a8d0-2e5e3fa811b7","Type":"ContainerDied","Data":"14ef2c7e31a1bfcccfff2fca90fe810e982e159d91dd657ade3dda905d93e9e7"}
Sep 11 16:45:43.796386 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:43.796293    2557 scope.go:117] "RemoveContainer" containerID="eb59cfe80b75459710f343bc0a2c5862d315284f81bffe641ee05c53458eadf2"
Sep 11 16:45:43.806765 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:43.806745    2557 scope.go:117] "RemoveContainer" containerID="eb59cfe80b75459710f343bc0a2c5862d315284f81bffe641ee05c53458eadf2"
Sep 11 16:45:43.807069 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:45:43.807044    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb59cfe80b75459710f343bc0a2c5862d315284f81bffe641ee05c53458eadf2\": container with ID starting with eb59cfe80b75459710f343bc0a2c5862d315284f81bffe641ee05c53458eadf2 not found: ID does not exist" containerID="eb59cfe80b75459710f343bc0a2c5862d315284f81bffe641ee05c53458eadf2"
Sep 11 16:45:43.807173 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:43.807075    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb59cfe80b75459710f343bc0a2c5862d315284f81bffe641ee05c53458eadf2"} err="failed to get container status \"eb59cfe80b75459710f343bc0a2c5862d315284f81bffe641ee05c53458eadf2\": rpc error: code = NotFound desc = could not find container \"eb59cfe80b75459710f343bc0a2c5862d315284f81bffe641ee05c53458eadf2\": container with ID starting with eb59cfe80b75459710f343bc0a2c5862d315284f81bffe641ee05c53458eadf2 not found: ID does not exist"
Sep 11 16:45:43.829327 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:43.829289    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp"]
Sep 11 16:45:43.836405 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:43.836378    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-42752c-6877fd584c-8wklp"]
Sep 11 16:45:44.948155 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:44.948124    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="102075ae-74e0-4472-a8d0-2e5e3fa811b7" path="/var/lib/kubelet/pods/102075ae-74e0-4472-a8d0-2e5e3fa811b7/volumes"
Sep 11 16:45:57.104022 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.103982    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5"]
Sep 11 16:45:57.104416 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.104379    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="102075ae-74e0-4472-a8d0-2e5e3fa811b7" containerName="payload-processing"
Sep 11 16:45:57.104416 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.104392    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="102075ae-74e0-4472-a8d0-2e5e3fa811b7" containerName="payload-processing"
Sep 11 16:45:57.104416 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.104405    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ded93d86-f728-4128-956c-d35ee366889d" containerName="istio-proxy"
Sep 11 16:45:57.104416 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.104410    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ded93d86-f728-4128-956c-d35ee366889d" containerName="istio-proxy"
Sep 11 16:45:57.104552 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.104488    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="102075ae-74e0-4472-a8d0-2e5e3fa811b7" containerName="payload-processing"
Sep 11 16:45:57.108805 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.108786    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5"
Sep 11 16:45:57.111949 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.111923    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-a864cd-dockercfg-5krsr\""
Sep 11 16:45:57.112064 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.111980    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-a864cd\""
Sep 11 16:45:57.119086 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.119053    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5"]
Sep 11 16:45:57.130011 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.129980    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49b82d21-4909-459f-a3f2-32af12fa2040-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5\" (UID: \"49b82d21-4909-459f-a3f2-32af12fa2040\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5"
Sep 11 16:45:57.130170 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.130021    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9887\" (UniqueName: \"kubernetes.io/projected/49b82d21-4909-459f-a3f2-32af12fa2040-kube-api-access-h9887\") pod \"payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5\" (UID: \"49b82d21-4909-459f-a3f2-32af12fa2040\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5"
Sep 11 16:45:57.231737 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.231701    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49b82d21-4909-459f-a3f2-32af12fa2040-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5\" (UID: \"49b82d21-4909-459f-a3f2-32af12fa2040\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5"
Sep 11 16:45:57.231737 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.231750    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9887\" (UniqueName: \"kubernetes.io/projected/49b82d21-4909-459f-a3f2-32af12fa2040-kube-api-access-h9887\") pod \"payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5\" (UID: \"49b82d21-4909-459f-a3f2-32af12fa2040\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5"
Sep 11 16:45:57.232572 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.232541    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49b82d21-4909-459f-a3f2-32af12fa2040-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5\" (UID: \"49b82d21-4909-459f-a3f2-32af12fa2040\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5"
Sep 11 16:45:57.246368 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.246332    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9887\" (UniqueName: \"kubernetes.io/projected/49b82d21-4909-459f-a3f2-32af12fa2040-kube-api-access-h9887\") pod \"payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5\" (UID: \"49b82d21-4909-459f-a3f2-32af12fa2040\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5"
Sep 11 16:45:57.420578 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.420480    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5"
Sep 11 16:45:57.701797 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.701762    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5"]
Sep 11 16:45:57.703556 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:45:57.703525    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b82d21_4909_459f_a3f2_32af12fa2040.slice/crio-eaf6c12df307f3a4a214326635f552d16c807abb83bd87844c523e87b9f8fc33 WatchSource:0}: Error finding container eaf6c12df307f3a4a214326635f552d16c807abb83bd87844c523e87b9f8fc33: Status 404 returned error can't find the container with id eaf6c12df307f3a4a214326635f552d16c807abb83bd87844c523e87b9f8fc33
Sep 11 16:45:57.885503 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.885464    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5" event={"ID":"49b82d21-4909-459f-a3f2-32af12fa2040","Type":"ContainerStarted","Data":"e5b5e75d912f7cff393e89dc9953bdb5a1dc45567551f02b6fa67c280cd2112d"}
Sep 11 16:45:57.885705 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.885527    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5" event={"ID":"49b82d21-4909-459f-a3f2-32af12fa2040","Type":"ContainerStarted","Data":"eaf6c12df307f3a4a214326635f552d16c807abb83bd87844c523e87b9f8fc33"}
Sep 11 16:45:57.885758 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.885730    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5"
Sep 11 16:45:57.913136 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:45:57.913081    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5" podStartSLOduration=0.913063553 podStartE2EDuration="913.063553ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:45:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:45:57.910864194 +0000 UTC m=+977.529138364" watchObservedRunningTime="2026-09-11 16:45:57.913063553 +0000 UTC m=+977.531337723"
Sep 11 16:46:08.893431 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:46:08.893342    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5"
Sep 11 16:47:09.969831 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:09.969796    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"]
Sep 11 16:47:09.973577 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:09.973554    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"
Sep 11 16:47:09.977199 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:09.977169    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-424dd7d1-serving-cert\""
Sep 11 16:47:09.991802 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:09.991774    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"]
Sep 11 16:47:10.136188 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:10.136148    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-openshift-service-ca\") pod \"maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2\" (UID: \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"
Sep 11 16:47:10.136358 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:10.136258    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-metrics-certs\") pod \"maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2\" (UID: \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"
Sep 11 16:47:10.136358 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:10.136297    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64x8z\" (UniqueName: \"kubernetes.io/projected/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-kube-api-access-64x8z\") pod \"maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2\" (UID: \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"
Sep 11 16:47:10.136358 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:10.136318    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-maas-api-tls\") pod \"maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2\" (UID: \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"
Sep 11 16:47:10.237896 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:10.237796    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-openshift-service-ca\") pod \"maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2\" (UID: \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"
Sep 11 16:47:10.237896 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:10.237862    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-metrics-certs\") pod \"maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2\" (UID: \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"
Sep 11 16:47:10.237896 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:10.237887    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64x8z\" (UniqueName: \"kubernetes.io/projected/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-kube-api-access-64x8z\") pod \"maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2\" (UID: \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"
Sep 11 16:47:10.238160 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:10.237906    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-maas-api-tls\") pod \"maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2\" (UID: \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"
Sep 11 16:47:10.238579 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:10.238551    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-openshift-service-ca\") pod \"maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2\" (UID: \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"
Sep 11 16:47:10.240382 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:10.240351    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-maas-api-tls\") pod \"maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2\" (UID: \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"
Sep 11 16:47:10.240501 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:10.240450    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-metrics-certs\") pod \"maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2\" (UID: \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"
Sep 11 16:47:10.249485 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:10.249460    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64x8z\" (UniqueName: \"kubernetes.io/projected/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-kube-api-access-64x8z\") pod \"maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2\" (UID: \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"
Sep 11 16:47:10.285353 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:10.285307    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"
Sep 11 16:47:10.563932 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:10.563899    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"]
Sep 11 16:47:10.564050 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:47:10.563956    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f4ef0a_b22a_4ba0_bb64_01ad8fb69945.slice/crio-a4447298191a7e6f6ce8961b39115f0c903061b74701160f6d90d5671b2dc520 WatchSource:0}: Error finding container a4447298191a7e6f6ce8961b39115f0c903061b74701160f6d90d5671b2dc520: Status 404 returned error can't find the container with id a4447298191a7e6f6ce8961b39115f0c903061b74701160f6d90d5671b2dc520
Sep 11 16:47:11.318561 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:11.318458    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2" event={"ID":"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945","Type":"ContainerStarted","Data":"8164eaae79f6ad6a3231170c27ac5c4e274da36916636ca91387fc60f9bf9fee"}
Sep 11 16:47:11.318561 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:11.318526    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2" event={"ID":"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945","Type":"ContainerStarted","Data":"a4447298191a7e6f6ce8961b39115f0c903061b74701160f6d90d5671b2dc520"}
Sep 11 16:47:11.319006 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:11.318578    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"
Sep 11 16:47:11.373319 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:11.373255    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2" podStartSLOduration=1.874951656 podStartE2EDuration="2.37323054s" totalImagesPullingTime="498.278884ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:47:11.371797472 +0000 UTC m=+1050.990071642" watchObservedRunningTime="2026-09-11 16:47:11.37323054 +0000 UTC m=+1050.991504711"
Sep 11 16:47:11.401680 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:11.401638    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5"]
Sep 11 16:47:11.401874 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:11.401845    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5" podUID="49b82d21-4909-459f-a3f2-32af12fa2040" containerName="payload-pre-processing" containerID="cri-o://e5b5e75d912f7cff393e89dc9953bdb5a1dc45567551f02b6fa67c280cd2112d" gracePeriod=30
Sep 11 16:47:11.674917 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:11.674886    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5"
Sep 11 16:47:11.749924 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:11.749874    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9887\" (UniqueName: \"kubernetes.io/projected/49b82d21-4909-459f-a3f2-32af12fa2040-kube-api-access-h9887\") pod \"49b82d21-4909-459f-a3f2-32af12fa2040\" (UID: \"49b82d21-4909-459f-a3f2-32af12fa2040\") "
Sep 11 16:47:11.749924 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:11.749923    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49b82d21-4909-459f-a3f2-32af12fa2040-plugins-config-volume\") pod \"49b82d21-4909-459f-a3f2-32af12fa2040\" (UID: \"49b82d21-4909-459f-a3f2-32af12fa2040\") "
Sep 11 16:47:11.750597 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:11.750561    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49b82d21-4909-459f-a3f2-32af12fa2040-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "49b82d21-4909-459f-a3f2-32af12fa2040" (UID: "49b82d21-4909-459f-a3f2-32af12fa2040"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:47:11.752531 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:11.752499    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49b82d21-4909-459f-a3f2-32af12fa2040-kube-api-access-h9887" (OuterVolumeSpecName: "kube-api-access-h9887") pod "49b82d21-4909-459f-a3f2-32af12fa2040" (UID: "49b82d21-4909-459f-a3f2-32af12fa2040"). InnerVolumeSpecName "kube-api-access-h9887". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:47:11.850743 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:11.850652    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49b82d21-4909-459f-a3f2-32af12fa2040-plugins-config-volume\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:11.850743 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:11.850684    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9887\" (UniqueName: \"kubernetes.io/projected/49b82d21-4909-459f-a3f2-32af12fa2040-kube-api-access-h9887\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:12.325241 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:12.325208    2557 generic.go:356] "Generic (PLEG): container finished" podID="49b82d21-4909-459f-a3f2-32af12fa2040" containerID="e5b5e75d912f7cff393e89dc9953bdb5a1dc45567551f02b6fa67c280cd2112d" exitCode=0
Sep 11 16:47:12.325849 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:12.325258    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5"
Sep 11 16:47:12.325849 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:12.325344    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5" event={"ID":"49b82d21-4909-459f-a3f2-32af12fa2040","Type":"ContainerDied","Data":"e5b5e75d912f7cff393e89dc9953bdb5a1dc45567551f02b6fa67c280cd2112d"}
Sep 11 16:47:12.325849 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:12.325404    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5" event={"ID":"49b82d21-4909-459f-a3f2-32af12fa2040","Type":"ContainerDied","Data":"eaf6c12df307f3a4a214326635f552d16c807abb83bd87844c523e87b9f8fc33"}
Sep 11 16:47:12.325849 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:12.325435    2557 scope.go:117] "RemoveContainer" containerID="e5b5e75d912f7cff393e89dc9953bdb5a1dc45567551f02b6fa67c280cd2112d"
Sep 11 16:47:12.335522 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:12.335498    2557 scope.go:117] "RemoveContainer" containerID="e5b5e75d912f7cff393e89dc9953bdb5a1dc45567551f02b6fa67c280cd2112d"
Sep 11 16:47:12.335828 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:47:12.335809    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5b5e75d912f7cff393e89dc9953bdb5a1dc45567551f02b6fa67c280cd2112d\": container with ID starting with e5b5e75d912f7cff393e89dc9953bdb5a1dc45567551f02b6fa67c280cd2112d not found: ID does not exist" containerID="e5b5e75d912f7cff393e89dc9953bdb5a1dc45567551f02b6fa67c280cd2112d"
Sep 11 16:47:12.335903 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:12.335837    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5b5e75d912f7cff393e89dc9953bdb5a1dc45567551f02b6fa67c280cd2112d"} err="failed to get container status \"e5b5e75d912f7cff393e89dc9953bdb5a1dc45567551f02b6fa67c280cd2112d\": rpc error: code = NotFound desc = could not find container \"e5b5e75d912f7cff393e89dc9953bdb5a1dc45567551f02b6fa67c280cd2112d\": container with ID starting with e5b5e75d912f7cff393e89dc9953bdb5a1dc45567551f02b6fa67c280cd2112d not found: ID does not exist"
Sep 11 16:47:12.355495 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:12.355464    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5"]
Sep 11 16:47:12.359814 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:12.359787    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a864cd-769b5b769d-wbhc5"]
Sep 11 16:47:12.949428 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:12.949396    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49b82d21-4909-459f-a3f2-32af12fa2040" path="/var/lib/kubelet/pods/49b82d21-4909-459f-a3f2-32af12fa2040/volumes"
Sep 11 16:47:17.331769 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:17.331731    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"
Sep 11 16:47:38.615925 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:38.615833    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"]
Sep 11 16:47:51.041253 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.041221    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"]
Sep 11 16:47:51.041832 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.041455    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z" podUID="b599286d-184b-4db1-8b88-dd782f726857" containerName="maas-api" containerID="cri-o://ff41a42f199cf7714f7d279529d86e3221dad90657eb4477ec724ee6a3f83fdd" gracePeriod=30
Sep 11 16:47:51.116754 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.116720    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26"]
Sep 11 16:47:51.117006 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.116957    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26" podUID="f641af03-346a-47cb-b87a-e2d705a018ef" containerName="payload-processing" containerID="cri-o://5de0307b67746770cdb63afff42da724dc2abb23006c397ad1a9c3549a491c44" gracePeriod=30
Sep 11 16:47:51.128386 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.128356    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv"]
Sep 11 16:47:51.128581 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.128556    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv" podUID="74a4203d-3c62-4b23-88f4-f99c88456baa" containerName="payload-pre-processing" containerID="cri-o://40ec7270e4fc3fb1765af484f79cdbde13c239f1f663e20d3d5a87d87f28866a" gracePeriod=30
Sep 11 16:47:51.324789 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.324758    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"
Sep 11 16:47:51.346555 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.345014    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b599286d-184b-4db1-8b88-dd782f726857-openshift-service-ca\") pod \"b599286d-184b-4db1-8b88-dd782f726857\" (UID: \"b599286d-184b-4db1-8b88-dd782f726857\") "
Sep 11 16:47:51.346555 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.345101    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b599286d-184b-4db1-8b88-dd782f726857-metrics-certs\") pod \"b599286d-184b-4db1-8b88-dd782f726857\" (UID: \"b599286d-184b-4db1-8b88-dd782f726857\") "
Sep 11 16:47:51.346555 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.345144    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b599286d-184b-4db1-8b88-dd782f726857-maas-api-tls\") pod \"b599286d-184b-4db1-8b88-dd782f726857\" (UID: \"b599286d-184b-4db1-8b88-dd782f726857\") "
Sep 11 16:47:51.346555 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.345260    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw8v7\" (UniqueName: \"kubernetes.io/projected/b599286d-184b-4db1-8b88-dd782f726857-kube-api-access-gw8v7\") pod \"b599286d-184b-4db1-8b88-dd782f726857\" (UID: \"b599286d-184b-4db1-8b88-dd782f726857\") "
Sep 11 16:47:51.346555 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.346502    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b599286d-184b-4db1-8b88-dd782f726857-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b599286d-184b-4db1-8b88-dd782f726857" (UID: "b599286d-184b-4db1-8b88-dd782f726857"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:47:51.349845 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.349535    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b599286d-184b-4db1-8b88-dd782f726857-kube-api-access-gw8v7" (OuterVolumeSpecName: "kube-api-access-gw8v7") pod "b599286d-184b-4db1-8b88-dd782f726857" (UID: "b599286d-184b-4db1-8b88-dd782f726857"). InnerVolumeSpecName "kube-api-access-gw8v7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:47:51.353321 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.353194    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b599286d-184b-4db1-8b88-dd782f726857-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b599286d-184b-4db1-8b88-dd782f726857" (UID: "b599286d-184b-4db1-8b88-dd782f726857"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:47:51.356069 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.355706    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b599286d-184b-4db1-8b88-dd782f726857-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b599286d-184b-4db1-8b88-dd782f726857" (UID: "b599286d-184b-4db1-8b88-dd782f726857"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:47:51.393570 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.393543    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26"
Sep 11 16:47:51.436176 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.436150    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv"
Sep 11 16:47:51.446464 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.446435    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f641af03-346a-47cb-b87a-e2d705a018ef-plugins-config-volume\") pod \"f641af03-346a-47cb-b87a-e2d705a018ef\" (UID: \"f641af03-346a-47cb-b87a-e2d705a018ef\") "
Sep 11 16:47:51.446632 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.446515    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68n8d\" (UniqueName: \"kubernetes.io/projected/f641af03-346a-47cb-b87a-e2d705a018ef-kube-api-access-68n8d\") pod \"f641af03-346a-47cb-b87a-e2d705a018ef\" (UID: \"f641af03-346a-47cb-b87a-e2d705a018ef\") "
Sep 11 16:47:51.446713 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.446701    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b599286d-184b-4db1-8b88-dd782f726857-openshift-service-ca\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:51.446771 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.446715    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b599286d-184b-4db1-8b88-dd782f726857-metrics-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:51.446771 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.446725    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b599286d-184b-4db1-8b88-dd782f726857-maas-api-tls\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:51.446771 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.446734    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw8v7\" (UniqueName: \"kubernetes.io/projected/b599286d-184b-4db1-8b88-dd782f726857-kube-api-access-gw8v7\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:51.446906 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.446880    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f641af03-346a-47cb-b87a-e2d705a018ef-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f641af03-346a-47cb-b87a-e2d705a018ef" (UID: "f641af03-346a-47cb-b87a-e2d705a018ef"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:47:51.448587 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.448567    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f641af03-346a-47cb-b87a-e2d705a018ef-kube-api-access-68n8d" (OuterVolumeSpecName: "kube-api-access-68n8d") pod "f641af03-346a-47cb-b87a-e2d705a018ef" (UID: "f641af03-346a-47cb-b87a-e2d705a018ef"). InnerVolumeSpecName "kube-api-access-68n8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:47:51.547560 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.547471    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74a4203d-3c62-4b23-88f4-f99c88456baa-plugins-config-volume\") pod \"74a4203d-3c62-4b23-88f4-f99c88456baa\" (UID: \"74a4203d-3c62-4b23-88f4-f99c88456baa\") "
Sep 11 16:47:51.547560 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.547528    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2lnl\" (UniqueName: \"kubernetes.io/projected/74a4203d-3c62-4b23-88f4-f99c88456baa-kube-api-access-v2lnl\") pod \"74a4203d-3c62-4b23-88f4-f99c88456baa\" (UID: \"74a4203d-3c62-4b23-88f4-f99c88456baa\") "
Sep 11 16:47:51.547798 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.547786    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f641af03-346a-47cb-b87a-e2d705a018ef-plugins-config-volume\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:51.547836 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.547799    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68n8d\" (UniqueName: \"kubernetes.io/projected/f641af03-346a-47cb-b87a-e2d705a018ef-kube-api-access-68n8d\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:51.547908 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.547885    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74a4203d-3c62-4b23-88f4-f99c88456baa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "74a4203d-3c62-4b23-88f4-f99c88456baa" (UID: "74a4203d-3c62-4b23-88f4-f99c88456baa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:47:51.549637 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.549596    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74a4203d-3c62-4b23-88f4-f99c88456baa-kube-api-access-v2lnl" (OuterVolumeSpecName: "kube-api-access-v2lnl") pod "74a4203d-3c62-4b23-88f4-f99c88456baa" (UID: "74a4203d-3c62-4b23-88f4-f99c88456baa"). InnerVolumeSpecName "kube-api-access-v2lnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:47:51.555780 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.555751    2557 generic.go:356] "Generic (PLEG): container finished" podID="74a4203d-3c62-4b23-88f4-f99c88456baa" containerID="40ec7270e4fc3fb1765af484f79cdbde13c239f1f663e20d3d5a87d87f28866a" exitCode=0
Sep 11 16:47:51.555915 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.555796    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv"
Sep 11 16:47:51.555915 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.555854    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv" event={"ID":"74a4203d-3c62-4b23-88f4-f99c88456baa","Type":"ContainerDied","Data":"40ec7270e4fc3fb1765af484f79cdbde13c239f1f663e20d3d5a87d87f28866a"}
Sep 11 16:47:51.555915 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.555906    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv" event={"ID":"74a4203d-3c62-4b23-88f4-f99c88456baa","Type":"ContainerDied","Data":"fd0ae4b375a3ead7590b30f583eb1c67d0a40f89f31df3b017b9b00b36236b1a"}
Sep 11 16:47:51.556084 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.555933    2557 scope.go:117] "RemoveContainer" containerID="40ec7270e4fc3fb1765af484f79cdbde13c239f1f663e20d3d5a87d87f28866a"
Sep 11 16:47:51.557299 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.557275    2557 generic.go:356] "Generic (PLEG): container finished" podID="b599286d-184b-4db1-8b88-dd782f726857" containerID="ff41a42f199cf7714f7d279529d86e3221dad90657eb4477ec724ee6a3f83fdd" exitCode=0
Sep 11 16:47:51.557438 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.557312    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"
Sep 11 16:47:51.557438 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.557358    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z" event={"ID":"b599286d-184b-4db1-8b88-dd782f726857","Type":"ContainerDied","Data":"ff41a42f199cf7714f7d279529d86e3221dad90657eb4477ec724ee6a3f83fdd"}
Sep 11 16:47:51.557438 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.557424    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z" event={"ID":"b599286d-184b-4db1-8b88-dd782f726857","Type":"ContainerDied","Data":"7d14ee50e82fa479922a0fa07f9b8e9cd8d1b96be3a55d4cd1b01c9adcfbb309"}
Sep 11 16:47:51.558943 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.558920    2557 generic.go:356] "Generic (PLEG): container finished" podID="f641af03-346a-47cb-b87a-e2d705a018ef" containerID="5de0307b67746770cdb63afff42da724dc2abb23006c397ad1a9c3549a491c44" exitCode=0
Sep 11 16:47:51.559070 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.558972    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26"
Sep 11 16:47:51.559070 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.559007    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26" event={"ID":"f641af03-346a-47cb-b87a-e2d705a018ef","Type":"ContainerDied","Data":"5de0307b67746770cdb63afff42da724dc2abb23006c397ad1a9c3549a491c44"}
Sep 11 16:47:51.559070 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.559062    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26" event={"ID":"f641af03-346a-47cb-b87a-e2d705a018ef","Type":"ContainerDied","Data":"3e6b3474b240e9a319550d9697b3059cce2f90d856b1609a1cc7f73ee2b145bd"}
Sep 11 16:47:51.568308 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.568258    2557 scope.go:117] "RemoveContainer" containerID="40ec7270e4fc3fb1765af484f79cdbde13c239f1f663e20d3d5a87d87f28866a"
Sep 11 16:47:51.570211 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:47:51.570185    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40ec7270e4fc3fb1765af484f79cdbde13c239f1f663e20d3d5a87d87f28866a\": container with ID starting with 40ec7270e4fc3fb1765af484f79cdbde13c239f1f663e20d3d5a87d87f28866a not found: ID does not exist" containerID="40ec7270e4fc3fb1765af484f79cdbde13c239f1f663e20d3d5a87d87f28866a"
Sep 11 16:47:51.570314 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.570225    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40ec7270e4fc3fb1765af484f79cdbde13c239f1f663e20d3d5a87d87f28866a"} err="failed to get container status \"40ec7270e4fc3fb1765af484f79cdbde13c239f1f663e20d3d5a87d87f28866a\": rpc error: code = NotFound desc = could not find container \"40ec7270e4fc3fb1765af484f79cdbde13c239f1f663e20d3d5a87d87f28866a\": container with ID starting with 40ec7270e4fc3fb1765af484f79cdbde13c239f1f663e20d3d5a87d87f28866a not found: ID does not exist"
Sep 11 16:47:51.570314 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.570251    2557 scope.go:117] "RemoveContainer" containerID="ff41a42f199cf7714f7d279529d86e3221dad90657eb4477ec724ee6a3f83fdd"
Sep 11 16:47:51.579161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.579135    2557 scope.go:117] "RemoveContainer" containerID="ff41a42f199cf7714f7d279529d86e3221dad90657eb4477ec724ee6a3f83fdd"
Sep 11 16:47:51.579466 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:47:51.579449    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff41a42f199cf7714f7d279529d86e3221dad90657eb4477ec724ee6a3f83fdd\": container with ID starting with ff41a42f199cf7714f7d279529d86e3221dad90657eb4477ec724ee6a3f83fdd not found: ID does not exist" containerID="ff41a42f199cf7714f7d279529d86e3221dad90657eb4477ec724ee6a3f83fdd"
Sep 11 16:47:51.579530 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.579474    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff41a42f199cf7714f7d279529d86e3221dad90657eb4477ec724ee6a3f83fdd"} err="failed to get container status \"ff41a42f199cf7714f7d279529d86e3221dad90657eb4477ec724ee6a3f83fdd\": rpc error: code = NotFound desc = could not find container \"ff41a42f199cf7714f7d279529d86e3221dad90657eb4477ec724ee6a3f83fdd\": container with ID starting with ff41a42f199cf7714f7d279529d86e3221dad90657eb4477ec724ee6a3f83fdd not found: ID does not exist"
Sep 11 16:47:51.579530 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.579492    2557 scope.go:117] "RemoveContainer" containerID="5de0307b67746770cdb63afff42da724dc2abb23006c397ad1a9c3549a491c44"
Sep 11 16:47:51.587532 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.587510    2557 scope.go:117] "RemoveContainer" containerID="5de0307b67746770cdb63afff42da724dc2abb23006c397ad1a9c3549a491c44"
Sep 11 16:47:51.587833 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:47:51.587812    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5de0307b67746770cdb63afff42da724dc2abb23006c397ad1a9c3549a491c44\": container with ID starting with 5de0307b67746770cdb63afff42da724dc2abb23006c397ad1a9c3549a491c44 not found: ID does not exist" containerID="5de0307b67746770cdb63afff42da724dc2abb23006c397ad1a9c3549a491c44"
Sep 11 16:47:51.587931 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.587838    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5de0307b67746770cdb63afff42da724dc2abb23006c397ad1a9c3549a491c44"} err="failed to get container status \"5de0307b67746770cdb63afff42da724dc2abb23006c397ad1a9c3549a491c44\": rpc error: code = NotFound desc = could not find container \"5de0307b67746770cdb63afff42da724dc2abb23006c397ad1a9c3549a491c44\": container with ID starting with 5de0307b67746770cdb63afff42da724dc2abb23006c397ad1a9c3549a491c44 not found: ID does not exist"
Sep 11 16:47:51.600848 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.600809    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"]
Sep 11 16:47:51.608893 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.608867    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4264bf-569b6c7544-lzl9z"]
Sep 11 16:47:51.632343 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.632305    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv"]
Sep 11 16:47:51.635330 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.635291    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-4264bf-c485894f8-97pcv"]
Sep 11 16:47:51.648592 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.648556    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2lnl\" (UniqueName: \"kubernetes.io/projected/74a4203d-3c62-4b23-88f4-f99c88456baa-kube-api-access-v2lnl\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:51.648592 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.648582    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/74a4203d-3c62-4b23-88f4-f99c88456baa-plugins-config-volume\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:51.654505 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.654475    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26"]
Sep 11 16:47:51.668985 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:51.668957    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-4264bf-7d8fc7d48f-xsp26"]
Sep 11 16:47:52.947057 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:52.947023    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74a4203d-3c62-4b23-88f4-f99c88456baa" path="/var/lib/kubelet/pods/74a4203d-3c62-4b23-88f4-f99c88456baa/volumes"
Sep 11 16:47:52.947459 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:52.947444    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b599286d-184b-4db1-8b88-dd782f726857" path="/var/lib/kubelet/pods/b599286d-184b-4db1-8b88-dd782f726857/volumes"
Sep 11 16:47:52.947810 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:52.947796    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f641af03-346a-47cb-b87a-e2d705a018ef" path="/var/lib/kubelet/pods/f641af03-346a-47cb-b87a-e2d705a018ef/volumes"
Sep 11 16:47:53.635235 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:53.635190    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt" podUID="0a28e49e-fa6b-4034-8dbf-1cce490f47ee" containerName="main" containerID="cri-o://024c5769e7785ef797a3142f35aa629554dec9d5fd81344c5462e18ba6850bbf" gracePeriod=45
Sep 11 16:47:53.774054 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:53.774015    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"]
Sep 11 16:47:53.774327 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:53.774295    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2" podUID="d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945" containerName="maas-api" containerID="cri-o://8164eaae79f6ad6a3231170c27ac5c4e274da36916636ca91387fc60f9bf9fee" gracePeriod=30
Sep 11 16:47:53.917910 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:53.917876    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:47:53.970441 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:53.970411    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-tmp-dir\") pod \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") "
Sep 11 16:47:53.970981 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:53.970474    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-model-cache\") pod \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") "
Sep 11 16:47:53.970981 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:53.970516    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkj4z\" (UniqueName: \"kubernetes.io/projected/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-kube-api-access-zkj4z\") pod \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") "
Sep 11 16:47:53.970981 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:53.970572    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-tls-certs\") pod \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") "
Sep 11 16:47:53.970981 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:53.970593    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-home\") pod \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") "
Sep 11 16:47:53.970981 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:53.970637    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-dshm\") pod \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\" (UID: \"0a28e49e-fa6b-4034-8dbf-1cce490f47ee\") "
Sep 11 16:47:53.970981 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:53.970730    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0a28e49e-fa6b-4034-8dbf-1cce490f47ee" (UID: "0a28e49e-fa6b-4034-8dbf-1cce490f47ee"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:47:53.970981 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:53.970740    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-model-cache" (OuterVolumeSpecName: "model-cache") pod "0a28e49e-fa6b-4034-8dbf-1cce490f47ee" (UID: "0a28e49e-fa6b-4034-8dbf-1cce490f47ee"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:47:53.971368 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:53.971096    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-tmp-dir\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:53.971368 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:53.971121    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-model-cache\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:53.971626 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:53.971577    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-home" (OuterVolumeSpecName: "home") pod "0a28e49e-fa6b-4034-8dbf-1cce490f47ee" (UID: "0a28e49e-fa6b-4034-8dbf-1cce490f47ee"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:47:53.973771 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:53.973741    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-kube-api-access-zkj4z" (OuterVolumeSpecName: "kube-api-access-zkj4z") pod "0a28e49e-fa6b-4034-8dbf-1cce490f47ee" (UID: "0a28e49e-fa6b-4034-8dbf-1cce490f47ee"). InnerVolumeSpecName "kube-api-access-zkj4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:47:53.973872 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:53.973803    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0a28e49e-fa6b-4034-8dbf-1cce490f47ee" (UID: "0a28e49e-fa6b-4034-8dbf-1cce490f47ee"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:47:53.974090 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:53.974053    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-dshm" (OuterVolumeSpecName: "dshm") pod "0a28e49e-fa6b-4034-8dbf-1cce490f47ee" (UID: "0a28e49e-fa6b-4034-8dbf-1cce490f47ee"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:47:54.024197 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.024171    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"
Sep 11 16:47:54.071707 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.071667    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-openshift-service-ca\") pod \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\" (UID: \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\") "
Sep 11 16:47:54.072004 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.071752    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-metrics-certs\") pod \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\" (UID: \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\") "
Sep 11 16:47:54.072004 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.071806    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64x8z\" (UniqueName: \"kubernetes.io/projected/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-kube-api-access-64x8z\") pod \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\" (UID: \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\") "
Sep 11 16:47:54.072004 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.071834    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-maas-api-tls\") pod \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\" (UID: \"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945\") "
Sep 11 16:47:54.072303 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.072142    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945" (UID: "d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:47:54.072303 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.072204    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-tls-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:54.072303 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.072223    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-home\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:54.072303 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.072236    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-dshm\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:54.072303 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.072249    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkj4z\" (UniqueName: \"kubernetes.io/projected/0a28e49e-fa6b-4034-8dbf-1cce490f47ee-kube-api-access-zkj4z\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:54.074722 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.074687    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945" (UID: "d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:47:54.074827 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.074759    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945" (UID: "d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:47:54.075053 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.075029    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-kube-api-access-64x8z" (OuterVolumeSpecName: "kube-api-access-64x8z") pod "d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945" (UID: "d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945"). InnerVolumeSpecName "kube-api-access-64x8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:47:54.172795 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.172708    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-openshift-service-ca\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:54.172795 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.172739    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-metrics-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:54.172795 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.172750    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64x8z\" (UniqueName: \"kubernetes.io/projected/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-kube-api-access-64x8z\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:54.172795 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.172758    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945-maas-api-tls\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:47:54.580891 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.580855    2557 generic.go:356] "Generic (PLEG): container finished" podID="d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945" containerID="8164eaae79f6ad6a3231170c27ac5c4e274da36916636ca91387fc60f9bf9fee" exitCode=0
Sep 11 16:47:54.581095 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.580902    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"
Sep 11 16:47:54.581095 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.580941    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2" event={"ID":"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945","Type":"ContainerDied","Data":"8164eaae79f6ad6a3231170c27ac5c4e274da36916636ca91387fc60f9bf9fee"}
Sep 11 16:47:54.581095 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.581001    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2" event={"ID":"d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945","Type":"ContainerDied","Data":"a4447298191a7e6f6ce8961b39115f0c903061b74701160f6d90d5671b2dc520"}
Sep 11 16:47:54.581095 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.581032    2557 scope.go:117] "RemoveContainer" containerID="8164eaae79f6ad6a3231170c27ac5c4e274da36916636ca91387fc60f9bf9fee"
Sep 11 16:47:54.582408 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.582382    2557 generic.go:356] "Generic (PLEG): container finished" podID="0a28e49e-fa6b-4034-8dbf-1cce490f47ee" containerID="024c5769e7785ef797a3142f35aa629554dec9d5fd81344c5462e18ba6850bbf" exitCode=0
Sep 11 16:47:54.582543 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.582413    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"
Sep 11 16:47:54.582543 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.582502    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt" event={"ID":"0a28e49e-fa6b-4034-8dbf-1cce490f47ee","Type":"ContainerDied","Data":"024c5769e7785ef797a3142f35aa629554dec9d5fd81344c5462e18ba6850bbf"}
Sep 11 16:47:54.582543 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.582534    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt" event={"ID":"0a28e49e-fa6b-4034-8dbf-1cce490f47ee","Type":"ContainerDied","Data":"90719f5d38c77d59a5be1cb0a2c22771a83ebe8af923f3fe9e50e8104e0dc6b0"}
Sep 11 16:47:54.592043 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.592025    2557 scope.go:117] "RemoveContainer" containerID="8164eaae79f6ad6a3231170c27ac5c4e274da36916636ca91387fc60f9bf9fee"
Sep 11 16:47:54.592345 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:47:54.592319    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8164eaae79f6ad6a3231170c27ac5c4e274da36916636ca91387fc60f9bf9fee\": container with ID starting with 8164eaae79f6ad6a3231170c27ac5c4e274da36916636ca91387fc60f9bf9fee not found: ID does not exist" containerID="8164eaae79f6ad6a3231170c27ac5c4e274da36916636ca91387fc60f9bf9fee"
Sep 11 16:47:54.592411 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.592345    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8164eaae79f6ad6a3231170c27ac5c4e274da36916636ca91387fc60f9bf9fee"} err="failed to get container status \"8164eaae79f6ad6a3231170c27ac5c4e274da36916636ca91387fc60f9bf9fee\": rpc error: code = NotFound desc = could not find container \"8164eaae79f6ad6a3231170c27ac5c4e274da36916636ca91387fc60f9bf9fee\": container with ID starting with 8164eaae79f6ad6a3231170c27ac5c4e274da36916636ca91387fc60f9bf9fee not found: ID does not exist"
Sep 11 16:47:54.592411 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.592363    2557 scope.go:117] "RemoveContainer" containerID="024c5769e7785ef797a3142f35aa629554dec9d5fd81344c5462e18ba6850bbf"
Sep 11 16:47:54.600585 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.600568    2557 scope.go:117] "RemoveContainer" containerID="024c5769e7785ef797a3142f35aa629554dec9d5fd81344c5462e18ba6850bbf"
Sep 11 16:47:54.600900 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:47:54.600876    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"024c5769e7785ef797a3142f35aa629554dec9d5fd81344c5462e18ba6850bbf\": container with ID starting with 024c5769e7785ef797a3142f35aa629554dec9d5fd81344c5462e18ba6850bbf not found: ID does not exist" containerID="024c5769e7785ef797a3142f35aa629554dec9d5fd81344c5462e18ba6850bbf"
Sep 11 16:47:54.600961 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.600907    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"024c5769e7785ef797a3142f35aa629554dec9d5fd81344c5462e18ba6850bbf"} err="failed to get container status \"024c5769e7785ef797a3142f35aa629554dec9d5fd81344c5462e18ba6850bbf\": rpc error: code = NotFound desc = could not find container \"024c5769e7785ef797a3142f35aa629554dec9d5fd81344c5462e18ba6850bbf\": container with ID starting with 024c5769e7785ef797a3142f35aa629554dec9d5fd81344c5462e18ba6850bbf not found: ID does not exist"
Sep 11 16:47:54.611328 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.611301    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"]
Sep 11 16:47:54.625445 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.625421    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-424dd7d1-7d47bb4856-prlm2"]
Sep 11 16:47:54.639877 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.639847    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"]
Sep 11 16:47:54.646191 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.646158    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-4264bf/test-model-4264bf-kserve-d77b94c6f-64jpt"]
Sep 11 16:47:54.946470 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.946374    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a28e49e-fa6b-4034-8dbf-1cce490f47ee" path="/var/lib/kubelet/pods/0a28e49e-fa6b-4034-8dbf-1cce490f47ee/volumes"
Sep 11 16:47:54.946904 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:54.946883    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945" path="/var/lib/kubelet/pods/d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945/volumes"
Sep 11 16:47:59.288464 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:59.288422    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"]
Sep 11 16:47:59.288941 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:47:59.288781    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf" podUID="b9bebf44-14c6-4d31-adaa-2ce9e71b5125" containerName="istio-proxy" containerID="cri-o://deab7f26a845fe136af07caa296f8b522b72d73b43970b097f61624438e60424" gracePeriod=30
Sep 11 16:48:04.542508 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.542480    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:48:04.647753 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.647663    2557 generic.go:356] "Generic (PLEG): container finished" podID="b9bebf44-14c6-4d31-adaa-2ce9e71b5125" containerID="deab7f26a845fe136af07caa296f8b522b72d73b43970b097f61624438e60424" exitCode=0
Sep 11 16:48:04.647753 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.647711    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"
Sep 11 16:48:04.647935 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.647752    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf" event={"ID":"b9bebf44-14c6-4d31-adaa-2ce9e71b5125","Type":"ContainerDied","Data":"deab7f26a845fe136af07caa296f8b522b72d73b43970b097f61624438e60424"}
Sep 11 16:48:04.647935 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.647828    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf" event={"ID":"b9bebf44-14c6-4d31-adaa-2ce9e71b5125","Type":"ContainerDied","Data":"ce491f4c1d272de4147e5170ba03a68f53081e2fed0188a795f2aee5539359fd"}
Sep 11 16:48:04.647935 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.647851    2557 scope.go:117] "RemoveContainer" containerID="deab7f26a845fe136af07caa296f8b522b72d73b43970b097f61624438e60424"
Sep 11 16:48:04.657292 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.657271    2557 scope.go:117] "RemoveContainer" containerID="dc23f6cadaaf6e5831f99c9471b135bf326acc02266b6ff198851b870df90ea6"
Sep 11 16:48:04.666108 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.666085    2557 scope.go:117] "RemoveContainer" containerID="deab7f26a845fe136af07caa296f8b522b72d73b43970b097f61624438e60424"
Sep 11 16:48:04.666399 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:48:04.666376    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deab7f26a845fe136af07caa296f8b522b72d73b43970b097f61624438e60424\": container with ID starting with deab7f26a845fe136af07caa296f8b522b72d73b43970b097f61624438e60424 not found: ID does not exist" containerID="deab7f26a845fe136af07caa296f8b522b72d73b43970b097f61624438e60424"
Sep 11 16:48:04.666453 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.666412    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deab7f26a845fe136af07caa296f8b522b72d73b43970b097f61624438e60424"} err="failed to get container status \"deab7f26a845fe136af07caa296f8b522b72d73b43970b097f61624438e60424\": rpc error: code = NotFound desc = could not find container \"deab7f26a845fe136af07caa296f8b522b72d73b43970b097f61624438e60424\": container with ID starting with deab7f26a845fe136af07caa296f8b522b72d73b43970b097f61624438e60424 not found: ID does not exist"
Sep 11 16:48:04.666453 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.666432    2557 scope.go:117] "RemoveContainer" containerID="dc23f6cadaaf6e5831f99c9471b135bf326acc02266b6ff198851b870df90ea6"
Sep 11 16:48:04.666700 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:48:04.666674    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc23f6cadaaf6e5831f99c9471b135bf326acc02266b6ff198851b870df90ea6\": container with ID starting with dc23f6cadaaf6e5831f99c9471b135bf326acc02266b6ff198851b870df90ea6 not found: ID does not exist" containerID="dc23f6cadaaf6e5831f99c9471b135bf326acc02266b6ff198851b870df90ea6"
Sep 11 16:48:04.666753 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.666700    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc23f6cadaaf6e5831f99c9471b135bf326acc02266b6ff198851b870df90ea6"} err="failed to get container status \"dc23f6cadaaf6e5831f99c9471b135bf326acc02266b6ff198851b870df90ea6\": rpc error: code = NotFound desc = could not find container \"dc23f6cadaaf6e5831f99c9471b135bf326acc02266b6ff198851b870df90ea6\": container with ID starting with dc23f6cadaaf6e5831f99c9471b135bf326acc02266b6ff198851b870df90ea6 not found: ID does not exist"
Sep 11 16:48:04.666801 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.666785    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-credential-socket\") pod \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") "
Sep 11 16:48:04.666841 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.666819    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-data\") pod \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") "
Sep 11 16:48:04.666883 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.666853    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-token\") pod \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") "
Sep 11 16:48:04.666925 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.666885    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-podinfo\") pod \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") "
Sep 11 16:48:04.666925 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.666900    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-workload-socket\") pod \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") "
Sep 11 16:48:04.666925 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.666919    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istiod-ca-cert\") pod \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") "
Sep 11 16:48:04.667074 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.666941    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwqpb\" (UniqueName: \"kubernetes.io/projected/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-kube-api-access-zwqpb\") pod \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") "
Sep 11 16:48:04.667074 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.667004    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-workload-certs\") pod \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") "
Sep 11 16:48:04.667074 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.667037    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b9bebf44-14c6-4d31-adaa-2ce9e71b5125" (UID: "b9bebf44-14c6-4d31-adaa-2ce9e71b5125"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:48:04.667074 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.667060    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-envoy\") pod \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\" (UID: \"b9bebf44-14c6-4d31-adaa-2ce9e71b5125\") "
Sep 11 16:48:04.667257 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.667104    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-data" (OuterVolumeSpecName: "istio-data") pod "b9bebf44-14c6-4d31-adaa-2ce9e71b5125" (UID: "b9bebf44-14c6-4d31-adaa-2ce9e71b5125"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:48:04.667353 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.667334    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b9bebf44-14c6-4d31-adaa-2ce9e71b5125" (UID: "b9bebf44-14c6-4d31-adaa-2ce9e71b5125"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:48:04.667423 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.667343    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-credential-socket\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:48:04.667423 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.667354    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b9bebf44-14c6-4d31-adaa-2ce9e71b5125" (UID: "b9bebf44-14c6-4d31-adaa-2ce9e71b5125"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:48:04.667423 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.667379    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-data\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:48:04.667578 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.667518    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b9bebf44-14c6-4d31-adaa-2ce9e71b5125" (UID: "b9bebf44-14c6-4d31-adaa-2ce9e71b5125"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:48:04.669154 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.669127    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b9bebf44-14c6-4d31-adaa-2ce9e71b5125" (UID: "b9bebf44-14c6-4d31-adaa-2ce9e71b5125"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 16:48:04.669261 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.669180    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-kube-api-access-zwqpb" (OuterVolumeSpecName: "kube-api-access-zwqpb") pod "b9bebf44-14c6-4d31-adaa-2ce9e71b5125" (UID: "b9bebf44-14c6-4d31-adaa-2ce9e71b5125"). InnerVolumeSpecName "kube-api-access-zwqpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:48:04.669261 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.669186    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-token" (OuterVolumeSpecName: "istio-token") pod "b9bebf44-14c6-4d31-adaa-2ce9e71b5125" (UID: "b9bebf44-14c6-4d31-adaa-2ce9e71b5125"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:48:04.669344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.669268    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b9bebf44-14c6-4d31-adaa-2ce9e71b5125" (UID: "b9bebf44-14c6-4d31-adaa-2ce9e71b5125"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:48:04.768506 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.768471    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-workload-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:48:04.768506 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.768499    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-envoy\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:48:04.768506 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.768507    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-token\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:48:04.768506 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.768515    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istio-podinfo\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:48:04.768801 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.768523    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-workload-socket\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:48:04.768801 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.768532    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-istiod-ca-cert\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:48:04.768801 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.768541    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwqpb\" (UniqueName: \"kubernetes.io/projected/b9bebf44-14c6-4d31-adaa-2ce9e71b5125-kube-api-access-zwqpb\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:48:04.976473 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.976438    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"]
Sep 11 16:48:04.984185 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:04.984157    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-4264bf-openshift-default-fc96c54cd-csjmf"]
Sep 11 16:48:06.946742 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:06.946709    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9bebf44-14c6-4d31-adaa-2ce9e71b5125" path="/var/lib/kubelet/pods/b9bebf44-14c6-4d31-adaa-2ce9e71b5125/volumes"
Sep 11 16:48:10.638180 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:10.638146    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-587a17-29819085-7srcr"]
Sep 11 16:48:10.646249 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:10.646217    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-587a17-29819085-7srcr"]
Sep 11 16:48:10.947012 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:10.946923    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a660c310-7ec1-4726-8984-5b3da9e94ada" path="/var/lib/kubelet/pods/a660c310-7ec1-4726-8984-5b3da9e94ada/volumes"
Sep 11 16:48:22.707310 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.707273    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"]
Sep 11 16:48:22.707900 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.707878    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a28e49e-fa6b-4034-8dbf-1cce490f47ee" containerName="main"
Sep 11 16:48:22.707900 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.707899    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a28e49e-fa6b-4034-8dbf-1cce490f47ee" containerName="main"
Sep 11 16:48:22.708032 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.707912    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b599286d-184b-4db1-8b88-dd782f726857" containerName="maas-api"
Sep 11 16:48:22.708032 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.707920    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b599286d-184b-4db1-8b88-dd782f726857" containerName="maas-api"
Sep 11 16:48:22.708032 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.707938    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f641af03-346a-47cb-b87a-e2d705a018ef" containerName="payload-processing"
Sep 11 16:48:22.708032 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.707948    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f641af03-346a-47cb-b87a-e2d705a018ef" containerName="payload-processing"
Sep 11 16:48:22.708032 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.707958    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9bebf44-14c6-4d31-adaa-2ce9e71b5125" containerName="istio-proxy"
Sep 11 16:48:22.708032 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.707967    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9bebf44-14c6-4d31-adaa-2ce9e71b5125" containerName="istio-proxy"
Sep 11 16:48:22.708032 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.707979    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74a4203d-3c62-4b23-88f4-f99c88456baa" containerName="payload-pre-processing"
Sep 11 16:48:22.708032 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.707990    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="74a4203d-3c62-4b23-88f4-f99c88456baa" containerName="payload-pre-processing"
Sep 11 16:48:22.708032 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.708000    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945" containerName="maas-api"
Sep 11 16:48:22.708032 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.708009    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945" containerName="maas-api"
Sep 11 16:48:22.708032 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.708022    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49b82d21-4909-459f-a3f2-32af12fa2040" containerName="payload-pre-processing"
Sep 11 16:48:22.708032 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.708030    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="49b82d21-4909-459f-a3f2-32af12fa2040" containerName="payload-pre-processing"
Sep 11 16:48:22.709158 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.708043    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9bebf44-14c6-4d31-adaa-2ce9e71b5125" containerName="istio-proxy"
Sep 11 16:48:22.709158 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.708052    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9bebf44-14c6-4d31-adaa-2ce9e71b5125" containerName="istio-proxy"
Sep 11 16:48:22.709158 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.708143    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="49b82d21-4909-459f-a3f2-32af12fa2040" containerName="payload-pre-processing"
Sep 11 16:48:22.709158 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.708159    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9bebf44-14c6-4d31-adaa-2ce9e71b5125" containerName="istio-proxy"
Sep 11 16:48:22.709158 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.708168    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f641af03-346a-47cb-b87a-e2d705a018ef" containerName="payload-processing"
Sep 11 16:48:22.709158 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.708175    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="74a4203d-3c62-4b23-88f4-f99c88456baa" containerName="payload-pre-processing"
Sep 11 16:48:22.709158 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.708185    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b599286d-184b-4db1-8b88-dd782f726857" containerName="maas-api"
Sep 11 16:48:22.709158 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.708193    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5f4ef0a-b22a-4ba0-bb64-01ad8fb69945" containerName="maas-api"
Sep 11 16:48:22.709158 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.708201    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a28e49e-fa6b-4034-8dbf-1cce490f47ee" containerName="main"
Sep 11 16:48:22.711873 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.711853    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.715345 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.715320    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-ff7416-openshift-default-dockercfg-c9xhv\""
Sep 11 16:48:22.753229 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.753193    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"]
Sep 11 16:48:22.831819 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.831781    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-token\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.831819 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.831819    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-workload-socket\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.832051 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.831847    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-podinfo\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.832051 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.831866    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-data\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.832051 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.831886    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-workload-certs\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.832051 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.831908    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-envoy\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.832051 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.831983    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-credential-socket\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.832051 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.832022    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istiod-ca-cert\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.832051 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.832048    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d92cl\" (UniqueName: \"kubernetes.io/projected/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-kube-api-access-d92cl\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.933162 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.933116    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-podinfo\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.933162 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.933165    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-data\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.933418 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.933193    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-workload-certs\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.933418 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.933230    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-envoy\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.933418 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.933288    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-credential-socket\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.933418 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.933312    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istiod-ca-cert\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.933418 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.933350    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d92cl\" (UniqueName: \"kubernetes.io/projected/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-kube-api-access-d92cl\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.933758 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.933421    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-token\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.933758 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.933453    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-workload-socket\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.933881 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.933750    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-workload-certs\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.933881 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.933770    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-data\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.933996 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.933898    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-credential-socket\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.933996 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.933927    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-workload-socket\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.934229 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.934205    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istiod-ca-cert\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.935652 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.935632    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-envoy\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.935791 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.935772    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-podinfo\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.950135 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.950108    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-token\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:22.952518 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:22.952493    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d92cl\" (UniqueName: \"kubernetes.io/projected/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-kube-api-access-d92cl\") pod \"e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") " pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:23.022236 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:23.022201    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:23.313540 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:23.313505    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"]
Sep 11 16:48:23.315322 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:48:23.315294    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fabd1a9_a7c5_4ae9_af94_21402b4fee77.slice/crio-4945a334652c2dd8ac8f6fb05ac673c878bcf62a2f703dcdc6cfb5c6ce093a6e WatchSource:0}: Error finding container 4945a334652c2dd8ac8f6fb05ac673c878bcf62a2f703dcdc6cfb5c6ce093a6e: Status 404 returned error can't find the container with id 4945a334652c2dd8ac8f6fb05ac673c878bcf62a2f703dcdc6cfb5c6ce093a6e
Sep 11 16:48:23.317384 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:23.317354    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:48:23.317437 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:23.317418    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:48:23.317476 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:23.317447    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:48:23.758273 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:23.758168    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6" event={"ID":"1fabd1a9-a7c5-4ae9-af94-21402b4fee77","Type":"ContainerStarted","Data":"3a47608138a5292aee64f16fa138e02a35169883bd4cea26bb63d3f8ba4b089f"}
Sep 11 16:48:23.758273 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:23.758233    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6" event={"ID":"1fabd1a9-a7c5-4ae9-af94-21402b4fee77","Type":"ContainerStarted","Data":"4945a334652c2dd8ac8f6fb05ac673c878bcf62a2f703dcdc6cfb5c6ce093a6e"}
Sep 11 16:48:23.835744 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:23.835694    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6" podStartSLOduration=1.835676033 podStartE2EDuration="1.835676033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:48:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:48:23.832676608 +0000 UTC m=+1123.450950781" watchObservedRunningTime="2026-09-11 16:48:23.835676033 +0000 UTC m=+1123.453950204"
Sep 11 16:48:24.022827 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:24.022787    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:24.024293 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:24.024263    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 11 16:48:24.024454 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:24.024362    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6" podUID="1fabd1a9-a7c5-4ae9-af94-21402b4fee77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 11 16:48:25.035880 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:25.035844    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:25.769783 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:25.769746    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:25.770691 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:25.770670    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:28.582903 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.582849    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw"]
Sep 11 16:48:28.583491 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.583455    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9bebf44-14c6-4d31-adaa-2ce9e71b5125" containerName="istio-proxy"
Sep 11 16:48:28.586948 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.586930    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw"
Sep 11 16:48:28.589836 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.589809    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-ff7416\""
Sep 11 16:48:28.589936 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.589820    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-ff7416-dockercfg-rztt9\""
Sep 11 16:48:28.592657 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.592633    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adafb380-7908-49d2-b5a2-c9fc5bb5947d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw\" (UID: \"adafb380-7908-49d2-b5a2-c9fc5bb5947d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw"
Sep 11 16:48:28.592760 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.592668    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4fvn\" (UniqueName: \"kubernetes.io/projected/adafb380-7908-49d2-b5a2-c9fc5bb5947d-kube-api-access-g4fvn\") pod \"payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw\" (UID: \"adafb380-7908-49d2-b5a2-c9fc5bb5947d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw"
Sep 11 16:48:28.600723 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.600697    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw"]
Sep 11 16:48:28.693735 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.693689    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adafb380-7908-49d2-b5a2-c9fc5bb5947d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw\" (UID: \"adafb380-7908-49d2-b5a2-c9fc5bb5947d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw"
Sep 11 16:48:28.693735 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.693739    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4fvn\" (UniqueName: \"kubernetes.io/projected/adafb380-7908-49d2-b5a2-c9fc5bb5947d-kube-api-access-g4fvn\") pod \"payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw\" (UID: \"adafb380-7908-49d2-b5a2-c9fc5bb5947d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw"
Sep 11 16:48:28.694385 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.694362    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adafb380-7908-49d2-b5a2-c9fc5bb5947d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw\" (UID: \"adafb380-7908-49d2-b5a2-c9fc5bb5947d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw"
Sep 11 16:48:28.712474 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.712436    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4fvn\" (UniqueName: \"kubernetes.io/projected/adafb380-7908-49d2-b5a2-c9fc5bb5947d-kube-api-access-g4fvn\") pod \"payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw\" (UID: \"adafb380-7908-49d2-b5a2-c9fc5bb5947d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw"
Sep 11 16:48:28.731234 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.731202    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc"]
Sep 11 16:48:28.734988 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.734966    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc"
Sep 11 16:48:28.763067 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.763033    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc"]
Sep 11 16:48:28.794475 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.794437    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d30a833c-af8a-4cc1-91b0-7e03823eeda1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc\" (UID: \"d30a833c-af8a-4cc1-91b0-7e03823eeda1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc"
Sep 11 16:48:28.794662 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.794487    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gdwb\" (UniqueName: \"kubernetes.io/projected/d30a833c-af8a-4cc1-91b0-7e03823eeda1-kube-api-access-7gdwb\") pod \"payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc\" (UID: \"d30a833c-af8a-4cc1-91b0-7e03823eeda1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc"
Sep 11 16:48:28.895214 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.895110    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d30a833c-af8a-4cc1-91b0-7e03823eeda1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc\" (UID: \"d30a833c-af8a-4cc1-91b0-7e03823eeda1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc"
Sep 11 16:48:28.895214 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.895165    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gdwb\" (UniqueName: \"kubernetes.io/projected/d30a833c-af8a-4cc1-91b0-7e03823eeda1-kube-api-access-7gdwb\") pod \"payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc\" (UID: \"d30a833c-af8a-4cc1-91b0-7e03823eeda1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc"
Sep 11 16:48:28.895920 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.895893    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d30a833c-af8a-4cc1-91b0-7e03823eeda1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc\" (UID: \"d30a833c-af8a-4cc1-91b0-7e03823eeda1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc"
Sep 11 16:48:28.897782 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.897764    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw"
Sep 11 16:48:28.918829 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:28.918801    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gdwb\" (UniqueName: \"kubernetes.io/projected/d30a833c-af8a-4cc1-91b0-7e03823eeda1-kube-api-access-7gdwb\") pod \"payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc\" (UID: \"d30a833c-af8a-4cc1-91b0-7e03823eeda1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc"
Sep 11 16:48:29.045504 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:29.045468    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc"
Sep 11 16:48:29.195063 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:29.195032    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw"]
Sep 11 16:48:29.195386 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:48:29.195363    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadafb380_7908_49d2_b5a2_c9fc5bb5947d.slice/crio-dede806522357e225884029b83ac391861ef6e2d304a8a380d3f1888002d4eb2 WatchSource:0}: Error finding container dede806522357e225884029b83ac391861ef6e2d304a8a380d3f1888002d4eb2: Status 404 returned error can't find the container with id dede806522357e225884029b83ac391861ef6e2d304a8a380d3f1888002d4eb2
Sep 11 16:48:29.331239 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:29.331204    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc"]
Sep 11 16:48:29.332755 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:48:29.332726    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd30a833c_af8a_4cc1_91b0_7e03823eeda1.slice/crio-c61d165aaf8ac89e990268344ca50604342399b2064b702256ad0f953b45792a WatchSource:0}: Error finding container c61d165aaf8ac89e990268344ca50604342399b2064b702256ad0f953b45792a: Status 404 returned error can't find the container with id c61d165aaf8ac89e990268344ca50604342399b2064b702256ad0f953b45792a
Sep 11 16:48:29.794301 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:29.794261    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw" event={"ID":"adafb380-7908-49d2-b5a2-c9fc5bb5947d","Type":"ContainerStarted","Data":"69777245a48cd0ae8981d2dbd4e3d8c2f56844fc4abc638ea4dc680d64e5ac4f"}
Sep 11 16:48:29.794808 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:29.794327    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw" event={"ID":"adafb380-7908-49d2-b5a2-c9fc5bb5947d","Type":"ContainerStarted","Data":"dede806522357e225884029b83ac391861ef6e2d304a8a380d3f1888002d4eb2"}
Sep 11 16:48:29.794808 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:29.794460    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw"
Sep 11 16:48:29.796189 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:29.796166    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc" event={"ID":"d30a833c-af8a-4cc1-91b0-7e03823eeda1","Type":"ContainerStarted","Data":"3e804ead985683bc70a6024b62586a10bbbebfb45be96ec7fa0fa0c11f6b72b6"}
Sep 11 16:48:29.796299 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:29.796204    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc" event={"ID":"d30a833c-af8a-4cc1-91b0-7e03823eeda1","Type":"ContainerStarted","Data":"c61d165aaf8ac89e990268344ca50604342399b2064b702256ad0f953b45792a"}
Sep 11 16:48:29.796299 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:29.796233    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc"
Sep 11 16:48:29.846768 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:29.846707    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw" podStartSLOduration=1.846683306 podStartE2EDuration="1.846683306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:48:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:48:29.845911328 +0000 UTC m=+1129.464185498" watchObservedRunningTime="2026-09-11 16:48:29.846683306 +0000 UTC m=+1129.464957476"
Sep 11 16:48:29.913344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:29.913287    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc" podStartSLOduration=1.913270311 podStartE2EDuration="1.913270311s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:48:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:48:29.912796931 +0000 UTC m=+1129.531071102" watchObservedRunningTime="2026-09-11 16:48:29.913270311 +0000 UTC m=+1129.531544487"
Sep 11 16:48:31.618417 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:31.618366    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s"]
Sep 11 16:48:31.622223 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:31.622195    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s"
Sep 11 16:48:31.625458 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:31.625433    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-347815\""
Sep 11 16:48:31.625592 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:31.625435    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-347815-dockercfg-nchq8\""
Sep 11 16:48:31.636193 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:31.636159    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s"]
Sep 11 16:48:31.719495 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:31.719456    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ae2957c-8148-4f85-8938-8c9035768da6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s\" (UID: \"5ae2957c-8148-4f85-8938-8c9035768da6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s"
Sep 11 16:48:31.719720 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:31.719701    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d2kj\" (UniqueName: \"kubernetes.io/projected/5ae2957c-8148-4f85-8938-8c9035768da6-kube-api-access-5d2kj\") pod \"payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s\" (UID: \"5ae2957c-8148-4f85-8938-8c9035768da6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s"
Sep 11 16:48:31.820386 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:31.820345    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ae2957c-8148-4f85-8938-8c9035768da6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s\" (UID: \"5ae2957c-8148-4f85-8938-8c9035768da6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s"
Sep 11 16:48:31.820590 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:31.820485    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d2kj\" (UniqueName: \"kubernetes.io/projected/5ae2957c-8148-4f85-8938-8c9035768da6-kube-api-access-5d2kj\") pod \"payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s\" (UID: \"5ae2957c-8148-4f85-8938-8c9035768da6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s"
Sep 11 16:48:31.821090 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:31.821067    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ae2957c-8148-4f85-8938-8c9035768da6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s\" (UID: \"5ae2957c-8148-4f85-8938-8c9035768da6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s"
Sep 11 16:48:31.833118 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:31.833084    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d2kj\" (UniqueName: \"kubernetes.io/projected/5ae2957c-8148-4f85-8938-8c9035768da6-kube-api-access-5d2kj\") pod \"payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s\" (UID: \"5ae2957c-8148-4f85-8938-8c9035768da6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s"
Sep 11 16:48:31.934549 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:31.934444    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s"
Sep 11 16:48:32.221666 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:32.221590    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s"]
Sep 11 16:48:32.222058 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:48:32.222034    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae2957c_8148_4f85_8938_8c9035768da6.slice/crio-adf7bb5066378bea7183ce8748b42ccb430c15679c356cea924415e2ef7d2178 WatchSource:0}: Error finding container adf7bb5066378bea7183ce8748b42ccb430c15679c356cea924415e2ef7d2178: Status 404 returned error can't find the container with id adf7bb5066378bea7183ce8748b42ccb430c15679c356cea924415e2ef7d2178
Sep 11 16:48:32.815061 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:32.815022    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s" event={"ID":"5ae2957c-8148-4f85-8938-8c9035768da6","Type":"ContainerStarted","Data":"7cd2f9316ec64c5f74546a7cbf0a8b2962595b675358f0d7ea962a5accc95a06"}
Sep 11 16:48:32.815501 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:32.815084    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s" event={"ID":"5ae2957c-8148-4f85-8938-8c9035768da6","Type":"ContainerStarted","Data":"adf7bb5066378bea7183ce8748b42ccb430c15679c356cea924415e2ef7d2178"}
Sep 11 16:48:32.815501 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:32.815124    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s"
Sep 11 16:48:32.837521 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:32.837457    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s" podStartSLOduration=1.837437303 podStartE2EDuration="1.837437303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:48:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:48:32.835382197 +0000 UTC m=+1132.453656368" watchObservedRunningTime="2026-09-11 16:48:32.837437303 +0000 UTC m=+1132.455711474"
Sep 11 16:48:40.804734 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:40.804702    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc"
Sep 11 16:48:40.805190 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:40.804775    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw"
Sep 11 16:48:41.297158 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:41.296566    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": read tcp 10.132.0.2:38126->10.132.0.65:15021: read: connection reset by peer" start-of-body=
Sep 11 16:48:41.297158 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:41.296670    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6" podUID="1fabd1a9-a7c5-4ae9-af94-21402b4fee77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": read tcp 10.132.0.2:38126->10.132.0.65:15021: read: connection reset by peer"
Sep 11 16:48:41.880723 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:41.880686    2557 generic.go:356] "Generic (PLEG): container finished" podID="1fabd1a9-a7c5-4ae9-af94-21402b4fee77" containerID="3a47608138a5292aee64f16fa138e02a35169883bd4cea26bb63d3f8ba4b089f" exitCode=0
Sep 11 16:48:41.881108 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:41.880737    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6" event={"ID":"1fabd1a9-a7c5-4ae9-af94-21402b4fee77","Type":"ContainerDied","Data":"3a47608138a5292aee64f16fa138e02a35169883bd4cea26bb63d3f8ba4b089f"}
Sep 11 16:48:41.881152 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:41.881113    2557 scope.go:117] "RemoveContainer" containerID="3a47608138a5292aee64f16fa138e02a35169883bd4cea26bb63d3f8ba4b089f"
Sep 11 16:48:41.882185 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:41.882153    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:48:41.882242 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:41.882224    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:48:41.882278 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:41.882255    2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 16:48:42.889917 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:42.889881    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6" event={"ID":"1fabd1a9-a7c5-4ae9-af94-21402b4fee77","Type":"ContainerStarted","Data":"732a290f4a0d40ff1630c4bc5fc821c4b3898723465fd4685733331f5a8143fa"}
Sep 11 16:48:43.022939 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:43.022903    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:43.023219 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:43.023189    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 11 16:48:43.023270 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:43.023246    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6" podUID="1fabd1a9-a7c5-4ae9-af94-21402b4fee77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 11 16:48:43.823140 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:43.823106    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s"
Sep 11 16:48:44.023339 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:44.023299    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 11 16:48:44.023752 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:44.023356    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6" podUID="1fabd1a9-a7c5-4ae9-af94-21402b4fee77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 11 16:48:45.023500 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:45.023458    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 11 16:48:45.023949 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:45.023521    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6" podUID="1fabd1a9-a7c5-4ae9-af94-21402b4fee77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 11 16:48:46.023581 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:46.023535    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 11 16:48:46.024070 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:46.023627    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6" podUID="1fabd1a9-a7c5-4ae9-af94-21402b4fee77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 11 16:48:47.022909 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:47.022862    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 11 16:48:47.023105 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:47.022936    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6" podUID="1fabd1a9-a7c5-4ae9-af94-21402b4fee77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 11 16:48:48.023544 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:48.023505    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 11 16:48:48.023976 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:48.023566    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6" podUID="1fabd1a9-a7c5-4ae9-af94-21402b4fee77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 11 16:48:49.026058 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:49.026022    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:49.026543 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:49.026412    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:48:49.027197 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:48:49.027174    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 16:49:01.226886 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:01.226850    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"]
Sep 11 16:49:01.230821 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:01.230796    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"
Sep 11 16:49:01.234166 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:01.234142    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-ce902a-serving-cert\""
Sep 11 16:49:01.252334 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:01.252304    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"]
Sep 11 16:49:01.324747 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:01.324710    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knzl7\" (UniqueName: \"kubernetes.io/projected/6d4ab71e-5ae6-47bd-a936-459584037f85-kube-api-access-knzl7\") pod \"maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq\" (UID: \"6d4ab71e-5ae6-47bd-a936-459584037f85\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"
Sep 11 16:49:01.324747 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:01.324752    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d4ab71e-5ae6-47bd-a936-459584037f85-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq\" (UID: \"6d4ab71e-5ae6-47bd-a936-459584037f85\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"
Sep 11 16:49:01.324990 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:01.324774    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d4ab71e-5ae6-47bd-a936-459584037f85-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq\" (UID: \"6d4ab71e-5ae6-47bd-a936-459584037f85\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"
Sep 11 16:49:01.324990 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:01.324880    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4ab71e-5ae6-47bd-a936-459584037f85-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq\" (UID: \"6d4ab71e-5ae6-47bd-a936-459584037f85\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"
Sep 11 16:49:01.425664 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:01.425601    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knzl7\" (UniqueName: \"kubernetes.io/projected/6d4ab71e-5ae6-47bd-a936-459584037f85-kube-api-access-knzl7\") pod \"maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq\" (UID: \"6d4ab71e-5ae6-47bd-a936-459584037f85\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"
Sep 11 16:49:01.425664 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:01.425666    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d4ab71e-5ae6-47bd-a936-459584037f85-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq\" (UID: \"6d4ab71e-5ae6-47bd-a936-459584037f85\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"
Sep 11 16:49:01.425896 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:01.425687    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d4ab71e-5ae6-47bd-a936-459584037f85-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq\" (UID: \"6d4ab71e-5ae6-47bd-a936-459584037f85\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"
Sep 11 16:49:01.425896 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:01.425725    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4ab71e-5ae6-47bd-a936-459584037f85-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq\" (UID: \"6d4ab71e-5ae6-47bd-a936-459584037f85\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"
Sep 11 16:49:01.425896 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:49:01.425823    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-serving-cert: secret "maas-api-e2e-shared-b-w3-ce902a-serving-cert" not found
Sep 11 16:49:01.425896 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:49:01.425893    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d4ab71e-5ae6-47bd-a936-459584037f85-maas-api-tls podName:6d4ab71e-5ae6-47bd-a936-459584037f85 nodeName:}" failed. No retries permitted until 2026-09-11 16:49:01.925873219 +0000 UTC m=+1161.544147381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6d4ab71e-5ae6-47bd-a936-459584037f85-maas-api-tls") pod "maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq" (UID: "6d4ab71e-5ae6-47bd-a936-459584037f85") : secret "maas-api-e2e-shared-b-w3-ce902a-serving-cert" not found
Sep 11 16:49:01.426361 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:01.426332    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d4ab71e-5ae6-47bd-a936-459584037f85-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq\" (UID: \"6d4ab71e-5ae6-47bd-a936-459584037f85\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"
Sep 11 16:49:01.428284 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:01.428263    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4ab71e-5ae6-47bd-a936-459584037f85-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq\" (UID: \"6d4ab71e-5ae6-47bd-a936-459584037f85\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"
Sep 11 16:49:01.440003 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:01.439971    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knzl7\" (UniqueName: \"kubernetes.io/projected/6d4ab71e-5ae6-47bd-a936-459584037f85-kube-api-access-knzl7\") pod \"maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq\" (UID: \"6d4ab71e-5ae6-47bd-a936-459584037f85\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"
Sep 11 16:49:01.930307 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:01.930262    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d4ab71e-5ae6-47bd-a936-459584037f85-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq\" (UID: \"6d4ab71e-5ae6-47bd-a936-459584037f85\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"
Sep 11 16:49:01.932656 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:01.932630    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d4ab71e-5ae6-47bd-a936-459584037f85-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq\" (UID: \"6d4ab71e-5ae6-47bd-a936-459584037f85\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"
Sep 11 16:49:02.142090 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:02.142043    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"
Sep 11 16:49:02.434389 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:02.434357    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"]
Sep 11 16:49:02.434782 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:49:02.434759    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d4ab71e_5ae6_47bd_a936_459584037f85.slice/crio-bca34d332467184425f6718984e672f38875d93051d89ca24c0a5b603e7dd963 WatchSource:0}: Error finding container bca34d332467184425f6718984e672f38875d93051d89ca24c0a5b603e7dd963: Status 404 returned error can't find the container with id bca34d332467184425f6718984e672f38875d93051d89ca24c0a5b603e7dd963
Sep 11 16:49:03.004484 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:03.004401    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq" event={"ID":"6d4ab71e-5ae6-47bd-a936-459584037f85","Type":"ContainerStarted","Data":"45bd2c1e62172467b211779d3f8c9a173c0b8889cee4831e004fd2725343f64e"}
Sep 11 16:49:03.004484 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:03.004467    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq" event={"ID":"6d4ab71e-5ae6-47bd-a936-459584037f85","Type":"ContainerStarted","Data":"bca34d332467184425f6718984e672f38875d93051d89ca24c0a5b603e7dd963"}
Sep 11 16:49:03.004725 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:03.004632    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"
Sep 11 16:49:03.035885 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:03.035767    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq" podStartSLOduration=1.7009080829999998 podStartE2EDuration="2.035747867s" totalImagesPullingTime="334.839784ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:49:03.032785135 +0000 UTC m=+1162.651059317" watchObservedRunningTime="2026-09-11 16:49:03.035747867 +0000 UTC m=+1162.654022057"
Sep 11 16:49:03.800989 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:03.800952    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"]
Sep 11 16:49:03.804643 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:03.804621    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"
Sep 11 16:49:03.814448 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:03.814423    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-3e9c29-serving-cert\""
Sep 11 16:49:03.832134 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:03.832103    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"]
Sep 11 16:49:03.953055 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:03.953016    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae4f1a1b-1432-41bb-877a-2e529e47c054-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw\" (UID: \"ae4f1a1b-1432-41bb-877a-2e529e47c054\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"
Sep 11 16:49:03.953226 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:03.953117    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae4f1a1b-1432-41bb-877a-2e529e47c054-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw\" (UID: \"ae4f1a1b-1432-41bb-877a-2e529e47c054\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"
Sep 11 16:49:03.953226 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:03.953136    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h87dq\" (UniqueName: \"kubernetes.io/projected/ae4f1a1b-1432-41bb-877a-2e529e47c054-kube-api-access-h87dq\") pod \"maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw\" (UID: \"ae4f1a1b-1432-41bb-877a-2e529e47c054\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"
Sep 11 16:49:03.953226 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:03.953198    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae4f1a1b-1432-41bb-877a-2e529e47c054-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw\" (UID: \"ae4f1a1b-1432-41bb-877a-2e529e47c054\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"
Sep 11 16:49:04.054147 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:04.054048    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae4f1a1b-1432-41bb-877a-2e529e47c054-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw\" (UID: \"ae4f1a1b-1432-41bb-877a-2e529e47c054\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"
Sep 11 16:49:04.054147 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:04.054135    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae4f1a1b-1432-41bb-877a-2e529e47c054-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw\" (UID: \"ae4f1a1b-1432-41bb-877a-2e529e47c054\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"
Sep 11 16:49:04.054390 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:04.054162    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h87dq\" (UniqueName: \"kubernetes.io/projected/ae4f1a1b-1432-41bb-877a-2e529e47c054-kube-api-access-h87dq\") pod \"maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw\" (UID: \"ae4f1a1b-1432-41bb-877a-2e529e47c054\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"
Sep 11 16:49:04.054390 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:04.054185    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae4f1a1b-1432-41bb-877a-2e529e47c054-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw\" (UID: \"ae4f1a1b-1432-41bb-877a-2e529e47c054\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"
Sep 11 16:49:04.054909 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:04.054882    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae4f1a1b-1432-41bb-877a-2e529e47c054-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw\" (UID: \"ae4f1a1b-1432-41bb-877a-2e529e47c054\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"
Sep 11 16:49:04.056520 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:04.056495    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae4f1a1b-1432-41bb-877a-2e529e47c054-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw\" (UID: \"ae4f1a1b-1432-41bb-877a-2e529e47c054\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"
Sep 11 16:49:04.056636 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:04.056601    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae4f1a1b-1432-41bb-877a-2e529e47c054-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw\" (UID: \"ae4f1a1b-1432-41bb-877a-2e529e47c054\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"
Sep 11 16:49:04.074164 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:04.074136    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h87dq\" (UniqueName: \"kubernetes.io/projected/ae4f1a1b-1432-41bb-877a-2e529e47c054-kube-api-access-h87dq\") pod \"maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw\" (UID: \"ae4f1a1b-1432-41bb-877a-2e529e47c054\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"
Sep 11 16:49:04.115047 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:04.115005    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"
Sep 11 16:49:04.492238 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:04.492200    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"]
Sep 11 16:49:04.492974 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:49:04.492945    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4f1a1b_1432_41bb_877a_2e529e47c054.slice/crio-552aecfb50c5fa7a3166888b0fef73c9d421e7cf9216ffb01fbb7bc04f6ae2f8 WatchSource:0}: Error finding container 552aecfb50c5fa7a3166888b0fef73c9d421e7cf9216ffb01fbb7bc04f6ae2f8: Status 404 returned error can't find the container with id 552aecfb50c5fa7a3166888b0fef73c9d421e7cf9216ffb01fbb7bc04f6ae2f8
Sep 11 16:49:04.983386 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:04.983344    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb"]
Sep 11 16:49:04.987042 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:04.987019    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb"
Sep 11 16:49:04.990648 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:04.990622    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-3e9c29-dockercfg-6qkdf\""
Sep 11 16:49:04.990789 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:04.990720    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-3e9c29\""
Sep 11 16:49:05.006630 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:05.006575    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb"]
Sep 11 16:49:05.019585 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:05.019549    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw" event={"ID":"ae4f1a1b-1432-41bb-877a-2e529e47c054","Type":"ContainerStarted","Data":"0184c8e518fe94f3d31000df5be430bd0390286b60e124f692f07be3f8eb3bae"}
Sep 11 16:49:05.019774 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:05.019627    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw" event={"ID":"ae4f1a1b-1432-41bb-877a-2e529e47c054","Type":"ContainerStarted","Data":"552aecfb50c5fa7a3166888b0fef73c9d421e7cf9216ffb01fbb7bc04f6ae2f8"}
Sep 11 16:49:05.019774 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:05.019660    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"
Sep 11 16:49:05.062431 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:05.062343    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7098ec9b-20b5-4b72-9316-3f4ed4fc6f50-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb\" (UID: \"7098ec9b-20b5-4b72-9316-3f4ed4fc6f50\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb"
Sep 11 16:49:05.062810 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:05.062756    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw" podStartSLOduration=1.78152249 podStartE2EDuration="2.062737156s" totalImagesPullingTime="281.214666ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:49:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:49:05.057457426 +0000 UTC m=+1164.675731602" watchObservedRunningTime="2026-09-11 16:49:05.062737156 +0000 UTC m=+1164.681011326"
Sep 11 16:49:05.062991 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:05.062969    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zwcw\" (UniqueName: \"kubernetes.io/projected/7098ec9b-20b5-4b72-9316-3f4ed4fc6f50-kube-api-access-2zwcw\") pod \"payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb\" (UID: \"7098ec9b-20b5-4b72-9316-3f4ed4fc6f50\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb"
Sep 11 16:49:05.164387 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:05.164331    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zwcw\" (UniqueName: \"kubernetes.io/projected/7098ec9b-20b5-4b72-9316-3f4ed4fc6f50-kube-api-access-2zwcw\") pod \"payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb\" (UID: \"7098ec9b-20b5-4b72-9316-3f4ed4fc6f50\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb"
Sep 11 16:49:05.164573 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:05.164454    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7098ec9b-20b5-4b72-9316-3f4ed4fc6f50-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb\" (UID: \"7098ec9b-20b5-4b72-9316-3f4ed4fc6f50\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb"
Sep 11 16:49:05.165500 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:05.165470    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7098ec9b-20b5-4b72-9316-3f4ed4fc6f50-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb\" (UID: \"7098ec9b-20b5-4b72-9316-3f4ed4fc6f50\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb"
Sep 11 16:49:05.175461 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:05.175427    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zwcw\" (UniqueName: \"kubernetes.io/projected/7098ec9b-20b5-4b72-9316-3f4ed4fc6f50-kube-api-access-2zwcw\") pod \"payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb\" (UID: \"7098ec9b-20b5-4b72-9316-3f4ed4fc6f50\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb"
Sep 11 16:49:05.299104 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:05.299065    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb"
Sep 11 16:49:05.577322 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:05.577290    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb"]
Sep 11 16:49:05.578019 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:49:05.577988    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7098ec9b_20b5_4b72_9316_3f4ed4fc6f50.slice/crio-8dc9146400813667af2a95b675f92a0af30f64e8a63266f767d763056e1f3eb9 WatchSource:0}: Error finding container 8dc9146400813667af2a95b675f92a0af30f64e8a63266f767d763056e1f3eb9: Status 404 returned error can't find the container with id 8dc9146400813667af2a95b675f92a0af30f64e8a63266f767d763056e1f3eb9
Sep 11 16:49:06.028406 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:06.028364    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb" event={"ID":"7098ec9b-20b5-4b72-9316-3f4ed4fc6f50","Type":"ContainerStarted","Data":"839eb1636d9e96c7953daffe5609259d922c37c5936c2ee80898e6374ce41eb7"}
Sep 11 16:49:06.028893 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:06.028427    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb" event={"ID":"7098ec9b-20b5-4b72-9316-3f4ed4fc6f50","Type":"ContainerStarted","Data":"8dc9146400813667af2a95b675f92a0af30f64e8a63266f767d763056e1f3eb9"}
Sep 11 16:49:06.028893 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:06.028623    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb"
Sep 11 16:49:06.052149 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:06.052084    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb" podStartSLOduration=2.052062915 podStartE2EDuration="2.052062915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:49:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:49:06.047686314 +0000 UTC m=+1165.665960485" watchObservedRunningTime="2026-09-11 16:49:06.052062915 +0000 UTC m=+1165.670337085"
Sep 11 16:49:09.017123 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:09.017093    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"
Sep 11 16:49:11.033910 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:11.033878    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"
Sep 11 16:49:17.036297 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:17.036260    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb"
Sep 11 16:49:41.920347 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:41.920310    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"]
Sep 11 16:49:41.924105 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:41.924079    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"
Sep 11 16:49:41.926983 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:41.926957    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-3bf678c7-serving-cert\""
Sep 11 16:49:41.939090 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:41.939066    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"]
Sep 11 16:49:42.018564 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:42.018520    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14b85268-e7cd-4c42-a90a-426dd3838c9a-openshift-service-ca\") pod \"maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86\" (UID: \"14b85268-e7cd-4c42-a90a-426dd3838c9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"
Sep 11 16:49:42.018564 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:42.018570    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14b85268-e7cd-4c42-a90a-426dd3838c9a-metrics-certs\") pod \"maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86\" (UID: \"14b85268-e7cd-4c42-a90a-426dd3838c9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"
Sep 11 16:49:42.018864 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:42.018707    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14b85268-e7cd-4c42-a90a-426dd3838c9a-maas-api-tls\") pod \"maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86\" (UID: \"14b85268-e7cd-4c42-a90a-426dd3838c9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"
Sep 11 16:49:42.018864 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:42.018768    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlhgs\" (UniqueName: \"kubernetes.io/projected/14b85268-e7cd-4c42-a90a-426dd3838c9a-kube-api-access-dlhgs\") pod \"maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86\" (UID: \"14b85268-e7cd-4c42-a90a-426dd3838c9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"
Sep 11 16:49:42.120036 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:42.119999    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14b85268-e7cd-4c42-a90a-426dd3838c9a-openshift-service-ca\") pod \"maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86\" (UID: \"14b85268-e7cd-4c42-a90a-426dd3838c9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"
Sep 11 16:49:42.120036 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:42.120041    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14b85268-e7cd-4c42-a90a-426dd3838c9a-metrics-certs\") pod \"maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86\" (UID: \"14b85268-e7cd-4c42-a90a-426dd3838c9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"
Sep 11 16:49:42.120256 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:42.120068    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14b85268-e7cd-4c42-a90a-426dd3838c9a-maas-api-tls\") pod \"maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86\" (UID: \"14b85268-e7cd-4c42-a90a-426dd3838c9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"
Sep 11 16:49:42.120256 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:42.120122    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlhgs\" (UniqueName: \"kubernetes.io/projected/14b85268-e7cd-4c42-a90a-426dd3838c9a-kube-api-access-dlhgs\") pod \"maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86\" (UID: \"14b85268-e7cd-4c42-a90a-426dd3838c9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"
Sep 11 16:49:42.120256 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:49:42.120166    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-serving-cert: secret "maas-api-e2e-mt-3bf678c7-serving-cert" not found
Sep 11 16:49:42.120256 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:49:42.120233    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b85268-e7cd-4c42-a90a-426dd3838c9a-maas-api-tls podName:14b85268-e7cd-4c42-a90a-426dd3838c9a nodeName:}" failed. No retries permitted until 2026-09-11 16:49:42.620211409 +0000 UTC m=+1202.238485558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/14b85268-e7cd-4c42-a90a-426dd3838c9a-maas-api-tls") pod "maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86" (UID: "14b85268-e7cd-4c42-a90a-426dd3838c9a") : secret "maas-api-e2e-mt-3bf678c7-serving-cert" not found
Sep 11 16:49:42.120887 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:42.120859    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14b85268-e7cd-4c42-a90a-426dd3838c9a-openshift-service-ca\") pod \"maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86\" (UID: \"14b85268-e7cd-4c42-a90a-426dd3838c9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"
Sep 11 16:49:42.122377 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:42.122352    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14b85268-e7cd-4c42-a90a-426dd3838c9a-metrics-certs\") pod \"maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86\" (UID: \"14b85268-e7cd-4c42-a90a-426dd3838c9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"
Sep 11 16:49:42.141081 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:42.141047    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlhgs\" (UniqueName: \"kubernetes.io/projected/14b85268-e7cd-4c42-a90a-426dd3838c9a-kube-api-access-dlhgs\") pod \"maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86\" (UID: \"14b85268-e7cd-4c42-a90a-426dd3838c9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"
Sep 11 16:49:42.623647 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:42.623582    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14b85268-e7cd-4c42-a90a-426dd3838c9a-maas-api-tls\") pod \"maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86\" (UID: \"14b85268-e7cd-4c42-a90a-426dd3838c9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"
Sep 11 16:49:42.626011 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:42.625979    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14b85268-e7cd-4c42-a90a-426dd3838c9a-maas-api-tls\") pod \"maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86\" (UID: \"14b85268-e7cd-4c42-a90a-426dd3838c9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"
Sep 11 16:49:42.834871 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:42.834837    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"
Sep 11 16:49:43.089893 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:43.089855    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s"]
Sep 11 16:49:43.094697 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:43.094674    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s"
Sep 11 16:49:43.098843 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:43.098820    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-3bf678c7-dockercfg-vfgqt\""
Sep 11 16:49:43.099205 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:43.099184    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-3bf678c7\""
Sep 11 16:49:43.124952 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:43.124908    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s"]
Sep 11 16:49:43.139213 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:49:43.139184    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14b85268_e7cd_4c42_a90a_426dd3838c9a.slice/crio-a4420127ecdef42f1c9541f94020dcb5ae186f89c89293753647635f7e1804e6 WatchSource:0}: Error finding container a4420127ecdef42f1c9541f94020dcb5ae186f89c89293753647635f7e1804e6: Status 404 returned error can't find the container with id a4420127ecdef42f1c9541f94020dcb5ae186f89c89293753647635f7e1804e6
Sep 11 16:49:43.139391 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:43.139370    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"]
Sep 11 16:49:43.229878 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:43.229833    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93572506-a353-4d79-a283-2a61dc8d2f38-plugins-config-volume\") pod \"payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s\" (UID: \"93572506-a353-4d79-a283-2a61dc8d2f38\") " pod="openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s"
Sep 11 16:49:43.230065 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:43.229887    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp5mx\" (UniqueName: \"kubernetes.io/projected/93572506-a353-4d79-a283-2a61dc8d2f38-kube-api-access-lp5mx\") pod \"payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s\" (UID: \"93572506-a353-4d79-a283-2a61dc8d2f38\") " pod="openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s"
Sep 11 16:49:43.249694 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:43.249651    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86" event={"ID":"14b85268-e7cd-4c42-a90a-426dd3838c9a","Type":"ContainerStarted","Data":"a4420127ecdef42f1c9541f94020dcb5ae186f89c89293753647635f7e1804e6"}
Sep 11 16:49:43.330984 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:43.330940    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93572506-a353-4d79-a283-2a61dc8d2f38-plugins-config-volume\") pod \"payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s\" (UID: \"93572506-a353-4d79-a283-2a61dc8d2f38\") " pod="openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s"
Sep 11 16:49:43.331190 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:43.331024    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp5mx\" (UniqueName: \"kubernetes.io/projected/93572506-a353-4d79-a283-2a61dc8d2f38-kube-api-access-lp5mx\") pod \"payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s\" (UID: \"93572506-a353-4d79-a283-2a61dc8d2f38\") " pod="openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s"
Sep 11 16:49:43.331809 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:43.331785    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93572506-a353-4d79-a283-2a61dc8d2f38-plugins-config-volume\") pod \"payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s\" (UID: \"93572506-a353-4d79-a283-2a61dc8d2f38\") " pod="openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s"
Sep 11 16:49:43.345718 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:43.345693    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp5mx\" (UniqueName: \"kubernetes.io/projected/93572506-a353-4d79-a283-2a61dc8d2f38-kube-api-access-lp5mx\") pod \"payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s\" (UID: \"93572506-a353-4d79-a283-2a61dc8d2f38\") " pod="openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s"
Sep 11 16:49:43.406072 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:43.405978    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s"
Sep 11 16:49:43.707531 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:43.707444    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s"]
Sep 11 16:49:43.710598 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:49:43.710571    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93572506_a353_4d79_a283_2a61dc8d2f38.slice/crio-13b4366e5d5b25d8396349e3f8decc4acd199fc3e1638419e4a77a1ad7a93079 WatchSource:0}: Error finding container 13b4366e5d5b25d8396349e3f8decc4acd199fc3e1638419e4a77a1ad7a93079: Status 404 returned error can't find the container with id 13b4366e5d5b25d8396349e3f8decc4acd199fc3e1638419e4a77a1ad7a93079
Sep 11 16:49:44.258787 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:44.258751    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86" event={"ID":"14b85268-e7cd-4c42-a90a-426dd3838c9a","Type":"ContainerStarted","Data":"83a4c1ece0b95e962ab68fdac052d177916ff56927a2aac41d0365a9c93fc5cc"}
Sep 11 16:49:44.259254 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:44.258878    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"
Sep 11 16:49:44.260542 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:44.260513    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s" event={"ID":"93572506-a353-4d79-a283-2a61dc8d2f38","Type":"ContainerStarted","Data":"9a53babaab56f437ad048e8dac150e766396ec018f03438819ae621751270b8f"}
Sep 11 16:49:44.260697 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:44.260594    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s" event={"ID":"93572506-a353-4d79-a283-2a61dc8d2f38","Type":"ContainerStarted","Data":"13b4366e5d5b25d8396349e3f8decc4acd199fc3e1638419e4a77a1ad7a93079"}
Sep 11 16:49:44.260697 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:44.260649    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s"
Sep 11 16:49:44.283084 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:44.283028    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86" podStartSLOduration=2.887864527 podStartE2EDuration="3.28300868s" totalImagesPullingTime="395.144153ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:49:44.28257943 +0000 UTC m=+1203.900853610" watchObservedRunningTime="2026-09-11 16:49:44.28300868 +0000 UTC m=+1203.901282852"
Sep 11 16:49:44.310566 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:44.310511    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s" podStartSLOduration=1.310494391 podStartE2EDuration="1.310494391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:49:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:49:44.308837746 +0000 UTC m=+1203.927111918" watchObservedRunningTime="2026-09-11 16:49:44.310494391 +0000 UTC m=+1203.928768559"
Sep 11 16:49:50.272508 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:50.272475    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"
Sep 11 16:49:55.268802 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:49:55.268762    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s"
Sep 11 16:50:55.530720 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:55.530632    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"]
Sep 11 16:50:55.595088 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:55.595051    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s"]
Sep 11 16:50:55.595327 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:55.595282    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s" podUID="93572506-a353-4d79-a283-2a61dc8d2f38" containerName="payload-processing" containerID="cri-o://9a53babaab56f437ad048e8dac150e766396ec018f03438819ae621751270b8f" gracePeriod=30
Sep 11 16:50:55.680261 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:55.680216    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86" podUID="14b85268-e7cd-4c42-a90a-426dd3838c9a" containerName="maas-api" containerID="cri-o://83a4c1ece0b95e962ab68fdac052d177916ff56927a2aac41d0365a9c93fc5cc" gracePeriod=30
Sep 11 16:50:55.936403 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:55.936376    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s"
Sep 11 16:50:55.975463 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:55.975438    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"
Sep 11 16:50:56.020238 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.020201    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93572506-a353-4d79-a283-2a61dc8d2f38-plugins-config-volume\") pod \"93572506-a353-4d79-a283-2a61dc8d2f38\" (UID: \"93572506-a353-4d79-a283-2a61dc8d2f38\") "
Sep 11 16:50:56.020238 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.020239    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lp5mx\" (UniqueName: \"kubernetes.io/projected/93572506-a353-4d79-a283-2a61dc8d2f38-kube-api-access-lp5mx\") pod \"93572506-a353-4d79-a283-2a61dc8d2f38\" (UID: \"93572506-a353-4d79-a283-2a61dc8d2f38\") "
Sep 11 16:50:56.020502 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.020331    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14b85268-e7cd-4c42-a90a-426dd3838c9a-metrics-certs\") pod \"14b85268-e7cd-4c42-a90a-426dd3838c9a\" (UID: \"14b85268-e7cd-4c42-a90a-426dd3838c9a\") "
Sep 11 16:50:56.020502 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.020359    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14b85268-e7cd-4c42-a90a-426dd3838c9a-openshift-service-ca\") pod \"14b85268-e7cd-4c42-a90a-426dd3838c9a\" (UID: \"14b85268-e7cd-4c42-a90a-426dd3838c9a\") "
Sep 11 16:50:56.020502 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.020376    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14b85268-e7cd-4c42-a90a-426dd3838c9a-maas-api-tls\") pod \"14b85268-e7cd-4c42-a90a-426dd3838c9a\" (UID: \"14b85268-e7cd-4c42-a90a-426dd3838c9a\") "
Sep 11 16:50:56.020502 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.020399    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlhgs\" (UniqueName: \"kubernetes.io/projected/14b85268-e7cd-4c42-a90a-426dd3838c9a-kube-api-access-dlhgs\") pod \"14b85268-e7cd-4c42-a90a-426dd3838c9a\" (UID: \"14b85268-e7cd-4c42-a90a-426dd3838c9a\") "
Sep 11 16:50:56.020866 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.020832    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14b85268-e7cd-4c42-a90a-426dd3838c9a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "14b85268-e7cd-4c42-a90a-426dd3838c9a" (UID: "14b85268-e7cd-4c42-a90a-426dd3838c9a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:50:56.021206 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.021179    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93572506-a353-4d79-a283-2a61dc8d2f38-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "93572506-a353-4d79-a283-2a61dc8d2f38" (UID: "93572506-a353-4d79-a283-2a61dc8d2f38"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:50:56.023160 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.023131    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14b85268-e7cd-4c42-a90a-426dd3838c9a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "14b85268-e7cd-4c42-a90a-426dd3838c9a" (UID: "14b85268-e7cd-4c42-a90a-426dd3838c9a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:50:56.023271 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.023247    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93572506-a353-4d79-a283-2a61dc8d2f38-kube-api-access-lp5mx" (OuterVolumeSpecName: "kube-api-access-lp5mx") pod "93572506-a353-4d79-a283-2a61dc8d2f38" (UID: "93572506-a353-4d79-a283-2a61dc8d2f38"). InnerVolumeSpecName "kube-api-access-lp5mx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:50:56.023335 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.023277    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14b85268-e7cd-4c42-a90a-426dd3838c9a-kube-api-access-dlhgs" (OuterVolumeSpecName: "kube-api-access-dlhgs") pod "14b85268-e7cd-4c42-a90a-426dd3838c9a" (UID: "14b85268-e7cd-4c42-a90a-426dd3838c9a"). InnerVolumeSpecName "kube-api-access-dlhgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:50:56.023452 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.023424    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14b85268-e7cd-4c42-a90a-426dd3838c9a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "14b85268-e7cd-4c42-a90a-426dd3838c9a" (UID: "14b85268-e7cd-4c42-a90a-426dd3838c9a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:50:56.122364 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.122268    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14b85268-e7cd-4c42-a90a-426dd3838c9a-metrics-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:50:56.122364 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.122301    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14b85268-e7cd-4c42-a90a-426dd3838c9a-openshift-service-ca\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:50:56.122364 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.122313    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14b85268-e7cd-4c42-a90a-426dd3838c9a-maas-api-tls\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:50:56.122364 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.122322    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlhgs\" (UniqueName: \"kubernetes.io/projected/14b85268-e7cd-4c42-a90a-426dd3838c9a-kube-api-access-dlhgs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:50:56.122364 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.122331    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/93572506-a353-4d79-a283-2a61dc8d2f38-plugins-config-volume\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:50:56.122364 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.122339    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lp5mx\" (UniqueName: \"kubernetes.io/projected/93572506-a353-4d79-a283-2a61dc8d2f38-kube-api-access-lp5mx\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:50:56.688238 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.688196    2557 generic.go:356] "Generic (PLEG): container finished" podID="14b85268-e7cd-4c42-a90a-426dd3838c9a" containerID="83a4c1ece0b95e962ab68fdac052d177916ff56927a2aac41d0365a9c93fc5cc" exitCode=0
Sep 11 16:50:56.688744 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.688240    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"
Sep 11 16:50:56.688744 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.688271    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86" event={"ID":"14b85268-e7cd-4c42-a90a-426dd3838c9a","Type":"ContainerDied","Data":"83a4c1ece0b95e962ab68fdac052d177916ff56927a2aac41d0365a9c93fc5cc"}
Sep 11 16:50:56.688744 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.688329    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86" event={"ID":"14b85268-e7cd-4c42-a90a-426dd3838c9a","Type":"ContainerDied","Data":"a4420127ecdef42f1c9541f94020dcb5ae186f89c89293753647635f7e1804e6"}
Sep 11 16:50:56.688744 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.688359    2557 scope.go:117] "RemoveContainer" containerID="83a4c1ece0b95e962ab68fdac052d177916ff56927a2aac41d0365a9c93fc5cc"
Sep 11 16:50:56.689909 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.689889    2557 generic.go:356] "Generic (PLEG): container finished" podID="93572506-a353-4d79-a283-2a61dc8d2f38" containerID="9a53babaab56f437ad048e8dac150e766396ec018f03438819ae621751270b8f" exitCode=0
Sep 11 16:50:56.689975 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.689924    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s" event={"ID":"93572506-a353-4d79-a283-2a61dc8d2f38","Type":"ContainerDied","Data":"9a53babaab56f437ad048e8dac150e766396ec018f03438819ae621751270b8f"}
Sep 11 16:50:56.689975 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.689942    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s"
Sep 11 16:50:56.690059 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.689983    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s" event={"ID":"93572506-a353-4d79-a283-2a61dc8d2f38","Type":"ContainerDied","Data":"13b4366e5d5b25d8396349e3f8decc4acd199fc3e1638419e4a77a1ad7a93079"}
Sep 11 16:50:56.699479 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.699460    2557 scope.go:117] "RemoveContainer" containerID="83a4c1ece0b95e962ab68fdac052d177916ff56927a2aac41d0365a9c93fc5cc"
Sep 11 16:50:56.699848 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:50:56.699821    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83a4c1ece0b95e962ab68fdac052d177916ff56927a2aac41d0365a9c93fc5cc\": container with ID starting with 83a4c1ece0b95e962ab68fdac052d177916ff56927a2aac41d0365a9c93fc5cc not found: ID does not exist" containerID="83a4c1ece0b95e962ab68fdac052d177916ff56927a2aac41d0365a9c93fc5cc"
Sep 11 16:50:56.699930 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.699862    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83a4c1ece0b95e962ab68fdac052d177916ff56927a2aac41d0365a9c93fc5cc"} err="failed to get container status \"83a4c1ece0b95e962ab68fdac052d177916ff56927a2aac41d0365a9c93fc5cc\": rpc error: code = NotFound desc = could not find container \"83a4c1ece0b95e962ab68fdac052d177916ff56927a2aac41d0365a9c93fc5cc\": container with ID starting with 83a4c1ece0b95e962ab68fdac052d177916ff56927a2aac41d0365a9c93fc5cc not found: ID does not exist"
Sep 11 16:50:56.699930 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.699889    2557 scope.go:117] "RemoveContainer" containerID="9a53babaab56f437ad048e8dac150e766396ec018f03438819ae621751270b8f"
Sep 11 16:50:56.708088 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.708069    2557 scope.go:117] "RemoveContainer" containerID="9a53babaab56f437ad048e8dac150e766396ec018f03438819ae621751270b8f"
Sep 11 16:50:56.708382 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:50:56.708356    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a53babaab56f437ad048e8dac150e766396ec018f03438819ae621751270b8f\": container with ID starting with 9a53babaab56f437ad048e8dac150e766396ec018f03438819ae621751270b8f not found: ID does not exist" containerID="9a53babaab56f437ad048e8dac150e766396ec018f03438819ae621751270b8f"
Sep 11 16:50:56.708442 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.708389    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a53babaab56f437ad048e8dac150e766396ec018f03438819ae621751270b8f"} err="failed to get container status \"9a53babaab56f437ad048e8dac150e766396ec018f03438819ae621751270b8f\": rpc error: code = NotFound desc = could not find container \"9a53babaab56f437ad048e8dac150e766396ec018f03438819ae621751270b8f\": container with ID starting with 9a53babaab56f437ad048e8dac150e766396ec018f03438819ae621751270b8f not found: ID does not exist"
Sep 11 16:50:56.737515 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.737482    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"]
Sep 11 16:50:56.749662 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.749629    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-3bf678c7-5fc49467b8-qxk86"]
Sep 11 16:50:56.770154 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.770118    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s"]
Sep 11 16:50:56.775814 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.775788    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3bf678c7-7899dcd8c7-frk9s"]
Sep 11 16:50:56.947290 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.947211    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14b85268-e7cd-4c42-a90a-426dd3838c9a" path="/var/lib/kubelet/pods/14b85268-e7cd-4c42-a90a-426dd3838c9a/volumes"
Sep 11 16:50:56.947630 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:50:56.947602    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93572506-a353-4d79-a283-2a61dc8d2f38" path="/var/lib/kubelet/pods/93572506-a353-4d79-a283-2a61dc8d2f38/volumes"
Sep 11 16:51:41.054789 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:51:41.054757    2557 scope.go:117] "RemoveContainer" containerID="22f97501788090123053083a1b2a63120cfc71540559e6addab928d774d42352"
Sep 11 16:52:50.774478 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:50.774442    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"]
Sep 11 16:52:50.775092 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:50.775075    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14b85268-e7cd-4c42-a90a-426dd3838c9a" containerName="maas-api"
Sep 11 16:52:50.775147 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:50.775096    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="14b85268-e7cd-4c42-a90a-426dd3838c9a" containerName="maas-api"
Sep 11 16:52:50.775147 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:50.775118    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93572506-a353-4d79-a283-2a61dc8d2f38" containerName="payload-processing"
Sep 11 16:52:50.775147 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:50.775128    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="93572506-a353-4d79-a283-2a61dc8d2f38" containerName="payload-processing"
Sep 11 16:52:50.775245 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:50.775222    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="14b85268-e7cd-4c42-a90a-426dd3838c9a" containerName="maas-api"
Sep 11 16:52:50.775245 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:50.775241    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="93572506-a353-4d79-a283-2a61dc8d2f38" containerName="payload-processing"
Sep 11 16:52:50.778809 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:50.778786    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"
Sep 11 16:52:50.781704 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:50.781680    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-01987b-serving-cert\""
Sep 11 16:52:50.790794 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:50.790767    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"]
Sep 11 16:52:50.934881 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:50.934844    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea9639c-3f63-493d-9d6c-9ed440e192dc-openshift-service-ca\") pod \"maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj\" (UID: \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"
Sep 11 16:52:50.934881 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:50.934883    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vdg6\" (UniqueName: \"kubernetes.io/projected/0ea9639c-3f63-493d-9d6c-9ed440e192dc-kube-api-access-2vdg6\") pod \"maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj\" (UID: \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"
Sep 11 16:52:50.935144 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:50.934947    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ea9639c-3f63-493d-9d6c-9ed440e192dc-metrics-certs\") pod \"maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj\" (UID: \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"
Sep 11 16:52:50.935144 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:50.935017    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ea9639c-3f63-493d-9d6c-9ed440e192dc-maas-api-tls\") pod \"maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj\" (UID: \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"
Sep 11 16:52:51.036511 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.036409    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea9639c-3f63-493d-9d6c-9ed440e192dc-openshift-service-ca\") pod \"maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj\" (UID: \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"
Sep 11 16:52:51.036511 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.036450    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vdg6\" (UniqueName: \"kubernetes.io/projected/0ea9639c-3f63-493d-9d6c-9ed440e192dc-kube-api-access-2vdg6\") pod \"maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj\" (UID: \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"
Sep 11 16:52:51.036511 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.036490    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ea9639c-3f63-493d-9d6c-9ed440e192dc-metrics-certs\") pod \"maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj\" (UID: \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"
Sep 11 16:52:51.036822 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.036545    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ea9639c-3f63-493d-9d6c-9ed440e192dc-maas-api-tls\") pod \"maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj\" (UID: \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"
Sep 11 16:52:51.037112 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.037092    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea9639c-3f63-493d-9d6c-9ed440e192dc-openshift-service-ca\") pod \"maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj\" (UID: \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"
Sep 11 16:52:51.039166 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.039144    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ea9639c-3f63-493d-9d6c-9ed440e192dc-maas-api-tls\") pod \"maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj\" (UID: \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"
Sep 11 16:52:51.039232 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.039183    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ea9639c-3f63-493d-9d6c-9ed440e192dc-metrics-certs\") pod \"maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj\" (UID: \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"
Sep 11 16:52:51.052164 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.052129    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vdg6\" (UniqueName: \"kubernetes.io/projected/0ea9639c-3f63-493d-9d6c-9ed440e192dc-kube-api-access-2vdg6\") pod \"maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj\" (UID: \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"
Sep 11 16:52:51.091210 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.091169    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"
Sep 11 16:52:51.373012 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.372979    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"]
Sep 11 16:52:51.374667 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:52:51.374638    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea9639c_3f63_493d_9d6c_9ed440e192dc.slice/crio-a88c64988bb39ffbccef8e698a3d80760b12bdfb70fa95e183a5b126ddd960ac WatchSource:0}: Error finding container a88c64988bb39ffbccef8e698a3d80760b12bdfb70fa95e183a5b126ddd960ac: Status 404 returned error can't find the container with id a88c64988bb39ffbccef8e698a3d80760b12bdfb70fa95e183a5b126ddd960ac
Sep 11 16:52:51.376222 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.376202    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:52:51.667170 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.667081    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr"]
Sep 11 16:52:51.671845 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.671818    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr"
Sep 11 16:52:51.674781 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.674729    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-01987b-dockercfg-g56dd\""
Sep 11 16:52:51.674952 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.674926    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-01987b\""
Sep 11 16:52:51.688202 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.688175    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr"]
Sep 11 16:52:51.744088 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.744048    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c52678c6-7b3e-4b2e-800e-e917feb0a572-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr\" (UID: \"c52678c6-7b3e-4b2e-800e-e917feb0a572\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr"
Sep 11 16:52:51.744270 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.744099    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb9mj\" (UniqueName: \"kubernetes.io/projected/c52678c6-7b3e-4b2e-800e-e917feb0a572-kube-api-access-kb9mj\") pod \"payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr\" (UID: \"c52678c6-7b3e-4b2e-800e-e917feb0a572\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr"
Sep 11 16:52:51.845506 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.845449    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c52678c6-7b3e-4b2e-800e-e917feb0a572-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr\" (UID: \"c52678c6-7b3e-4b2e-800e-e917feb0a572\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr"
Sep 11 16:52:51.845506 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.845504    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb9mj\" (UniqueName: \"kubernetes.io/projected/c52678c6-7b3e-4b2e-800e-e917feb0a572-kube-api-access-kb9mj\") pod \"payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr\" (UID: \"c52678c6-7b3e-4b2e-800e-e917feb0a572\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr"
Sep 11 16:52:51.846241 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.846218    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c52678c6-7b3e-4b2e-800e-e917feb0a572-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr\" (UID: \"c52678c6-7b3e-4b2e-800e-e917feb0a572\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr"
Sep 11 16:52:51.856770 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.856744    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb9mj\" (UniqueName: \"kubernetes.io/projected/c52678c6-7b3e-4b2e-800e-e917feb0a572-kube-api-access-kb9mj\") pod \"payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr\" (UID: \"c52678c6-7b3e-4b2e-800e-e917feb0a572\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr"
Sep 11 16:52:51.983244 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:51.983162    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr"
Sep 11 16:52:52.260520 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:52.260492    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr"]
Sep 11 16:52:52.261787 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:52:52.261758    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc52678c6_7b3e_4b2e_800e_e917feb0a572.slice/crio-6822ad71d610ac808c5e46b8ca021b2af3b967ef339192d8bcc7cf55693d3897 WatchSource:0}: Error finding container 6822ad71d610ac808c5e46b8ca021b2af3b967ef339192d8bcc7cf55693d3897: Status 404 returned error can't find the container with id 6822ad71d610ac808c5e46b8ca021b2af3b967ef339192d8bcc7cf55693d3897
Sep 11 16:52:52.366733 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:52.366694    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj" event={"ID":"0ea9639c-3f63-493d-9d6c-9ed440e192dc","Type":"ContainerStarted","Data":"a651f981d551077447a466196a3e31e747f74dfbd2ef3fc798f5318a38c504c0"}
Sep 11 16:52:52.366931 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:52.366769    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"
Sep 11 16:52:52.366931 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:52.366794    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj" event={"ID":"0ea9639c-3f63-493d-9d6c-9ed440e192dc","Type":"ContainerStarted","Data":"a88c64988bb39ffbccef8e698a3d80760b12bdfb70fa95e183a5b126ddd960ac"}
Sep 11 16:52:52.368809 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:52.368780    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr" event={"ID":"c52678c6-7b3e-4b2e-800e-e917feb0a572","Type":"ContainerStarted","Data":"8d2fc58fe12a06137474b7ee31b5863cdba59dfe79f5034577780dff2ba01df7"}
Sep 11 16:52:52.368949 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:52.368824    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr" event={"ID":"c52678c6-7b3e-4b2e-800e-e917feb0a572","Type":"ContainerStarted","Data":"6822ad71d610ac808c5e46b8ca021b2af3b967ef339192d8bcc7cf55693d3897"}
Sep 11 16:52:52.368949 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:52.368893    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr"
Sep 11 16:52:52.388483 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:52.388419    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj" podStartSLOduration=1.7769982469999999 podStartE2EDuration="2.388397494s" totalImagesPullingTime="611.399247ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:52:52.387207866 +0000 UTC m=+1392.005482036" watchObservedRunningTime="2026-09-11 16:52:52.388397494 +0000 UTC m=+1392.006671664"
Sep 11 16:52:52.409368 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:52.409312    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr" podStartSLOduration=1.409295873 podStartE2EDuration="1.409295873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:52:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:52:52.40702477 +0000 UTC m=+1392.025298939" watchObservedRunningTime="2026-09-11 16:52:52.409295873 +0000 UTC m=+1392.027570042"
Sep 11 16:52:58.379797 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:52:58.379764    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"
Sep 11 16:53:03.376290 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:03.376256    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr"
Sep 11 16:53:20.008629 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:20.008571    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"]
Sep 11 16:53:20.012253 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:20.012236    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"
Sep 11 16:53:20.014919 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:20.014892    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-16265e-serving-cert\""
Sep 11 16:53:20.027854 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:20.027823    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"]
Sep 11 16:53:20.129581 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:20.129543    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b4ef839-86d6-4b2a-aacd-4219a2442e62-openshift-service-ca\") pod \"maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt\" (UID: \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"
Sep 11 16:53:20.129772 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:20.129706    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75xvg\" (UniqueName: \"kubernetes.io/projected/9b4ef839-86d6-4b2a-aacd-4219a2442e62-kube-api-access-75xvg\") pod \"maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt\" (UID: \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"
Sep 11 16:53:20.129772 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:20.129753    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b4ef839-86d6-4b2a-aacd-4219a2442e62-maas-api-tls\") pod \"maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt\" (UID: \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"
Sep 11 16:53:20.129854 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:20.129792    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4ef839-86d6-4b2a-aacd-4219a2442e62-metrics-certs\") pod \"maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt\" (UID: \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"
Sep 11 16:53:20.231005 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:20.230967    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4ef839-86d6-4b2a-aacd-4219a2442e62-metrics-certs\") pod \"maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt\" (UID: \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"
Sep 11 16:53:20.231206 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:20.231019    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b4ef839-86d6-4b2a-aacd-4219a2442e62-openshift-service-ca\") pod \"maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt\" (UID: \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"
Sep 11 16:53:20.231206 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:20.231096    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75xvg\" (UniqueName: \"kubernetes.io/projected/9b4ef839-86d6-4b2a-aacd-4219a2442e62-kube-api-access-75xvg\") pod \"maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt\" (UID: \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"
Sep 11 16:53:20.231206 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:20.231137    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b4ef839-86d6-4b2a-aacd-4219a2442e62-maas-api-tls\") pod \"maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt\" (UID: \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"
Sep 11 16:53:20.231380 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:53:20.231236    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-serving-cert: secret "maas-api-e2e-api-b-16265e-serving-cert" not found
Sep 11 16:53:20.231380 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:53:20.231309    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b4ef839-86d6-4b2a-aacd-4219a2442e62-maas-api-tls podName:9b4ef839-86d6-4b2a-aacd-4219a2442e62 nodeName:}" failed. No retries permitted until 2026-09-11 16:53:20.731288888 +0000 UTC m=+1420.349563036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9b4ef839-86d6-4b2a-aacd-4219a2442e62-maas-api-tls") pod "maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt" (UID: "9b4ef839-86d6-4b2a-aacd-4219a2442e62") : secret "maas-api-e2e-api-b-16265e-serving-cert" not found
Sep 11 16:53:20.231806 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:20.231783    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b4ef839-86d6-4b2a-aacd-4219a2442e62-openshift-service-ca\") pod \"maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt\" (UID: \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"
Sep 11 16:53:20.233484 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:20.233461    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4ef839-86d6-4b2a-aacd-4219a2442e62-metrics-certs\") pod \"maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt\" (UID: \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"
Sep 11 16:53:20.244747 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:20.244720    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75xvg\" (UniqueName: \"kubernetes.io/projected/9b4ef839-86d6-4b2a-aacd-4219a2442e62-kube-api-access-75xvg\") pod \"maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt\" (UID: \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"
Sep 11 16:53:20.736908 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:20.736868    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b4ef839-86d6-4b2a-aacd-4219a2442e62-maas-api-tls\") pod \"maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt\" (UID: \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"
Sep 11 16:53:20.739584 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:20.739550    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b4ef839-86d6-4b2a-aacd-4219a2442e62-maas-api-tls\") pod \"maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt\" (UID: \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"
Sep 11 16:53:20.924543 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:20.924506    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"
Sep 11 16:53:21.211165 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:21.211134    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"]
Sep 11 16:53:21.213710 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:53:21.213681    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b4ef839_86d6_4b2a_aacd_4219a2442e62.slice/crio-9dbfced47a22918346485f681385c5853bcb72d515936d0c7c33842298644aa9 WatchSource:0}: Error finding container 9dbfced47a22918346485f681385c5853bcb72d515936d0c7c33842298644aa9: Status 404 returned error can't find the container with id 9dbfced47a22918346485f681385c5853bcb72d515936d0c7c33842298644aa9
Sep 11 16:53:21.539910 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:21.539872    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt" event={"ID":"9b4ef839-86d6-4b2a-aacd-4219a2442e62","Type":"ContainerStarted","Data":"9dbfced47a22918346485f681385c5853bcb72d515936d0c7c33842298644aa9"}
Sep 11 16:53:22.548499 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:22.548463    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt" event={"ID":"9b4ef839-86d6-4b2a-aacd-4219a2442e62","Type":"ContainerStarted","Data":"416c94d2373581183a6d67b23740bad2408eb5e34e093ddd720f52486deee9f0"}
Sep 11 16:53:22.548941 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:22.548601    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"
Sep 11 16:53:22.575683 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:22.575626    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt" podStartSLOduration=3.198154001 podStartE2EDuration="3.575598908s" totalImagesPullingTime="377.444907ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:53:22.573273449 +0000 UTC m=+1422.191547619" watchObservedRunningTime="2026-09-11 16:53:22.575598908 +0000 UTC m=+1422.193873079"
Sep 11 16:53:28.560455 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:53:28.560422    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"
Sep 11 16:54:02.586641 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:02.586576    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"]
Sep 11 16:54:02.589049 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:02.586827    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj" podUID="0ea9639c-3f63-493d-9d6c-9ed440e192dc" containerName="maas-api" containerID="cri-o://a651f981d551077447a466196a3e31e747f74dfbd2ef3fc798f5318a38c504c0" gracePeriod=30
Sep 11 16:54:02.663455 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:02.663422    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr"]
Sep 11 16:54:02.663712 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:02.663665    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr" podUID="c52678c6-7b3e-4b2e-800e-e917feb0a572" containerName="payload-pre-processing" containerID="cri-o://8d2fc58fe12a06137474b7ee31b5863cdba59dfe79f5034577780dff2ba01df7" gracePeriod=30
Sep 11 16:54:02.788880 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:02.788845    2557 generic.go:356] "Generic (PLEG): container finished" podID="0ea9639c-3f63-493d-9d6c-9ed440e192dc" containerID="a651f981d551077447a466196a3e31e747f74dfbd2ef3fc798f5318a38c504c0" exitCode=0
Sep 11 16:54:02.789057 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:02.788953    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj" event={"ID":"0ea9639c-3f63-493d-9d6c-9ed440e192dc","Type":"ContainerDied","Data":"a651f981d551077447a466196a3e31e747f74dfbd2ef3fc798f5318a38c504c0"}
Sep 11 16:54:02.790915 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:02.790894    2557 generic.go:356] "Generic (PLEG): container finished" podID="c52678c6-7b3e-4b2e-800e-e917feb0a572" containerID="8d2fc58fe12a06137474b7ee31b5863cdba59dfe79f5034577780dff2ba01df7" exitCode=0
Sep 11 16:54:02.791016 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:02.790959    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr" event={"ID":"c52678c6-7b3e-4b2e-800e-e917feb0a572","Type":"ContainerDied","Data":"8d2fc58fe12a06137474b7ee31b5863cdba59dfe79f5034577780dff2ba01df7"}
Sep 11 16:54:02.931309 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:02.931280    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"
Sep 11 16:54:02.961093 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:02.961061    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr"
Sep 11 16:54:03.041911 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.041873    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c52678c6-7b3e-4b2e-800e-e917feb0a572-plugins-config-volume\") pod \"c52678c6-7b3e-4b2e-800e-e917feb0a572\" (UID: \"c52678c6-7b3e-4b2e-800e-e917feb0a572\") "
Sep 11 16:54:03.042104 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.041925    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ea9639c-3f63-493d-9d6c-9ed440e192dc-metrics-certs\") pod \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\" (UID: \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\") "
Sep 11 16:54:03.042104 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.041961    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vdg6\" (UniqueName: \"kubernetes.io/projected/0ea9639c-3f63-493d-9d6c-9ed440e192dc-kube-api-access-2vdg6\") pod \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\" (UID: \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\") "
Sep 11 16:54:03.042104 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.042055    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea9639c-3f63-493d-9d6c-9ed440e192dc-openshift-service-ca\") pod \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\" (UID: \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\") "
Sep 11 16:54:03.042104 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.042077    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kb9mj\" (UniqueName: \"kubernetes.io/projected/c52678c6-7b3e-4b2e-800e-e917feb0a572-kube-api-access-kb9mj\") pod \"c52678c6-7b3e-4b2e-800e-e917feb0a572\" (UID: \"c52678c6-7b3e-4b2e-800e-e917feb0a572\") "
Sep 11 16:54:03.042104 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.042103    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ea9639c-3f63-493d-9d6c-9ed440e192dc-maas-api-tls\") pod \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\" (UID: \"0ea9639c-3f63-493d-9d6c-9ed440e192dc\") "
Sep 11 16:54:03.042391 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.042254    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c52678c6-7b3e-4b2e-800e-e917feb0a572-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c52678c6-7b3e-4b2e-800e-e917feb0a572" (UID: "c52678c6-7b3e-4b2e-800e-e917feb0a572"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:54:03.042503 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.042481    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c52678c6-7b3e-4b2e-800e-e917feb0a572-plugins-config-volume\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:54:03.042810 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.042777    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ea9639c-3f63-493d-9d6c-9ed440e192dc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0ea9639c-3f63-493d-9d6c-9ed440e192dc" (UID: "0ea9639c-3f63-493d-9d6c-9ed440e192dc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:54:03.044405 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.044377    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ea9639c-3f63-493d-9d6c-9ed440e192dc-kube-api-access-2vdg6" (OuterVolumeSpecName: "kube-api-access-2vdg6") pod "0ea9639c-3f63-493d-9d6c-9ed440e192dc" (UID: "0ea9639c-3f63-493d-9d6c-9ed440e192dc"). InnerVolumeSpecName "kube-api-access-2vdg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:54:03.044599 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.044561    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c52678c6-7b3e-4b2e-800e-e917feb0a572-kube-api-access-kb9mj" (OuterVolumeSpecName: "kube-api-access-kb9mj") pod "c52678c6-7b3e-4b2e-800e-e917feb0a572" (UID: "c52678c6-7b3e-4b2e-800e-e917feb0a572"). InnerVolumeSpecName "kube-api-access-kb9mj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:54:03.044732 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.044630    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ea9639c-3f63-493d-9d6c-9ed440e192dc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0ea9639c-3f63-493d-9d6c-9ed440e192dc" (UID: "0ea9639c-3f63-493d-9d6c-9ed440e192dc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:54:03.044732 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.044667    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ea9639c-3f63-493d-9d6c-9ed440e192dc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0ea9639c-3f63-493d-9d6c-9ed440e192dc" (UID: "0ea9639c-3f63-493d-9d6c-9ed440e192dc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:54:03.144034 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.143942    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ea9639c-3f63-493d-9d6c-9ed440e192dc-metrics-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:54:03.144034 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.143971    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vdg6\" (UniqueName: \"kubernetes.io/projected/0ea9639c-3f63-493d-9d6c-9ed440e192dc-kube-api-access-2vdg6\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:54:03.144034 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.143982    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ea9639c-3f63-493d-9d6c-9ed440e192dc-openshift-service-ca\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:54:03.144034 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.143992    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kb9mj\" (UniqueName: \"kubernetes.io/projected/c52678c6-7b3e-4b2e-800e-e917feb0a572-kube-api-access-kb9mj\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:54:03.144034 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.144000    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ea9639c-3f63-493d-9d6c-9ed440e192dc-maas-api-tls\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:54:03.799034 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.799002    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"
Sep 11 16:54:03.799034 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.799020    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj" event={"ID":"0ea9639c-3f63-493d-9d6c-9ed440e192dc","Type":"ContainerDied","Data":"a88c64988bb39ffbccef8e698a3d80760b12bdfb70fa95e183a5b126ddd960ac"}
Sep 11 16:54:03.799537 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.799089    2557 scope.go:117] "RemoveContainer" containerID="a651f981d551077447a466196a3e31e747f74dfbd2ef3fc798f5318a38c504c0"
Sep 11 16:54:03.800534 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.800508    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr"
Sep 11 16:54:03.800650 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.800557    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr" event={"ID":"c52678c6-7b3e-4b2e-800e-e917feb0a572","Type":"ContainerDied","Data":"6822ad71d610ac808c5e46b8ca021b2af3b967ef339192d8bcc7cf55693d3897"}
Sep 11 16:54:03.808880 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.808858    2557 scope.go:117] "RemoveContainer" containerID="8d2fc58fe12a06137474b7ee31b5863cdba59dfe79f5034577780dff2ba01df7"
Sep 11 16:54:03.842524 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.842488    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"]
Sep 11 16:54:03.845134 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.845105    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-01987b-8d45c8bbb-sr8nj"]
Sep 11 16:54:03.867141 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.867053    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr"]
Sep 11 16:54:03.869566 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:03.869541    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-01987b-74d9db4c74-9qmhr"]
Sep 11 16:54:04.948004 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:04.947971    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ea9639c-3f63-493d-9d6c-9ed440e192dc" path="/var/lib/kubelet/pods/0ea9639c-3f63-493d-9d6c-9ed440e192dc/volumes"
Sep 11 16:54:04.948378 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:04.948326    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c52678c6-7b3e-4b2e-800e-e917feb0a572" path="/var/lib/kubelet/pods/c52678c6-7b3e-4b2e-800e-e917feb0a572/volumes"
Sep 11 16:54:11.508533 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:11.508486    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7783-8f50ae"]
Sep 11 16:54:11.509423 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:11.509394    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ea9639c-3f63-493d-9d6c-9ed440e192dc" containerName="maas-api"
Sep 11 16:54:11.509535 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:11.509425    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ea9639c-3f63-493d-9d6c-9ed440e192dc" containerName="maas-api"
Sep 11 16:54:11.509535 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:11.509439    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c52678c6-7b3e-4b2e-800e-e917feb0a572" containerName="payload-pre-processing"
Sep 11 16:54:11.509535 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:11.509449    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c52678c6-7b3e-4b2e-800e-e917feb0a572" containerName="payload-pre-processing"
Sep 11 16:54:11.509758 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:11.509656    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c52678c6-7b3e-4b2e-800e-e917feb0a572" containerName="payload-pre-processing"
Sep 11 16:54:11.509758 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:11.509684    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ea9639c-3f63-493d-9d6c-9ed440e192dc" containerName="maas-api"
Sep 11 16:54:11.513959 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:11.513926    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7783-8f50ae"
Sep 11 16:54:11.519164 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:11.519140    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vtvd2\""
Sep 11 16:54:11.522762 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:11.522735    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7783-8f50ae"]
Sep 11 16:54:11.627828 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:11.627791    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx7jt\" (UniqueName: \"kubernetes.io/projected/27e307cf-1f1a-4936-bfe3-bc872f234c6b-kube-api-access-nx7jt\") pod \"test-curl-7783-8f50ae\" (UID: \"27e307cf-1f1a-4936-bfe3-bc872f234c6b\") " pod="opendatahub/test-curl-7783-8f50ae"
Sep 11 16:54:11.729093 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:11.729044    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx7jt\" (UniqueName: \"kubernetes.io/projected/27e307cf-1f1a-4936-bfe3-bc872f234c6b-kube-api-access-nx7jt\") pod \"test-curl-7783-8f50ae\" (UID: \"27e307cf-1f1a-4936-bfe3-bc872f234c6b\") " pod="opendatahub/test-curl-7783-8f50ae"
Sep 11 16:54:11.751861 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:11.751824    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx7jt\" (UniqueName: \"kubernetes.io/projected/27e307cf-1f1a-4936-bfe3-bc872f234c6b-kube-api-access-nx7jt\") pod \"test-curl-7783-8f50ae\" (UID: \"27e307cf-1f1a-4936-bfe3-bc872f234c6b\") " pod="opendatahub/test-curl-7783-8f50ae"
Sep 11 16:54:11.825538 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:11.825504    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7783-8f50ae"
Sep 11 16:54:12.120912 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:12.120882    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7783-8f50ae"]
Sep 11 16:54:12.121698 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:54:12.121671    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27e307cf_1f1a_4936_bfe3_bc872f234c6b.slice/crio-25ed32703685ba8ccbaac05b03250423983fb9983a93257e162ea653dfcd0450 WatchSource:0}: Error finding container 25ed32703685ba8ccbaac05b03250423983fb9983a93257e162ea653dfcd0450: Status 404 returned error can't find the container with id 25ed32703685ba8ccbaac05b03250423983fb9983a93257e162ea653dfcd0450
Sep 11 16:54:12.861057 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:12.861019    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7783-8f50ae" event={"ID":"27e307cf-1f1a-4936-bfe3-bc872f234c6b","Type":"ContainerStarted","Data":"25ed32703685ba8ccbaac05b03250423983fb9983a93257e162ea653dfcd0450"}
Sep 11 16:54:14.874360 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:14.874325    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7783-8f50ae" event={"ID":"27e307cf-1f1a-4936-bfe3-bc872f234c6b","Type":"ContainerStarted","Data":"31a936fc59622d50505e8de89222755d54933a3964dc2c44970a259a378575a1"}
Sep 11 16:54:14.894345 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:14.894290    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7783-8f50ae" podStartSLOduration=1.915433815 podStartE2EDuration="3.89427544s" totalImagesPullingTime="1.978841625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:54:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:54:14.892821789 +0000 UTC m=+1474.511095958" watchObservedRunningTime="2026-09-11 16:54:14.89427544 +0000 UTC m=+1474.512549609"
Sep 11 16:54:15.532221 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:15.532183    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7783-8f50ae"]
Sep 11 16:54:15.537072 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:15.537041    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7783-8f50ae"]
Sep 11 16:54:15.881186 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:54:15.881152    2557 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7783-8f50ae" container="test-curl-7783-8f50ae"
Sep 11 16:54:16.886553 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:16.886508    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7783-8f50ae" podUID="27e307cf-1f1a-4936-bfe3-bc872f234c6b" containerName="test-curl-7783-8f50ae" containerID="cri-o://31a936fc59622d50505e8de89222755d54933a3964dc2c44970a259a378575a1" gracePeriod=2
Sep 11 16:54:16.889066 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:54:16.889038    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7783-8f50ae\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="27e307cf-1f1a-4936-bfe3-bc872f234c6b" pod="opendatahub/test-curl-7783-8f50ae"
Sep 11 16:54:19.059736 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:19.059706    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7783-8f50ae"
Sep 11 16:54:19.202466 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:19.202364    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx7jt\" (UniqueName: \"kubernetes.io/projected/27e307cf-1f1a-4936-bfe3-bc872f234c6b-kube-api-access-nx7jt\") pod \"27e307cf-1f1a-4936-bfe3-bc872f234c6b\" (UID: \"27e307cf-1f1a-4936-bfe3-bc872f234c6b\") "
Sep 11 16:54:19.204433 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:19.204406    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27e307cf-1f1a-4936-bfe3-bc872f234c6b-kube-api-access-nx7jt" (OuterVolumeSpecName: "kube-api-access-nx7jt") pod "27e307cf-1f1a-4936-bfe3-bc872f234c6b" (UID: "27e307cf-1f1a-4936-bfe3-bc872f234c6b"). InnerVolumeSpecName "kube-api-access-nx7jt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:54:19.303601 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:19.303556    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx7jt\" (UniqueName: \"kubernetes.io/projected/27e307cf-1f1a-4936-bfe3-bc872f234c6b-kube-api-access-nx7jt\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:54:19.906138 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:19.906088    2557 generic.go:356] "Generic (PLEG): container finished" podID="27e307cf-1f1a-4936-bfe3-bc872f234c6b" containerID="31a936fc59622d50505e8de89222755d54933a3964dc2c44970a259a378575a1" exitCode=137
Sep 11 16:54:19.906340 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:19.906175    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7783-8f50ae"
Sep 11 16:54:19.906340 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:19.906199    2557 scope.go:117] "RemoveContainer" containerID="31a936fc59622d50505e8de89222755d54933a3964dc2c44970a259a378575a1"
Sep 11 16:54:19.916363 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:19.916339    2557 scope.go:117] "RemoveContainer" containerID="31a936fc59622d50505e8de89222755d54933a3964dc2c44970a259a378575a1"
Sep 11 16:54:19.916698 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:54:19.916670    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31a936fc59622d50505e8de89222755d54933a3964dc2c44970a259a378575a1\": container with ID starting with 31a936fc59622d50505e8de89222755d54933a3964dc2c44970a259a378575a1 not found: ID does not exist" containerID="31a936fc59622d50505e8de89222755d54933a3964dc2c44970a259a378575a1"
Sep 11 16:54:19.916806 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:19.916700    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a936fc59622d50505e8de89222755d54933a3964dc2c44970a259a378575a1"} err="failed to get container status \"31a936fc59622d50505e8de89222755d54933a3964dc2c44970a259a378575a1\": rpc error: code = NotFound desc = could not find container \"31a936fc59622d50505e8de89222755d54933a3964dc2c44970a259a378575a1\": container with ID starting with 31a936fc59622d50505e8de89222755d54933a3964dc2c44970a259a378575a1 not found: ID does not exist"
Sep 11 16:54:19.916886 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:54:19.916843    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7783-8f50ae\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="27e307cf-1f1a-4936-bfe3-bc872f234c6b" pod="opendatahub/test-curl-7783-8f50ae"
Sep 11 16:54:20.946445 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:54:20.946393    2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7783-8f50ae\" is forbidden: User \"system:node:ip-10-0-134-196.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-196.ec2.internal' and this object" podUID="27e307cf-1f1a-4936-bfe3-bc872f234c6b" pod="opendatahub/test-curl-7783-8f50ae"
Sep 11 16:54:20.947835 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:20.947802    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27e307cf-1f1a-4936-bfe3-bc872f234c6b" path="/var/lib/kubelet/pods/27e307cf-1f1a-4936-bfe3-bc872f234c6b/volumes"
Sep 11 16:54:27.111473 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.111432    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"]
Sep 11 16:54:27.112311 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.112272    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt" podUID="9b4ef839-86d6-4b2a-aacd-4219a2442e62" containerName="maas-api" containerID="cri-o://416c94d2373581183a6d67b23740bad2408eb5e34e093ddd720f52486deee9f0" gracePeriod=30
Sep 11 16:54:27.373507 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.373441    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"
Sep 11 16:54:27.482203 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.482171    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75xvg\" (UniqueName: \"kubernetes.io/projected/9b4ef839-86d6-4b2a-aacd-4219a2442e62-kube-api-access-75xvg\") pod \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\" (UID: \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\") "
Sep 11 16:54:27.482382 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.482284    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b4ef839-86d6-4b2a-aacd-4219a2442e62-maas-api-tls\") pod \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\" (UID: \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\") "
Sep 11 16:54:27.482382 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.482312    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b4ef839-86d6-4b2a-aacd-4219a2442e62-openshift-service-ca\") pod \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\" (UID: \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\") "
Sep 11 16:54:27.482467 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.482432    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4ef839-86d6-4b2a-aacd-4219a2442e62-metrics-certs\") pod \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\" (UID: \"9b4ef839-86d6-4b2a-aacd-4219a2442e62\") "
Sep 11 16:54:27.482745 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.482718    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b4ef839-86d6-4b2a-aacd-4219a2442e62-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9b4ef839-86d6-4b2a-aacd-4219a2442e62" (UID: "9b4ef839-86d6-4b2a-aacd-4219a2442e62"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:54:27.482838 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.482816    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9b4ef839-86d6-4b2a-aacd-4219a2442e62-openshift-service-ca\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:54:27.484556 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.484523    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b4ef839-86d6-4b2a-aacd-4219a2442e62-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9b4ef839-86d6-4b2a-aacd-4219a2442e62" (UID: "9b4ef839-86d6-4b2a-aacd-4219a2442e62"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:54:27.484556 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.484539    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b4ef839-86d6-4b2a-aacd-4219a2442e62-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9b4ef839-86d6-4b2a-aacd-4219a2442e62" (UID: "9b4ef839-86d6-4b2a-aacd-4219a2442e62"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:54:27.484731 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.484532    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b4ef839-86d6-4b2a-aacd-4219a2442e62-kube-api-access-75xvg" (OuterVolumeSpecName: "kube-api-access-75xvg") pod "9b4ef839-86d6-4b2a-aacd-4219a2442e62" (UID: "9b4ef839-86d6-4b2a-aacd-4219a2442e62"). InnerVolumeSpecName "kube-api-access-75xvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:54:27.583495 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.583462    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9b4ef839-86d6-4b2a-aacd-4219a2442e62-maas-api-tls\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:54:27.583495 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.583490    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b4ef839-86d6-4b2a-aacd-4219a2442e62-metrics-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:54:27.583495 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.583501    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75xvg\" (UniqueName: \"kubernetes.io/projected/9b4ef839-86d6-4b2a-aacd-4219a2442e62-kube-api-access-75xvg\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:54:27.963791 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.963749    2557 generic.go:356] "Generic (PLEG): container finished" podID="9b4ef839-86d6-4b2a-aacd-4219a2442e62" containerID="416c94d2373581183a6d67b23740bad2408eb5e34e093ddd720f52486deee9f0" exitCode=0
Sep 11 16:54:27.963986 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.963816    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"
Sep 11 16:54:27.963986 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.963832    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt" event={"ID":"9b4ef839-86d6-4b2a-aacd-4219a2442e62","Type":"ContainerDied","Data":"416c94d2373581183a6d67b23740bad2408eb5e34e093ddd720f52486deee9f0"}
Sep 11 16:54:27.963986 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.963963    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt" event={"ID":"9b4ef839-86d6-4b2a-aacd-4219a2442e62","Type":"ContainerDied","Data":"9dbfced47a22918346485f681385c5853bcb72d515936d0c7c33842298644aa9"}
Sep 11 16:54:27.964155 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.963990    2557 scope.go:117] "RemoveContainer" containerID="416c94d2373581183a6d67b23740bad2408eb5e34e093ddd720f52486deee9f0"
Sep 11 16:54:27.974906 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.974888    2557 scope.go:117] "RemoveContainer" containerID="416c94d2373581183a6d67b23740bad2408eb5e34e093ddd720f52486deee9f0"
Sep 11 16:54:27.975184 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:54:27.975164    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"416c94d2373581183a6d67b23740bad2408eb5e34e093ddd720f52486deee9f0\": container with ID starting with 416c94d2373581183a6d67b23740bad2408eb5e34e093ddd720f52486deee9f0 not found: ID does not exist" containerID="416c94d2373581183a6d67b23740bad2408eb5e34e093ddd720f52486deee9f0"
Sep 11 16:54:27.975233 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.975193    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"416c94d2373581183a6d67b23740bad2408eb5e34e093ddd720f52486deee9f0"} err="failed to get container status \"416c94d2373581183a6d67b23740bad2408eb5e34e093ddd720f52486deee9f0\": rpc error: code = NotFound desc = could not find container \"416c94d2373581183a6d67b23740bad2408eb5e34e093ddd720f52486deee9f0\": container with ID starting with 416c94d2373581183a6d67b23740bad2408eb5e34e093ddd720f52486deee9f0 not found: ID does not exist"
Sep 11 16:54:27.990318 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:27.990288    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"]
Sep 11 16:54:28.000175 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:28.000146    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-16265e-5bfbf7fcfc-wzjbt"]
Sep 11 16:54:28.947293 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:28.947257    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b4ef839-86d6-4b2a-aacd-4219a2442e62" path="/var/lib/kubelet/pods/9b4ef839-86d6-4b2a-aacd-4219a2442e62/volumes"
Sep 11 16:54:45.840131 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:45.840087    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s"]
Sep 11 16:54:45.840759 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:45.840340    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s" podUID="5ae2957c-8148-4f85-8938-8c9035768da6" containerName="payload-pre-processing" containerID="cri-o://7cd2f9316ec64c5f74546a7cbf0a8b2962595b675358f0d7ea962a5accc95a06" gracePeriod=30
Sep 11 16:54:46.072652 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:46.072598    2557 generic.go:356] "Generic (PLEG): container finished" podID="5ae2957c-8148-4f85-8938-8c9035768da6" containerID="7cd2f9316ec64c5f74546a7cbf0a8b2962595b675358f0d7ea962a5accc95a06" exitCode=0
Sep 11 16:54:46.072652 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:46.072637    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s" event={"ID":"5ae2957c-8148-4f85-8938-8c9035768da6","Type":"ContainerDied","Data":"7cd2f9316ec64c5f74546a7cbf0a8b2962595b675358f0d7ea962a5accc95a06"}
Sep 11 16:54:46.104932 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:46.104838    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s"
Sep 11 16:54:46.271413 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:46.271374    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ae2957c-8148-4f85-8938-8c9035768da6-plugins-config-volume\") pod \"5ae2957c-8148-4f85-8938-8c9035768da6\" (UID: \"5ae2957c-8148-4f85-8938-8c9035768da6\") "
Sep 11 16:54:46.271600 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:46.271476    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5d2kj\" (UniqueName: \"kubernetes.io/projected/5ae2957c-8148-4f85-8938-8c9035768da6-kube-api-access-5d2kj\") pod \"5ae2957c-8148-4f85-8938-8c9035768da6\" (UID: \"5ae2957c-8148-4f85-8938-8c9035768da6\") "
Sep 11 16:54:46.271802 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:46.271779    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ae2957c-8148-4f85-8938-8c9035768da6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5ae2957c-8148-4f85-8938-8c9035768da6" (UID: "5ae2957c-8148-4f85-8938-8c9035768da6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:54:46.273617 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:46.273583    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ae2957c-8148-4f85-8938-8c9035768da6-kube-api-access-5d2kj" (OuterVolumeSpecName: "kube-api-access-5d2kj") pod "5ae2957c-8148-4f85-8938-8c9035768da6" (UID: "5ae2957c-8148-4f85-8938-8c9035768da6"). InnerVolumeSpecName "kube-api-access-5d2kj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:54:46.372780 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:46.372687    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5ae2957c-8148-4f85-8938-8c9035768da6-plugins-config-volume\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:54:46.372780 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:46.372721    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5d2kj\" (UniqueName: \"kubernetes.io/projected/5ae2957c-8148-4f85-8938-8c9035768da6-kube-api-access-5d2kj\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:54:47.080506 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:47.080476    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s"
Sep 11 16:54:47.081029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:47.080471    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s" event={"ID":"5ae2957c-8148-4f85-8938-8c9035768da6","Type":"ContainerDied","Data":"adf7bb5066378bea7183ce8748b42ccb430c15679c356cea924415e2ef7d2178"}
Sep 11 16:54:47.081029 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:47.080639    2557 scope.go:117] "RemoveContainer" containerID="7cd2f9316ec64c5f74546a7cbf0a8b2962595b675358f0d7ea962a5accc95a06"
Sep 11 16:54:47.119872 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:47.119831    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s"]
Sep 11 16:54:47.125361 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:47.125328    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-347815-6b9f867fc8-5qv2s"]
Sep 11 16:54:48.947860 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:54:48.947820    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ae2957c-8148-4f85-8938-8c9035768da6" path="/var/lib/kubelet/pods/5ae2957c-8148-4f85-8938-8c9035768da6/volumes"
Sep 11 16:55:04.645174 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:04.645081    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"]
Sep 11 16:55:04.645754 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:04.645372    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw" podUID="ae4f1a1b-1432-41bb-877a-2e529e47c054" containerName="maas-api" containerID="cri-o://0184c8e518fe94f3d31000df5be430bd0390286b60e124f692f07be3f8eb3bae" gracePeriod=30
Sep 11 16:55:04.785193 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:04.785155    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb"]
Sep 11 16:55:04.785415 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:04.785387    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb" podUID="7098ec9b-20b5-4b72-9316-3f4ed4fc6f50" containerName="payload-pre-processing" containerID="cri-o://839eb1636d9e96c7953daffe5609259d922c37c5936c2ee80898e6374ce41eb7" gracePeriod=30
Sep 11 16:55:04.910843 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:04.910817    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"
Sep 11 16:55:04.949283 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:04.949254    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae4f1a1b-1432-41bb-877a-2e529e47c054-openshift-service-ca\") pod \"ae4f1a1b-1432-41bb-877a-2e529e47c054\" (UID: \"ae4f1a1b-1432-41bb-877a-2e529e47c054\") "
Sep 11 16:55:04.949482 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:04.949345    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae4f1a1b-1432-41bb-877a-2e529e47c054-maas-api-tls\") pod \"ae4f1a1b-1432-41bb-877a-2e529e47c054\" (UID: \"ae4f1a1b-1432-41bb-877a-2e529e47c054\") "
Sep 11 16:55:04.949482 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:04.949382    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h87dq\" (UniqueName: \"kubernetes.io/projected/ae4f1a1b-1432-41bb-877a-2e529e47c054-kube-api-access-h87dq\") pod \"ae4f1a1b-1432-41bb-877a-2e529e47c054\" (UID: \"ae4f1a1b-1432-41bb-877a-2e529e47c054\") "
Sep 11 16:55:04.949482 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:04.949412    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae4f1a1b-1432-41bb-877a-2e529e47c054-metrics-certs\") pod \"ae4f1a1b-1432-41bb-877a-2e529e47c054\" (UID: \"ae4f1a1b-1432-41bb-877a-2e529e47c054\") "
Sep 11 16:55:04.949700 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:04.949664    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae4f1a1b-1432-41bb-877a-2e529e47c054-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ae4f1a1b-1432-41bb-877a-2e529e47c054" (UID: "ae4f1a1b-1432-41bb-877a-2e529e47c054"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:55:04.949822 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:04.949804    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae4f1a1b-1432-41bb-877a-2e529e47c054-openshift-service-ca\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:55:04.951671 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:04.951633    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae4f1a1b-1432-41bb-877a-2e529e47c054-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ae4f1a1b-1432-41bb-877a-2e529e47c054" (UID: "ae4f1a1b-1432-41bb-877a-2e529e47c054"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:55:04.952188 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:04.951915    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae4f1a1b-1432-41bb-877a-2e529e47c054-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ae4f1a1b-1432-41bb-877a-2e529e47c054" (UID: "ae4f1a1b-1432-41bb-877a-2e529e47c054"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:55:04.952188 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:04.952017    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae4f1a1b-1432-41bb-877a-2e529e47c054-kube-api-access-h87dq" (OuterVolumeSpecName: "kube-api-access-h87dq") pod "ae4f1a1b-1432-41bb-877a-2e529e47c054" (UID: "ae4f1a1b-1432-41bb-877a-2e529e47c054"). InnerVolumeSpecName "kube-api-access-h87dq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:55:05.030618 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.030576    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb"
Sep 11 16:55:05.050417 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.050379    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zwcw\" (UniqueName: \"kubernetes.io/projected/7098ec9b-20b5-4b72-9316-3f4ed4fc6f50-kube-api-access-2zwcw\") pod \"7098ec9b-20b5-4b72-9316-3f4ed4fc6f50\" (UID: \"7098ec9b-20b5-4b72-9316-3f4ed4fc6f50\") "
Sep 11 16:55:05.050619 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.050457    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7098ec9b-20b5-4b72-9316-3f4ed4fc6f50-plugins-config-volume\") pod \"7098ec9b-20b5-4b72-9316-3f4ed4fc6f50\" (UID: \"7098ec9b-20b5-4b72-9316-3f4ed4fc6f50\") "
Sep 11 16:55:05.050782 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.050762    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae4f1a1b-1432-41bb-877a-2e529e47c054-maas-api-tls\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:55:05.050859 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.050788    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h87dq\" (UniqueName: \"kubernetes.io/projected/ae4f1a1b-1432-41bb-877a-2e529e47c054-kube-api-access-h87dq\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:55:05.050859 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.050804    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae4f1a1b-1432-41bb-877a-2e529e47c054-metrics-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:55:05.051013 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.050991    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7098ec9b-20b5-4b72-9316-3f4ed4fc6f50-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7098ec9b-20b5-4b72-9316-3f4ed4fc6f50" (UID: "7098ec9b-20b5-4b72-9316-3f4ed4fc6f50"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:55:05.052581 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.052559    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7098ec9b-20b5-4b72-9316-3f4ed4fc6f50-kube-api-access-2zwcw" (OuterVolumeSpecName: "kube-api-access-2zwcw") pod "7098ec9b-20b5-4b72-9316-3f4ed4fc6f50" (UID: "7098ec9b-20b5-4b72-9316-3f4ed4fc6f50"). InnerVolumeSpecName "kube-api-access-2zwcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:55:05.151839 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.151802    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zwcw\" (UniqueName: \"kubernetes.io/projected/7098ec9b-20b5-4b72-9316-3f4ed4fc6f50-kube-api-access-2zwcw\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:55:05.151839 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.151832    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7098ec9b-20b5-4b72-9316-3f4ed4fc6f50-plugins-config-volume\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:55:05.185081 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.184983    2557 generic.go:356] "Generic (PLEG): container finished" podID="ae4f1a1b-1432-41bb-877a-2e529e47c054" containerID="0184c8e518fe94f3d31000df5be430bd0390286b60e124f692f07be3f8eb3bae" exitCode=0
Sep 11 16:55:05.185081 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.185035    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"
Sep 11 16:55:05.185305 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.185073    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw" event={"ID":"ae4f1a1b-1432-41bb-877a-2e529e47c054","Type":"ContainerDied","Data":"0184c8e518fe94f3d31000df5be430bd0390286b60e124f692f07be3f8eb3bae"}
Sep 11 16:55:05.185305 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.185131    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw" event={"ID":"ae4f1a1b-1432-41bb-877a-2e529e47c054","Type":"ContainerDied","Data":"552aecfb50c5fa7a3166888b0fef73c9d421e7cf9216ffb01fbb7bc04f6ae2f8"}
Sep 11 16:55:05.185305 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.185154    2557 scope.go:117] "RemoveContainer" containerID="0184c8e518fe94f3d31000df5be430bd0390286b60e124f692f07be3f8eb3bae"
Sep 11 16:55:05.186654 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.186627    2557 generic.go:356] "Generic (PLEG): container finished" podID="7098ec9b-20b5-4b72-9316-3f4ed4fc6f50" containerID="839eb1636d9e96c7953daffe5609259d922c37c5936c2ee80898e6374ce41eb7" exitCode=0
Sep 11 16:55:05.186777 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.186676    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb"
Sep 11 16:55:05.186777 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.186721    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb" event={"ID":"7098ec9b-20b5-4b72-9316-3f4ed4fc6f50","Type":"ContainerDied","Data":"839eb1636d9e96c7953daffe5609259d922c37c5936c2ee80898e6374ce41eb7"}
Sep 11 16:55:05.186777 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.186768    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb" event={"ID":"7098ec9b-20b5-4b72-9316-3f4ed4fc6f50","Type":"ContainerDied","Data":"8dc9146400813667af2a95b675f92a0af30f64e8a63266f767d763056e1f3eb9"}
Sep 11 16:55:05.196344 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.196320    2557 scope.go:117] "RemoveContainer" containerID="0184c8e518fe94f3d31000df5be430bd0390286b60e124f692f07be3f8eb3bae"
Sep 11 16:55:05.196677 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:55:05.196657    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0184c8e518fe94f3d31000df5be430bd0390286b60e124f692f07be3f8eb3bae\": container with ID starting with 0184c8e518fe94f3d31000df5be430bd0390286b60e124f692f07be3f8eb3bae not found: ID does not exist" containerID="0184c8e518fe94f3d31000df5be430bd0390286b60e124f692f07be3f8eb3bae"
Sep 11 16:55:05.196768 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.196687    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0184c8e518fe94f3d31000df5be430bd0390286b60e124f692f07be3f8eb3bae"} err="failed to get container status \"0184c8e518fe94f3d31000df5be430bd0390286b60e124f692f07be3f8eb3bae\": rpc error: code = NotFound desc = could not find container \"0184c8e518fe94f3d31000df5be430bd0390286b60e124f692f07be3f8eb3bae\": container with ID starting with 0184c8e518fe94f3d31000df5be430bd0390286b60e124f692f07be3f8eb3bae not found: ID does not exist"
Sep 11 16:55:05.196768 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.196703    2557 scope.go:117] "RemoveContainer" containerID="839eb1636d9e96c7953daffe5609259d922c37c5936c2ee80898e6374ce41eb7"
Sep 11 16:55:05.205308 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.205290    2557 scope.go:117] "RemoveContainer" containerID="839eb1636d9e96c7953daffe5609259d922c37c5936c2ee80898e6374ce41eb7"
Sep 11 16:55:05.205648 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:55:05.205597    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"839eb1636d9e96c7953daffe5609259d922c37c5936c2ee80898e6374ce41eb7\": container with ID starting with 839eb1636d9e96c7953daffe5609259d922c37c5936c2ee80898e6374ce41eb7 not found: ID does not exist" containerID="839eb1636d9e96c7953daffe5609259d922c37c5936c2ee80898e6374ce41eb7"
Sep 11 16:55:05.205710 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.205656    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"839eb1636d9e96c7953daffe5609259d922c37c5936c2ee80898e6374ce41eb7"} err="failed to get container status \"839eb1636d9e96c7953daffe5609259d922c37c5936c2ee80898e6374ce41eb7\": rpc error: code = NotFound desc = could not find container \"839eb1636d9e96c7953daffe5609259d922c37c5936c2ee80898e6374ce41eb7\": container with ID starting with 839eb1636d9e96c7953daffe5609259d922c37c5936c2ee80898e6374ce41eb7 not found: ID does not exist"
Sep 11 16:55:05.214797 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.214770    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"]
Sep 11 16:55:05.217131 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.217106    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-3e9c29-85d98f474b-f74mw"]
Sep 11 16:55:05.227992 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.227969    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb"]
Sep 11 16:55:05.237920 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:05.237894    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-3e9c29-66d495b4d6-hl4lb"]
Sep 11 16:55:06.946788 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:06.946751    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7098ec9b-20b5-4b72-9316-3f4ed4fc6f50" path="/var/lib/kubelet/pods/7098ec9b-20b5-4b72-9316-3f4ed4fc6f50/volumes"
Sep 11 16:55:06.947177 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:55:06.947157    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae4f1a1b-1432-41bb-877a-2e529e47c054" path="/var/lib/kubelet/pods/ae4f1a1b-1432-41bb-877a-2e529e47c054/volumes"
Sep 11 16:56:08.762799 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.762761    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl"]
Sep 11 16:56:08.763567 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.763335    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b4ef839-86d6-4b2a-aacd-4219a2442e62" containerName="maas-api"
Sep 11 16:56:08.763567 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.763357    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b4ef839-86d6-4b2a-aacd-4219a2442e62" containerName="maas-api"
Sep 11 16:56:08.763567 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.763374    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4f1a1b-1432-41bb-877a-2e529e47c054" containerName="maas-api"
Sep 11 16:56:08.763567 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.763382    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4f1a1b-1432-41bb-877a-2e529e47c054" containerName="maas-api"
Sep 11 16:56:08.763567 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.763398    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7098ec9b-20b5-4b72-9316-3f4ed4fc6f50" containerName="payload-pre-processing"
Sep 11 16:56:08.763567 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.763408    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7098ec9b-20b5-4b72-9316-3f4ed4fc6f50" containerName="payload-pre-processing"
Sep 11 16:56:08.763567 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.763431    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27e307cf-1f1a-4936-bfe3-bc872f234c6b" containerName="test-curl-7783-8f50ae"
Sep 11 16:56:08.763567 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.763439    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="27e307cf-1f1a-4936-bfe3-bc872f234c6b" containerName="test-curl-7783-8f50ae"
Sep 11 16:56:08.763567 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.763454    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ae2957c-8148-4f85-8938-8c9035768da6" containerName="payload-pre-processing"
Sep 11 16:56:08.763567 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.763463    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ae2957c-8148-4f85-8938-8c9035768da6" containerName="payload-pre-processing"
Sep 11 16:56:08.763567 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.763569    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae4f1a1b-1432-41bb-877a-2e529e47c054" containerName="maas-api"
Sep 11 16:56:08.764197 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.763582    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ae2957c-8148-4f85-8938-8c9035768da6" containerName="payload-pre-processing"
Sep 11 16:56:08.764197 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.763591    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b4ef839-86d6-4b2a-aacd-4219a2442e62" containerName="maas-api"
Sep 11 16:56:08.764197 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.763601    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="27e307cf-1f1a-4936-bfe3-bc872f234c6b" containerName="test-curl-7783-8f50ae"
Sep 11 16:56:08.764197 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.763630    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7098ec9b-20b5-4b72-9316-3f4ed4fc6f50" containerName="payload-pre-processing"
Sep 11 16:56:08.767127 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.767102    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl"
Sep 11 16:56:08.769822 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.769797    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-519b89\""
Sep 11 16:56:08.769971 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.769900    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-519b89-dockercfg-r2kgl\""
Sep 11 16:56:08.776937 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.776914    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl"]
Sep 11 16:56:08.840924 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.840878    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pkss\" (UniqueName: \"kubernetes.io/projected/978c3f52-9d01-4bbf-a221-e56079a8a418-kube-api-access-9pkss\") pod \"payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl\" (UID: \"978c3f52-9d01-4bbf-a221-e56079a8a418\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl"
Sep 11 16:56:08.841090 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.840942    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/978c3f52-9d01-4bbf-a221-e56079a8a418-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl\" (UID: \"978c3f52-9d01-4bbf-a221-e56079a8a418\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl"
Sep 11 16:56:08.942527 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.942466    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pkss\" (UniqueName: \"kubernetes.io/projected/978c3f52-9d01-4bbf-a221-e56079a8a418-kube-api-access-9pkss\") pod \"payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl\" (UID: \"978c3f52-9d01-4bbf-a221-e56079a8a418\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl"
Sep 11 16:56:08.942797 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.942632    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/978c3f52-9d01-4bbf-a221-e56079a8a418-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl\" (UID: \"978c3f52-9d01-4bbf-a221-e56079a8a418\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl"
Sep 11 16:56:08.943562 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.943526    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/978c3f52-9d01-4bbf-a221-e56079a8a418-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl\" (UID: \"978c3f52-9d01-4bbf-a221-e56079a8a418\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl"
Sep 11 16:56:08.954669 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:08.954639    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pkss\" (UniqueName: \"kubernetes.io/projected/978c3f52-9d01-4bbf-a221-e56079a8a418-kube-api-access-9pkss\") pod \"payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl\" (UID: \"978c3f52-9d01-4bbf-a221-e56079a8a418\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl"
Sep 11 16:56:09.079997 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:09.079898    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl"
Sep 11 16:56:09.364330 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:09.364298    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl"]
Sep 11 16:56:09.364695 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:56:09.364670    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod978c3f52_9d01_4bbf_a221_e56079a8a418.slice/crio-22bf1a2e0c3f0f4e5b3e83fbd9e52b0d2144ad9aa030e810581965c6041d0cc6 WatchSource:0}: Error finding container 22bf1a2e0c3f0f4e5b3e83fbd9e52b0d2144ad9aa030e810581965c6041d0cc6: Status 404 returned error can't find the container with id 22bf1a2e0c3f0f4e5b3e83fbd9e52b0d2144ad9aa030e810581965c6041d0cc6
Sep 11 16:56:09.563642 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:09.563587    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl" event={"ID":"978c3f52-9d01-4bbf-a221-e56079a8a418","Type":"ContainerStarted","Data":"6498e11eed7a559aa70df36f071e70bcfc396c79f11b126fd5e3f2053f0f3483"}
Sep 11 16:56:09.563843 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:09.563667    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl" event={"ID":"978c3f52-9d01-4bbf-a221-e56079a8a418","Type":"ContainerStarted","Data":"22bf1a2e0c3f0f4e5b3e83fbd9e52b0d2144ad9aa030e810581965c6041d0cc6"}
Sep 11 16:56:09.563843 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:09.563715    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl"
Sep 11 16:56:09.585444 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:09.585385    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl" podStartSLOduration=1.585367575 podStartE2EDuration="1.585367575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:56:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:56:09.582681101 +0000 UTC m=+1589.200955271" watchObservedRunningTime="2026-09-11 16:56:09.585367575 +0000 UTC m=+1589.203641745"
Sep 11 16:56:20.571443 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:20.571405    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl"
Sep 11 16:56:37.065548 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.065449    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"]
Sep 11 16:56:37.069460 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.069436    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"
Sep 11 16:56:37.073417 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.072506    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-eb677c-serving-cert\""
Sep 11 16:56:37.081783 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.081753    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"]
Sep 11 16:56:37.108797 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.108754    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rmzf\" (UniqueName: \"kubernetes.io/projected/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-kube-api-access-5rmzf\") pod \"maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7\" (UID: \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"
Sep 11 16:56:37.109015 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.108812    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-maas-api-tls\") pod \"maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7\" (UID: \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"
Sep 11 16:56:37.109015 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.108904    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-metrics-certs\") pod \"maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7\" (UID: \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"
Sep 11 16:56:37.109015 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.108975    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7\" (UID: \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"
Sep 11 16:56:37.209978 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.209937    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7\" (UID: \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"
Sep 11 16:56:37.210197 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.210012    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rmzf\" (UniqueName: \"kubernetes.io/projected/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-kube-api-access-5rmzf\") pod \"maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7\" (UID: \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"
Sep 11 16:56:37.210197 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.210041    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-maas-api-tls\") pod \"maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7\" (UID: \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"
Sep 11 16:56:37.210197 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.210070    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-metrics-certs\") pod \"maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7\" (UID: \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"
Sep 11 16:56:37.210383 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:56:37.210188    2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-serving-cert: secret "maas-api-e2e-ipp-b-eb677c-serving-cert" not found
Sep 11 16:56:37.210383 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:56:37.210269    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-maas-api-tls podName:0c0d8d32-77cd-4fc2-afb8-f79f621ca6be nodeName:}" failed. No retries permitted until 2026-09-11 16:56:37.710248057 +0000 UTC m=+1617.328522212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-maas-api-tls") pod "maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7" (UID: "0c0d8d32-77cd-4fc2-afb8-f79f621ca6be") : secret "maas-api-e2e-ipp-b-eb677c-serving-cert" not found
Sep 11 16:56:37.210662 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.210635    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7\" (UID: \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"
Sep 11 16:56:37.212435 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.212418    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-metrics-certs\") pod \"maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7\" (UID: \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"
Sep 11 16:56:37.220258 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.220237    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rmzf\" (UniqueName: \"kubernetes.io/projected/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-kube-api-access-5rmzf\") pod \"maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7\" (UID: \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"
Sep 11 16:56:37.714136 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.714098    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-maas-api-tls\") pod \"maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7\" (UID: \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"
Sep 11 16:56:37.716562 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.716538    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-maas-api-tls\") pod \"maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7\" (UID: \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"
Sep 11 16:56:37.736617 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.736576    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796"]
Sep 11 16:56:37.740513 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.740489    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796"
Sep 11 16:56:37.744046 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.744023    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-eb677c\""
Sep 11 16:56:37.752407 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.752378    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796"]
Sep 11 16:56:37.815554 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.815506    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49cde7b7-2aa3-4bec-8230-74c81647f815-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796\" (UID: \"49cde7b7-2aa3-4bec-8230-74c81647f815\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796"
Sep 11 16:56:37.815554 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.815553    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sjbg\" (UniqueName: \"kubernetes.io/projected/49cde7b7-2aa3-4bec-8230-74c81647f815-kube-api-access-4sjbg\") pod \"payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796\" (UID: \"49cde7b7-2aa3-4bec-8230-74c81647f815\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796"
Sep 11 16:56:37.916442 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.916404    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49cde7b7-2aa3-4bec-8230-74c81647f815-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796\" (UID: \"49cde7b7-2aa3-4bec-8230-74c81647f815\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796"
Sep 11 16:56:37.916442 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.916444    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sjbg\" (UniqueName: \"kubernetes.io/projected/49cde7b7-2aa3-4bec-8230-74c81647f815-kube-api-access-4sjbg\") pod \"payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796\" (UID: \"49cde7b7-2aa3-4bec-8230-74c81647f815\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796"
Sep 11 16:56:37.917138 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.917116    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49cde7b7-2aa3-4bec-8230-74c81647f815-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796\" (UID: \"49cde7b7-2aa3-4bec-8230-74c81647f815\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796"
Sep 11 16:56:37.930389 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.930352    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sjbg\" (UniqueName: \"kubernetes.io/projected/49cde7b7-2aa3-4bec-8230-74c81647f815-kube-api-access-4sjbg\") pod \"payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796\" (UID: \"49cde7b7-2aa3-4bec-8230-74c81647f815\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796"
Sep 11 16:56:37.984428 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:37.984327    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"
Sep 11 16:56:38.053039 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:38.053006    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796"
Sep 11 16:56:38.261470 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:38.261436    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"]
Sep 11 16:56:38.262778 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:56:38.262752    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c0d8d32_77cd_4fc2_afb8_f79f621ca6be.slice/crio-a9b91a6db71f60e86919f18e68fa91d3cbff1a5102322122b3bc4010eac91d62 WatchSource:0}: Error finding container a9b91a6db71f60e86919f18e68fa91d3cbff1a5102322122b3bc4010eac91d62: Status 404 returned error can't find the container with id a9b91a6db71f60e86919f18e68fa91d3cbff1a5102322122b3bc4010eac91d62
Sep 11 16:56:38.331037 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:38.331012    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796"]
Sep 11 16:56:38.333133 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:56:38.333079    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49cde7b7_2aa3_4bec_8230_74c81647f815.slice/crio-d9002adcd482279fde4ecbe075815566137f91686a845af99cca8ad036507911 WatchSource:0}: Error finding container d9002adcd482279fde4ecbe075815566137f91686a845af99cca8ad036507911: Status 404 returned error can't find the container with id d9002adcd482279fde4ecbe075815566137f91686a845af99cca8ad036507911
Sep 11 16:56:38.734386 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:38.734353    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7" event={"ID":"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be","Type":"ContainerStarted","Data":"3b1403975f633635a964583c99f8c5e5fe484e186cfe72ee5bdbf5a010dad923"}
Sep 11 16:56:38.734589 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:38.734405    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7" event={"ID":"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be","Type":"ContainerStarted","Data":"a9b91a6db71f60e86919f18e68fa91d3cbff1a5102322122b3bc4010eac91d62"}
Sep 11 16:56:38.734589 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:38.734435    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"
Sep 11 16:56:38.736100 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:38.736072    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796" event={"ID":"49cde7b7-2aa3-4bec-8230-74c81647f815","Type":"ContainerStarted","Data":"45c91764aded55406beac32c9b5e2d95e99f1f2592f3c70d4e1a291a471f1a8d"}
Sep 11 16:56:38.736206 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:38.736123    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796" event={"ID":"49cde7b7-2aa3-4bec-8230-74c81647f815","Type":"ContainerStarted","Data":"d9002adcd482279fde4ecbe075815566137f91686a845af99cca8ad036507911"}
Sep 11 16:56:38.736206 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:38.736157    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796"
Sep 11 16:56:38.753783 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:38.753728    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7" podStartSLOduration=1.385195455 podStartE2EDuration="1.75371164s" totalImagesPullingTime="368.516185ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:56:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:56:38.751918321 +0000 UTC m=+1618.370192504" watchObservedRunningTime="2026-09-11 16:56:38.75371164 +0000 UTC m=+1618.371985809"
Sep 11 16:56:38.772308 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:38.772253    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796" podStartSLOduration=1.7722372640000001 podStartE2EDuration="1.772237264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:56:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:56:38.770031036 +0000 UTC m=+1618.388305206" watchObservedRunningTime="2026-09-11 16:56:38.772237264 +0000 UTC m=+1618.390511434"
Sep 11 16:56:44.747779 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:44.747741    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"
Sep 11 16:56:49.744555 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:56:49.744519    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796"
Sep 11 16:57:06.095958 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:57:06.095925    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9qcfd_891ff581-1fa1-42ca-96be-ea2b43e402ac/payload-processing/0.log"
Sep 11 16:57:57.374901 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:57:57.374867    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9qcfd_891ff581-1fa1-42ca-96be-ea2b43e402ac/payload-processing/0.log"
Sep 11 16:58:02.616096 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:02.616057    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"]
Sep 11 16:58:02.619762 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:02.619739    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"
Sep 11 16:58:02.622743 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:02.622719    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-8a65bd-serving-cert\""
Sep 11 16:58:02.630683 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:02.630655    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"]
Sep 11 16:58:02.716145 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:02.716105    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a763300c-be16-4f26-bd1d-1c35d009a09b-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt\" (UID: \"a763300c-be16-4f26-bd1d-1c35d009a09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"
Sep 11 16:58:02.716414 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:02.716196    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a763300c-be16-4f26-bd1d-1c35d009a09b-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt\" (UID: \"a763300c-be16-4f26-bd1d-1c35d009a09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"
Sep 11 16:58:02.716414 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:02.716221    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a763300c-be16-4f26-bd1d-1c35d009a09b-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt\" (UID: \"a763300c-be16-4f26-bd1d-1c35d009a09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"
Sep 11 16:58:02.716414 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:02.716236    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtbwn\" (UniqueName: \"kubernetes.io/projected/a763300c-be16-4f26-bd1d-1c35d009a09b-kube-api-access-wtbwn\") pod \"maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt\" (UID: \"a763300c-be16-4f26-bd1d-1c35d009a09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"
Sep 11 16:58:02.817196 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:02.817160    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a763300c-be16-4f26-bd1d-1c35d009a09b-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt\" (UID: \"a763300c-be16-4f26-bd1d-1c35d009a09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"
Sep 11 16:58:02.817400 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:02.817203    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a763300c-be16-4f26-bd1d-1c35d009a09b-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt\" (UID: \"a763300c-be16-4f26-bd1d-1c35d009a09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"
Sep 11 16:58:02.817400 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:02.817221    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtbwn\" (UniqueName: \"kubernetes.io/projected/a763300c-be16-4f26-bd1d-1c35d009a09b-kube-api-access-wtbwn\") pod \"maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt\" (UID: \"a763300c-be16-4f26-bd1d-1c35d009a09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"
Sep 11 16:58:02.817400 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:02.817261    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a763300c-be16-4f26-bd1d-1c35d009a09b-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt\" (UID: \"a763300c-be16-4f26-bd1d-1c35d009a09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"
Sep 11 16:58:02.818059 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:02.818036    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a763300c-be16-4f26-bd1d-1c35d009a09b-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt\" (UID: \"a763300c-be16-4f26-bd1d-1c35d009a09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"
Sep 11 16:58:02.819767 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:02.819741    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a763300c-be16-4f26-bd1d-1c35d009a09b-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt\" (UID: \"a763300c-be16-4f26-bd1d-1c35d009a09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"
Sep 11 16:58:02.819912 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:02.819892    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a763300c-be16-4f26-bd1d-1c35d009a09b-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt\" (UID: \"a763300c-be16-4f26-bd1d-1c35d009a09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"
Sep 11 16:58:02.828161 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:02.828133    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtbwn\" (UniqueName: \"kubernetes.io/projected/a763300c-be16-4f26-bd1d-1c35d009a09b-kube-api-access-wtbwn\") pod \"maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt\" (UID: \"a763300c-be16-4f26-bd1d-1c35d009a09b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"
Sep 11 16:58:02.930556 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:02.930430    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"
Sep 11 16:58:03.216481 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:03.216454    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"]
Sep 11 16:58:03.218046 ip-10-0-134-196 kubenswrapper[2557]: W0911 16:58:03.218016    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda763300c_be16_4f26_bd1d_1c35d009a09b.slice/crio-63b56e35c4100dca3b944461cb36706f871b30b826fdbc7b1f97f0ab91c81e2e WatchSource:0}: Error finding container 63b56e35c4100dca3b944461cb36706f871b30b826fdbc7b1f97f0ab91c81e2e: Status 404 returned error can't find the container with id 63b56e35c4100dca3b944461cb36706f871b30b826fdbc7b1f97f0ab91c81e2e
Sep 11 16:58:03.219445 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:03.219417    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:58:04.218198 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:04.218160    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt" event={"ID":"a763300c-be16-4f26-bd1d-1c35d009a09b","Type":"ContainerStarted","Data":"aba683b39e0c3efb449dad65c6303f166b4029ec066f3dbc1e7bc2251258ac3c"}
Sep 11 16:58:04.218597 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:04.218216    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt" event={"ID":"a763300c-be16-4f26-bd1d-1c35d009a09b","Type":"ContainerStarted","Data":"63b56e35c4100dca3b944461cb36706f871b30b826fdbc7b1f97f0ab91c81e2e"}
Sep 11 16:58:04.218597 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:04.218271    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"
Sep 11 16:58:04.239825 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:04.239771    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt" podStartSLOduration=1.72744069 podStartE2EDuration="2.23975491s" totalImagesPullingTime="512.31422ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:58:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:58:04.238424231 +0000 UTC m=+1703.856698402" watchObservedRunningTime="2026-09-11 16:58:04.23975491 +0000 UTC m=+1703.858029080"
Sep 11 16:58:10.228970 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:10.228940    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"
Sep 11 16:58:33.413855 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:33.413818    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"]
Sep 11 16:58:33.414314 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:33.414041    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt" podUID="a763300c-be16-4f26-bd1d-1c35d009a09b" containerName="maas-api" containerID="cri-o://aba683b39e0c3efb449dad65c6303f166b4029ec066f3dbc1e7bc2251258ac3c" gracePeriod=30
Sep 11 16:58:33.673491 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:33.673428    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"
Sep 11 16:58:33.819088 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:33.819050    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a763300c-be16-4f26-bd1d-1c35d009a09b-metrics-certs\") pod \"a763300c-be16-4f26-bd1d-1c35d009a09b\" (UID: \"a763300c-be16-4f26-bd1d-1c35d009a09b\") "
Sep 11 16:58:33.819283 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:33.819093    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a763300c-be16-4f26-bd1d-1c35d009a09b-openshift-service-ca\") pod \"a763300c-be16-4f26-bd1d-1c35d009a09b\" (UID: \"a763300c-be16-4f26-bd1d-1c35d009a09b\") "
Sep 11 16:58:33.819283 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:33.819197    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtbwn\" (UniqueName: \"kubernetes.io/projected/a763300c-be16-4f26-bd1d-1c35d009a09b-kube-api-access-wtbwn\") pod \"a763300c-be16-4f26-bd1d-1c35d009a09b\" (UID: \"a763300c-be16-4f26-bd1d-1c35d009a09b\") "
Sep 11 16:58:33.819283 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:33.819249    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a763300c-be16-4f26-bd1d-1c35d009a09b-maas-api-tls\") pod \"a763300c-be16-4f26-bd1d-1c35d009a09b\" (UID: \"a763300c-be16-4f26-bd1d-1c35d009a09b\") "
Sep 11 16:58:33.819547 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:33.819516    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a763300c-be16-4f26-bd1d-1c35d009a09b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a763300c-be16-4f26-bd1d-1c35d009a09b" (UID: "a763300c-be16-4f26-bd1d-1c35d009a09b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:58:33.821353 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:33.821322    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a763300c-be16-4f26-bd1d-1c35d009a09b-kube-api-access-wtbwn" (OuterVolumeSpecName: "kube-api-access-wtbwn") pod "a763300c-be16-4f26-bd1d-1c35d009a09b" (UID: "a763300c-be16-4f26-bd1d-1c35d009a09b"). InnerVolumeSpecName "kube-api-access-wtbwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:58:33.821692 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:33.821358    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a763300c-be16-4f26-bd1d-1c35d009a09b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a763300c-be16-4f26-bd1d-1c35d009a09b" (UID: "a763300c-be16-4f26-bd1d-1c35d009a09b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:58:33.821692 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:33.821384    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a763300c-be16-4f26-bd1d-1c35d009a09b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a763300c-be16-4f26-bd1d-1c35d009a09b" (UID: "a763300c-be16-4f26-bd1d-1c35d009a09b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:58:33.920312 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:33.920271    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a763300c-be16-4f26-bd1d-1c35d009a09b-metrics-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:58:33.920312 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:33.920307    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a763300c-be16-4f26-bd1d-1c35d009a09b-openshift-service-ca\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:58:33.920312 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:33.920321    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtbwn\" (UniqueName: \"kubernetes.io/projected/a763300c-be16-4f26-bd1d-1c35d009a09b-kube-api-access-wtbwn\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:58:33.920567 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:33.920330    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a763300c-be16-4f26-bd1d-1c35d009a09b-maas-api-tls\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:58:34.389018 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:34.388982    2557 generic.go:356] "Generic (PLEG): container finished" podID="a763300c-be16-4f26-bd1d-1c35d009a09b" containerID="aba683b39e0c3efb449dad65c6303f166b4029ec066f3dbc1e7bc2251258ac3c" exitCode=0
Sep 11 16:58:34.389237 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:34.389030    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"
Sep 11 16:58:34.389237 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:34.389034    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt" event={"ID":"a763300c-be16-4f26-bd1d-1c35d009a09b","Type":"ContainerDied","Data":"aba683b39e0c3efb449dad65c6303f166b4029ec066f3dbc1e7bc2251258ac3c"}
Sep 11 16:58:34.389237 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:34.389159    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt" event={"ID":"a763300c-be16-4f26-bd1d-1c35d009a09b","Type":"ContainerDied","Data":"63b56e35c4100dca3b944461cb36706f871b30b826fdbc7b1f97f0ab91c81e2e"}
Sep 11 16:58:34.389237 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:34.389190    2557 scope.go:117] "RemoveContainer" containerID="aba683b39e0c3efb449dad65c6303f166b4029ec066f3dbc1e7bc2251258ac3c"
Sep 11 16:58:34.401378 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:34.401349    2557 scope.go:117] "RemoveContainer" containerID="aba683b39e0c3efb449dad65c6303f166b4029ec066f3dbc1e7bc2251258ac3c"
Sep 11 16:58:34.402855 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:58:34.402824    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aba683b39e0c3efb449dad65c6303f166b4029ec066f3dbc1e7bc2251258ac3c\": container with ID starting with aba683b39e0c3efb449dad65c6303f166b4029ec066f3dbc1e7bc2251258ac3c not found: ID does not exist" containerID="aba683b39e0c3efb449dad65c6303f166b4029ec066f3dbc1e7bc2251258ac3c"
Sep 11 16:58:34.403013 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:34.402988    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aba683b39e0c3efb449dad65c6303f166b4029ec066f3dbc1e7bc2251258ac3c"} err="failed to get container status \"aba683b39e0c3efb449dad65c6303f166b4029ec066f3dbc1e7bc2251258ac3c\": rpc error: code = NotFound desc = could not find container \"aba683b39e0c3efb449dad65c6303f166b4029ec066f3dbc1e7bc2251258ac3c\": container with ID starting with aba683b39e0c3efb449dad65c6303f166b4029ec066f3dbc1e7bc2251258ac3c not found: ID does not exist"
Sep 11 16:58:34.417901 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:34.417868    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"]
Sep 11 16:58:34.424977 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:34.424949    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a65bd-5d56bbfdbc-2tfwt"]
Sep 11 16:58:34.946908 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:58:34.946875    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a763300c-be16-4f26-bd1d-1c35d009a09b" path="/var/lib/kubelet/pods/a763300c-be16-4f26-bd1d-1c35d009a09b/volumes"
Sep 11 16:59:00.272149 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:59:00.272107    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl"]
Sep 11 16:59:00.272767 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:59:00.272376    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl" podUID="978c3f52-9d01-4bbf-a221-e56079a8a418" containerName="payload-pre-processing" containerID="cri-o://6498e11eed7a559aa70df36f071e70bcfc396c79f11b126fd5e3f2053f0f3483" gracePeriod=30
Sep 11 16:59:00.536505 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:59:00.536431    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl"
Sep 11 16:59:00.539367 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:59:00.539334    2557 generic.go:356] "Generic (PLEG): container finished" podID="978c3f52-9d01-4bbf-a221-e56079a8a418" containerID="6498e11eed7a559aa70df36f071e70bcfc396c79f11b126fd5e3f2053f0f3483" exitCode=0
Sep 11 16:59:00.539502 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:59:00.539374    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl"
Sep 11 16:59:00.539502 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:59:00.539406    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl" event={"ID":"978c3f52-9d01-4bbf-a221-e56079a8a418","Type":"ContainerDied","Data":"6498e11eed7a559aa70df36f071e70bcfc396c79f11b126fd5e3f2053f0f3483"}
Sep 11 16:59:00.539502 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:59:00.539478    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl" event={"ID":"978c3f52-9d01-4bbf-a221-e56079a8a418","Type":"ContainerDied","Data":"22bf1a2e0c3f0f4e5b3e83fbd9e52b0d2144ad9aa030e810581965c6041d0cc6"}
Sep 11 16:59:00.539502 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:59:00.539502    2557 scope.go:117] "RemoveContainer" containerID="6498e11eed7a559aa70df36f071e70bcfc396c79f11b126fd5e3f2053f0f3483"
Sep 11 16:59:00.548766 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:59:00.548740    2557 scope.go:117] "RemoveContainer" containerID="6498e11eed7a559aa70df36f071e70bcfc396c79f11b126fd5e3f2053f0f3483"
Sep 11 16:59:00.549105 ip-10-0-134-196 kubenswrapper[2557]: E0911 16:59:00.549084    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6498e11eed7a559aa70df36f071e70bcfc396c79f11b126fd5e3f2053f0f3483\": container with ID starting with 6498e11eed7a559aa70df36f071e70bcfc396c79f11b126fd5e3f2053f0f3483 not found: ID does not exist" containerID="6498e11eed7a559aa70df36f071e70bcfc396c79f11b126fd5e3f2053f0f3483"
Sep 11 16:59:00.549195 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:59:00.549114    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6498e11eed7a559aa70df36f071e70bcfc396c79f11b126fd5e3f2053f0f3483"} err="failed to get container status \"6498e11eed7a559aa70df36f071e70bcfc396c79f11b126fd5e3f2053f0f3483\": rpc error: code = NotFound desc = could not find container \"6498e11eed7a559aa70df36f071e70bcfc396c79f11b126fd5e3f2053f0f3483\": container with ID starting with 6498e11eed7a559aa70df36f071e70bcfc396c79f11b126fd5e3f2053f0f3483 not found: ID does not exist"
Sep 11 16:59:00.575499 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:59:00.575465    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pkss\" (UniqueName: \"kubernetes.io/projected/978c3f52-9d01-4bbf-a221-e56079a8a418-kube-api-access-9pkss\") pod \"978c3f52-9d01-4bbf-a221-e56079a8a418\" (UID: \"978c3f52-9d01-4bbf-a221-e56079a8a418\") "
Sep 11 16:59:00.575688 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:59:00.575564    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/978c3f52-9d01-4bbf-a221-e56079a8a418-plugins-config-volume\") pod \"978c3f52-9d01-4bbf-a221-e56079a8a418\" (UID: \"978c3f52-9d01-4bbf-a221-e56079a8a418\") "
Sep 11 16:59:00.575974 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:59:00.575947    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/978c3f52-9d01-4bbf-a221-e56079a8a418-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "978c3f52-9d01-4bbf-a221-e56079a8a418" (UID: "978c3f52-9d01-4bbf-a221-e56079a8a418"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:59:00.577581 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:59:00.577559    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/978c3f52-9d01-4bbf-a221-e56079a8a418-kube-api-access-9pkss" (OuterVolumeSpecName: "kube-api-access-9pkss") pod "978c3f52-9d01-4bbf-a221-e56079a8a418" (UID: "978c3f52-9d01-4bbf-a221-e56079a8a418"). InnerVolumeSpecName "kube-api-access-9pkss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:59:00.676896 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:59:00.676856    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/978c3f52-9d01-4bbf-a221-e56079a8a418-plugins-config-volume\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:59:00.676896 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:59:00.676891    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pkss\" (UniqueName: \"kubernetes.io/projected/978c3f52-9d01-4bbf-a221-e56079a8a418-kube-api-access-9pkss\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 16:59:00.862816 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:59:00.862782    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl"]
Sep 11 16:59:00.868410 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:59:00.868381    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-519b89-c8d4464d6-b5qpl"]
Sep 11 16:59:00.948249 ip-10-0-134-196 kubenswrapper[2557]: I0911 16:59:00.948212    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="978c3f52-9d01-4bbf-a221-e56079a8a418" path="/var/lib/kubelet/pods/978c3f52-9d01-4bbf-a221-e56079a8a418/volumes"
Sep 11 17:00:07.792259 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:07.792219    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"]
Sep 11 17:00:07.792922 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:07.792488    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7" podUID="0c0d8d32-77cd-4fc2-afb8-f79f621ca6be" containerName="maas-api" containerID="cri-o://3b1403975f633635a964583c99f8c5e5fe484e186cfe72ee5bdbf5a010dad923" gracePeriod=30
Sep 11 17:00:07.865940 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:07.865899    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796"]
Sep 11 17:00:07.866219 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:07.866187    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796" podUID="49cde7b7-2aa3-4bec-8230-74c81647f815" containerName="payload-pre-processing" containerID="cri-o://45c91764aded55406beac32c9b5e2d95e99f1f2592f3c70d4e1a291a471f1a8d" gracePeriod=30
Sep 11 17:00:07.921416 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:07.921375    2557 generic.go:356] "Generic (PLEG): container finished" podID="0c0d8d32-77cd-4fc2-afb8-f79f621ca6be" containerID="3b1403975f633635a964583c99f8c5e5fe484e186cfe72ee5bdbf5a010dad923" exitCode=0
Sep 11 17:00:07.921591 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:07.921459    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7" event={"ID":"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be","Type":"ContainerDied","Data":"3b1403975f633635a964583c99f8c5e5fe484e186cfe72ee5bdbf5a010dad923"}
Sep 11 17:00:08.131993 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.131960    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"
Sep 11 17:00:08.162247 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.162220    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796"
Sep 11 17:00:08.224203 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.224162    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rmzf\" (UniqueName: \"kubernetes.io/projected/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-kube-api-access-5rmzf\") pod \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\" (UID: \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\") "
Sep 11 17:00:08.224420 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.224249    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49cde7b7-2aa3-4bec-8230-74c81647f815-plugins-config-volume\") pod \"49cde7b7-2aa3-4bec-8230-74c81647f815\" (UID: \"49cde7b7-2aa3-4bec-8230-74c81647f815\") "
Sep 11 17:00:08.224420 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.224287    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-openshift-service-ca\") pod \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\" (UID: \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\") "
Sep 11 17:00:08.224420 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.224331    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-maas-api-tls\") pod \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\" (UID: \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\") "
Sep 11 17:00:08.224420 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.224353    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sjbg\" (UniqueName: \"kubernetes.io/projected/49cde7b7-2aa3-4bec-8230-74c81647f815-kube-api-access-4sjbg\") pod \"49cde7b7-2aa3-4bec-8230-74c81647f815\" (UID: \"49cde7b7-2aa3-4bec-8230-74c81647f815\") "
Sep 11 17:00:08.224420 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.224383    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-metrics-certs\") pod \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\" (UID: \"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be\") "
Sep 11 17:00:08.224760 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.224714    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49cde7b7-2aa3-4bec-8230-74c81647f815-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "49cde7b7-2aa3-4bec-8230-74c81647f815" (UID: "49cde7b7-2aa3-4bec-8230-74c81647f815"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:00:08.224829 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.224803    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0c0d8d32-77cd-4fc2-afb8-f79f621ca6be" (UID: "0c0d8d32-77cd-4fc2-afb8-f79f621ca6be"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:00:08.226671 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.226639    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-kube-api-access-5rmzf" (OuterVolumeSpecName: "kube-api-access-5rmzf") pod "0c0d8d32-77cd-4fc2-afb8-f79f621ca6be" (UID: "0c0d8d32-77cd-4fc2-afb8-f79f621ca6be"). InnerVolumeSpecName "kube-api-access-5rmzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:00:08.226781 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.226645    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49cde7b7-2aa3-4bec-8230-74c81647f815-kube-api-access-4sjbg" (OuterVolumeSpecName: "kube-api-access-4sjbg") pod "49cde7b7-2aa3-4bec-8230-74c81647f815" (UID: "49cde7b7-2aa3-4bec-8230-74c81647f815"). InnerVolumeSpecName "kube-api-access-4sjbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:00:08.226781 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.226760    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0c0d8d32-77cd-4fc2-afb8-f79f621ca6be" (UID: "0c0d8d32-77cd-4fc2-afb8-f79f621ca6be"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:00:08.226883 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.226787    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0c0d8d32-77cd-4fc2-afb8-f79f621ca6be" (UID: "0c0d8d32-77cd-4fc2-afb8-f79f621ca6be"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:00:08.325199 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.325160    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-maas-api-tls\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:08.325199 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.325191    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sjbg\" (UniqueName: \"kubernetes.io/projected/49cde7b7-2aa3-4bec-8230-74c81647f815-kube-api-access-4sjbg\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:08.325199 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.325201    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-metrics-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:08.325199 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.325210    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rmzf\" (UniqueName: \"kubernetes.io/projected/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-kube-api-access-5rmzf\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:08.325481 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.325218    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/49cde7b7-2aa3-4bec-8230-74c81647f815-plugins-config-volume\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:08.325481 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.325227    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be-openshift-service-ca\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:08.928551 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.928516    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"
Sep 11 17:00:08.928551 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.928531    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7" event={"ID":"0c0d8d32-77cd-4fc2-afb8-f79f621ca6be","Type":"ContainerDied","Data":"a9b91a6db71f60e86919f18e68fa91d3cbff1a5102322122b3bc4010eac91d62"}
Sep 11 17:00:08.929128 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.928661    2557 scope.go:117] "RemoveContainer" containerID="3b1403975f633635a964583c99f8c5e5fe484e186cfe72ee5bdbf5a010dad923"
Sep 11 17:00:08.930133 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.930057    2557 generic.go:356] "Generic (PLEG): container finished" podID="49cde7b7-2aa3-4bec-8230-74c81647f815" containerID="45c91764aded55406beac32c9b5e2d95e99f1f2592f3c70d4e1a291a471f1a8d" exitCode=0
Sep 11 17:00:08.930216 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.930189    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796"
Sep 11 17:00:08.930279 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.930175    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796" event={"ID":"49cde7b7-2aa3-4bec-8230-74c81647f815","Type":"ContainerDied","Data":"45c91764aded55406beac32c9b5e2d95e99f1f2592f3c70d4e1a291a471f1a8d"}
Sep 11 17:00:08.930279 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.930271    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796" event={"ID":"49cde7b7-2aa3-4bec-8230-74c81647f815","Type":"ContainerDied","Data":"d9002adcd482279fde4ecbe075815566137f91686a845af99cca8ad036507911"}
Sep 11 17:00:08.939006 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.938971    2557 scope.go:117] "RemoveContainer" containerID="45c91764aded55406beac32c9b5e2d95e99f1f2592f3c70d4e1a291a471f1a8d"
Sep 11 17:00:08.949293 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.949274    2557 scope.go:117] "RemoveContainer" containerID="45c91764aded55406beac32c9b5e2d95e99f1f2592f3c70d4e1a291a471f1a8d"
Sep 11 17:00:08.949580 ip-10-0-134-196 kubenswrapper[2557]: E0911 17:00:08.949560    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45c91764aded55406beac32c9b5e2d95e99f1f2592f3c70d4e1a291a471f1a8d\": container with ID starting with 45c91764aded55406beac32c9b5e2d95e99f1f2592f3c70d4e1a291a471f1a8d not found: ID does not exist" containerID="45c91764aded55406beac32c9b5e2d95e99f1f2592f3c70d4e1a291a471f1a8d"
Sep 11 17:00:08.949683 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.949587    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45c91764aded55406beac32c9b5e2d95e99f1f2592f3c70d4e1a291a471f1a8d"} err="failed to get container status \"45c91764aded55406beac32c9b5e2d95e99f1f2592f3c70d4e1a291a471f1a8d\": rpc error: code = NotFound desc = could not find container \"45c91764aded55406beac32c9b5e2d95e99f1f2592f3c70d4e1a291a471f1a8d\": container with ID starting with 45c91764aded55406beac32c9b5e2d95e99f1f2592f3c70d4e1a291a471f1a8d not found: ID does not exist"
Sep 11 17:00:08.957670 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.957645    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796"]
Sep 11 17:00:08.962551 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.962524    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-eb677c-576c48597d-9h796"]
Sep 11 17:00:08.975659 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.975625    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"]
Sep 11 17:00:08.983261 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:08.983233    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-eb677c-778b65f5b7-4lxf7"]
Sep 11 17:00:10.946990 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:10.946957    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c0d8d32-77cd-4fc2-afb8-f79f621ca6be" path="/var/lib/kubelet/pods/0c0d8d32-77cd-4fc2-afb8-f79f621ca6be/volumes"
Sep 11 17:00:10.947375 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:10.947323    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49cde7b7-2aa3-4bec-8230-74c81647f815" path="/var/lib/kubelet/pods/49cde7b7-2aa3-4bec-8230-74c81647f815/volumes"
Sep 11 17:00:26.326960 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:26.326920    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc"]
Sep 11 17:00:26.327465 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:26.327244    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc" podUID="d30a833c-af8a-4cc1-91b0-7e03823eeda1" containerName="payload-processing" containerID="cri-o://3e804ead985683bc70a6024b62586a10bbbebfb45be96ec7fa0fa0c11f6b72b6" gracePeriod=30
Sep 11 17:00:26.336720 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:26.336689    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw"]
Sep 11 17:00:26.336954 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:26.336908    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw" podUID="adafb380-7908-49d2-b5a2-c9fc5bb5947d" containerName="payload-pre-processing" containerID="cri-o://69777245a48cd0ae8981d2dbd4e3d8c2f56844fc4abc638ea4dc680d64e5ac4f" gracePeriod=30
Sep 11 17:00:26.625536 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:26.625506    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc"
Sep 11 17:00:26.629500 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:26.629475    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw"
Sep 11 17:00:26.699490 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:26.699452    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4fvn\" (UniqueName: \"kubernetes.io/projected/adafb380-7908-49d2-b5a2-c9fc5bb5947d-kube-api-access-g4fvn\") pod \"adafb380-7908-49d2-b5a2-c9fc5bb5947d\" (UID: \"adafb380-7908-49d2-b5a2-c9fc5bb5947d\") "
Sep 11 17:00:26.699490 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:26.699497    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gdwb\" (UniqueName: \"kubernetes.io/projected/d30a833c-af8a-4cc1-91b0-7e03823eeda1-kube-api-access-7gdwb\") pod \"d30a833c-af8a-4cc1-91b0-7e03823eeda1\" (UID: \"d30a833c-af8a-4cc1-91b0-7e03823eeda1\") "
Sep 11 17:00:26.699778 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:26.699537    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adafb380-7908-49d2-b5a2-c9fc5bb5947d-plugins-config-volume\") pod \"adafb380-7908-49d2-b5a2-c9fc5bb5947d\" (UID: \"adafb380-7908-49d2-b5a2-c9fc5bb5947d\") "
Sep 11 17:00:26.699778 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:26.699572    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d30a833c-af8a-4cc1-91b0-7e03823eeda1-plugins-config-volume\") pod \"d30a833c-af8a-4cc1-91b0-7e03823eeda1\" (UID: \"d30a833c-af8a-4cc1-91b0-7e03823eeda1\") "
Sep 11 17:00:26.700009 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:26.699972    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d30a833c-af8a-4cc1-91b0-7e03823eeda1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d30a833c-af8a-4cc1-91b0-7e03823eeda1" (UID: "d30a833c-af8a-4cc1-91b0-7e03823eeda1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:00:26.700009 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:26.699997    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adafb380-7908-49d2-b5a2-c9fc5bb5947d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "adafb380-7908-49d2-b5a2-c9fc5bb5947d" (UID: "adafb380-7908-49d2-b5a2-c9fc5bb5947d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:00:26.701862 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:26.701832    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d30a833c-af8a-4cc1-91b0-7e03823eeda1-kube-api-access-7gdwb" (OuterVolumeSpecName: "kube-api-access-7gdwb") pod "d30a833c-af8a-4cc1-91b0-7e03823eeda1" (UID: "d30a833c-af8a-4cc1-91b0-7e03823eeda1"). InnerVolumeSpecName "kube-api-access-7gdwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:00:26.701976 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:26.701907    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adafb380-7908-49d2-b5a2-c9fc5bb5947d-kube-api-access-g4fvn" (OuterVolumeSpecName: "kube-api-access-g4fvn") pod "adafb380-7908-49d2-b5a2-c9fc5bb5947d" (UID: "adafb380-7908-49d2-b5a2-c9fc5bb5947d"). InnerVolumeSpecName "kube-api-access-g4fvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:00:26.801183 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:26.801137    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4fvn\" (UniqueName: \"kubernetes.io/projected/adafb380-7908-49d2-b5a2-c9fc5bb5947d-kube-api-access-g4fvn\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:26.801183 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:26.801175    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gdwb\" (UniqueName: \"kubernetes.io/projected/d30a833c-af8a-4cc1-91b0-7e03823eeda1-kube-api-access-7gdwb\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:26.801183 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:26.801188    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/adafb380-7908-49d2-b5a2-c9fc5bb5947d-plugins-config-volume\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:26.801432 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:26.801201    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d30a833c-af8a-4cc1-91b0-7e03823eeda1-plugins-config-volume\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:27.034467 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:27.034433    2557 generic.go:356] "Generic (PLEG): container finished" podID="adafb380-7908-49d2-b5a2-c9fc5bb5947d" containerID="69777245a48cd0ae8981d2dbd4e3d8c2f56844fc4abc638ea4dc680d64e5ac4f" exitCode=0
Sep 11 17:00:27.034693 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:27.034481    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw"
Sep 11 17:00:27.034693 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:27.034528    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw" event={"ID":"adafb380-7908-49d2-b5a2-c9fc5bb5947d","Type":"ContainerDied","Data":"69777245a48cd0ae8981d2dbd4e3d8c2f56844fc4abc638ea4dc680d64e5ac4f"}
Sep 11 17:00:27.034693 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:27.034581    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw" event={"ID":"adafb380-7908-49d2-b5a2-c9fc5bb5947d","Type":"ContainerDied","Data":"dede806522357e225884029b83ac391861ef6e2d304a8a380d3f1888002d4eb2"}
Sep 11 17:00:27.034693 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:27.034626    2557 scope.go:117] "RemoveContainer" containerID="69777245a48cd0ae8981d2dbd4e3d8c2f56844fc4abc638ea4dc680d64e5ac4f"
Sep 11 17:00:27.036007 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:27.035986    2557 generic.go:356] "Generic (PLEG): container finished" podID="d30a833c-af8a-4cc1-91b0-7e03823eeda1" containerID="3e804ead985683bc70a6024b62586a10bbbebfb45be96ec7fa0fa0c11f6b72b6" exitCode=0
Sep 11 17:00:27.036096 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:27.036043    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc"
Sep 11 17:00:27.036096 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:27.036079    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc" event={"ID":"d30a833c-af8a-4cc1-91b0-7e03823eeda1","Type":"ContainerDied","Data":"3e804ead985683bc70a6024b62586a10bbbebfb45be96ec7fa0fa0c11f6b72b6"}
Sep 11 17:00:27.036214 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:27.036133    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc" event={"ID":"d30a833c-af8a-4cc1-91b0-7e03823eeda1","Type":"ContainerDied","Data":"c61d165aaf8ac89e990268344ca50604342399b2064b702256ad0f953b45792a"}
Sep 11 17:00:27.043936 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:27.043917    2557 scope.go:117] "RemoveContainer" containerID="69777245a48cd0ae8981d2dbd4e3d8c2f56844fc4abc638ea4dc680d64e5ac4f"
Sep 11 17:00:27.044248 ip-10-0-134-196 kubenswrapper[2557]: E0911 17:00:27.044229    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69777245a48cd0ae8981d2dbd4e3d8c2f56844fc4abc638ea4dc680d64e5ac4f\": container with ID starting with 69777245a48cd0ae8981d2dbd4e3d8c2f56844fc4abc638ea4dc680d64e5ac4f not found: ID does not exist" containerID="69777245a48cd0ae8981d2dbd4e3d8c2f56844fc4abc638ea4dc680d64e5ac4f"
Sep 11 17:00:27.044318 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:27.044255    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69777245a48cd0ae8981d2dbd4e3d8c2f56844fc4abc638ea4dc680d64e5ac4f"} err="failed to get container status \"69777245a48cd0ae8981d2dbd4e3d8c2f56844fc4abc638ea4dc680d64e5ac4f\": rpc error: code = NotFound desc = could not find container \"69777245a48cd0ae8981d2dbd4e3d8c2f56844fc4abc638ea4dc680d64e5ac4f\": container with ID starting with 69777245a48cd0ae8981d2dbd4e3d8c2f56844fc4abc638ea4dc680d64e5ac4f not found: ID does not exist"
Sep 11 17:00:27.044318 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:27.044277    2557 scope.go:117] "RemoveContainer" containerID="3e804ead985683bc70a6024b62586a10bbbebfb45be96ec7fa0fa0c11f6b72b6"
Sep 11 17:00:27.052657 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:27.052639    2557 scope.go:117] "RemoveContainer" containerID="3e804ead985683bc70a6024b62586a10bbbebfb45be96ec7fa0fa0c11f6b72b6"
Sep 11 17:00:27.052944 ip-10-0-134-196 kubenswrapper[2557]: E0911 17:00:27.052923    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e804ead985683bc70a6024b62586a10bbbebfb45be96ec7fa0fa0c11f6b72b6\": container with ID starting with 3e804ead985683bc70a6024b62586a10bbbebfb45be96ec7fa0fa0c11f6b72b6 not found: ID does not exist" containerID="3e804ead985683bc70a6024b62586a10bbbebfb45be96ec7fa0fa0c11f6b72b6"
Sep 11 17:00:27.053002 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:27.052952    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e804ead985683bc70a6024b62586a10bbbebfb45be96ec7fa0fa0c11f6b72b6"} err="failed to get container status \"3e804ead985683bc70a6024b62586a10bbbebfb45be96ec7fa0fa0c11f6b72b6\": rpc error: code = NotFound desc = could not find container \"3e804ead985683bc70a6024b62586a10bbbebfb45be96ec7fa0fa0c11f6b72b6\": container with ID starting with 3e804ead985683bc70a6024b62586a10bbbebfb45be96ec7fa0fa0c11f6b72b6 not found: ID does not exist"
Sep 11 17:00:27.059802 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:27.059768    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw"]
Sep 11 17:00:27.062374 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:27.062350    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-ff7416-674b47548b-dcxzw"]
Sep 11 17:00:27.074275 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:27.074248    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc"]
Sep 11 17:00:27.078742 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:27.078716    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-ff7416-68868bc79-5wmhc"]
Sep 11 17:00:28.946579 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:28.946545    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adafb380-7908-49d2-b5a2-c9fc5bb5947d" path="/var/lib/kubelet/pods/adafb380-7908-49d2-b5a2-c9fc5bb5947d/volumes"
Sep 11 17:00:28.946993 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:28.946936    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d30a833c-af8a-4cc1-91b0-7e03823eeda1" path="/var/lib/kubelet/pods/d30a833c-af8a-4cc1-91b0-7e03823eeda1/volumes"
Sep 11 17:00:33.580836 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:33.580799    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"]
Sep 11 17:00:33.581344 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:33.581098    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6" podUID="1fabd1a9-a7c5-4ae9-af94-21402b4fee77" containerName="istio-proxy" containerID="cri-o://732a290f4a0d40ff1630c4bc5fc821c4b3898723465fd4685733331f5a8143fa" gracePeriod=30
Sep 11 17:00:34.029121 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:34.029076    2557 patch_prober.go:28] interesting pod/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 17:00:34.029311 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:34.029154    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6" podUID="1fabd1a9-a7c5-4ae9-af94-21402b4fee77" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 17:00:38.840592 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.840562    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 17:00:38.910677 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.910573    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-podinfo\") pod \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") "
Sep 11 17:00:38.910677 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.910648    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-workload-socket\") pod \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") "
Sep 11 17:00:38.910677 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.910673    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-token\") pod \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") "
Sep 11 17:00:38.911087 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.910688    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istiod-ca-cert\") pod \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") "
Sep 11 17:00:38.911087 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.910742    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-envoy\") pod \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") "
Sep 11 17:00:38.911087 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.910758    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-workload-certs\") pod \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") "
Sep 11 17:00:38.911087 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.910810    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-data\") pod \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") "
Sep 11 17:00:38.911087 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.910827    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-credential-socket\") pod \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") "
Sep 11 17:00:38.911087 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.910849    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d92cl\" (UniqueName: \"kubernetes.io/projected/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-kube-api-access-d92cl\") pod \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\" (UID: \"1fabd1a9-a7c5-4ae9-af94-21402b4fee77\") "
Sep 11 17:00:38.911087 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.911007    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1fabd1a9-a7c5-4ae9-af94-21402b4fee77" (UID: "1fabd1a9-a7c5-4ae9-af94-21402b4fee77"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:00:38.911423 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.911127    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1fabd1a9-a7c5-4ae9-af94-21402b4fee77" (UID: "1fabd1a9-a7c5-4ae9-af94-21402b4fee77"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:00:38.911423 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.911247    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1fabd1a9-a7c5-4ae9-af94-21402b4fee77" (UID: "1fabd1a9-a7c5-4ae9-af94-21402b4fee77"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:00:38.911423 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.911296    2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-workload-socket\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:38.911423 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.911316    2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istiod-ca-cert\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:38.911423 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.911319    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1fabd1a9-a7c5-4ae9-af94-21402b4fee77" (UID: "1fabd1a9-a7c5-4ae9-af94-21402b4fee77"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:00:38.911423 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.911366    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-data" (OuterVolumeSpecName: "istio-data") pod "1fabd1a9-a7c5-4ae9-af94-21402b4fee77" (UID: "1fabd1a9-a7c5-4ae9-af94-21402b4fee77"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:00:38.912879 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.912852    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-token" (OuterVolumeSpecName: "istio-token") pod "1fabd1a9-a7c5-4ae9-af94-21402b4fee77" (UID: "1fabd1a9-a7c5-4ae9-af94-21402b4fee77"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:00:38.913053 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.913035    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-kube-api-access-d92cl" (OuterVolumeSpecName: "kube-api-access-d92cl") pod "1fabd1a9-a7c5-4ae9-af94-21402b4fee77" (UID: "1fabd1a9-a7c5-4ae9-af94-21402b4fee77"). InnerVolumeSpecName "kube-api-access-d92cl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:00:38.913251 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.913226    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1fabd1a9-a7c5-4ae9-af94-21402b4fee77" (UID: "1fabd1a9-a7c5-4ae9-af94-21402b4fee77"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:00:38.913344 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:38.913250    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1fabd1a9-a7c5-4ae9-af94-21402b4fee77" (UID: "1fabd1a9-a7c5-4ae9-af94-21402b4fee77"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 17:00:39.012058 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:39.012021    2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-data\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:39.012231 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:39.012062    2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-credential-socket\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:39.012231 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:39.012080    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d92cl\" (UniqueName: \"kubernetes.io/projected/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-kube-api-access-d92cl\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:39.012231 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:39.012097    2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-podinfo\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:39.012231 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:39.012113    2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-token\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:39.012231 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:39.012126    2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-istio-envoy\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:39.012231 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:39.012140    2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1fabd1a9-a7c5-4ae9-af94-21402b4fee77-workload-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:39.103839 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:39.103799    2557 generic.go:356] "Generic (PLEG): container finished" podID="1fabd1a9-a7c5-4ae9-af94-21402b4fee77" containerID="732a290f4a0d40ff1630c4bc5fc821c4b3898723465fd4685733331f5a8143fa" exitCode=0
Sep 11 17:00:39.104026 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:39.103860    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"
Sep 11 17:00:39.104026 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:39.103882    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6" event={"ID":"1fabd1a9-a7c5-4ae9-af94-21402b4fee77","Type":"ContainerDied","Data":"732a290f4a0d40ff1630c4bc5fc821c4b3898723465fd4685733331f5a8143fa"}
Sep 11 17:00:39.104026 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:39.103939    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6" event={"ID":"1fabd1a9-a7c5-4ae9-af94-21402b4fee77","Type":"ContainerDied","Data":"4945a334652c2dd8ac8f6fb05ac673c878bcf62a2f703dcdc6cfb5c6ce093a6e"}
Sep 11 17:00:39.104026 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:39.103963    2557 scope.go:117] "RemoveContainer" containerID="732a290f4a0d40ff1630c4bc5fc821c4b3898723465fd4685733331f5a8143fa"
Sep 11 17:00:39.112806 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:39.112781    2557 scope.go:117] "RemoveContainer" containerID="3a47608138a5292aee64f16fa138e02a35169883bd4cea26bb63d3f8ba4b089f"
Sep 11 17:00:39.121217 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:39.121198    2557 scope.go:117] "RemoveContainer" containerID="732a290f4a0d40ff1630c4bc5fc821c4b3898723465fd4685733331f5a8143fa"
Sep 11 17:00:39.121506 ip-10-0-134-196 kubenswrapper[2557]: E0911 17:00:39.121485    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"732a290f4a0d40ff1630c4bc5fc821c4b3898723465fd4685733331f5a8143fa\": container with ID starting with 732a290f4a0d40ff1630c4bc5fc821c4b3898723465fd4685733331f5a8143fa not found: ID does not exist" containerID="732a290f4a0d40ff1630c4bc5fc821c4b3898723465fd4685733331f5a8143fa"
Sep 11 17:00:39.121575 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:39.121516    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"732a290f4a0d40ff1630c4bc5fc821c4b3898723465fd4685733331f5a8143fa"} err="failed to get container status \"732a290f4a0d40ff1630c4bc5fc821c4b3898723465fd4685733331f5a8143fa\": rpc error: code = NotFound desc = could not find container \"732a290f4a0d40ff1630c4bc5fc821c4b3898723465fd4685733331f5a8143fa\": container with ID starting with 732a290f4a0d40ff1630c4bc5fc821c4b3898723465fd4685733331f5a8143fa not found: ID does not exist"
Sep 11 17:00:39.121575 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:39.121535    2557 scope.go:117] "RemoveContainer" containerID="3a47608138a5292aee64f16fa138e02a35169883bd4cea26bb63d3f8ba4b089f"
Sep 11 17:00:39.121822 ip-10-0-134-196 kubenswrapper[2557]: E0911 17:00:39.121802    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a47608138a5292aee64f16fa138e02a35169883bd4cea26bb63d3f8ba4b089f\": container with ID starting with 3a47608138a5292aee64f16fa138e02a35169883bd4cea26bb63d3f8ba4b089f not found: ID does not exist" containerID="3a47608138a5292aee64f16fa138e02a35169883bd4cea26bb63d3f8ba4b089f"
Sep 11 17:00:39.121864 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:39.121829    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a47608138a5292aee64f16fa138e02a35169883bd4cea26bb63d3f8ba4b089f"} err="failed to get container status \"3a47608138a5292aee64f16fa138e02a35169883bd4cea26bb63d3f8ba4b089f\": rpc error: code = NotFound desc = could not find container \"3a47608138a5292aee64f16fa138e02a35169883bd4cea26bb63d3f8ba4b089f\": container with ID starting with 3a47608138a5292aee64f16fa138e02a35169883bd4cea26bb63d3f8ba4b089f not found: ID does not exist"
Sep 11 17:00:39.127389 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:39.127367    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"]
Sep 11 17:00:39.132965 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:39.132937    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-ff7416-openshift-default-74bdb8884d-qj8t6"]
Sep 11 17:00:40.952500 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:40.952458    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fabd1a9-a7c5-4ae9-af94-21402b4fee77" path="/var/lib/kubelet/pods/1fabd1a9-a7c5-4ae9-af94-21402b4fee77/volumes"
Sep 11 17:00:44.501953 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:44.501914    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"]
Sep 11 17:00:44.502444 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:44.502208    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq" podUID="6d4ab71e-5ae6-47bd-a936-459584037f85" containerName="maas-api" containerID="cri-o://45bd2c1e62172467b211779d3f8c9a173c0b8889cee4831e004fd2725343f64e" gracePeriod=30
Sep 11 17:00:44.763813 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:44.763784    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"
Sep 11 17:00:44.865176 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:44.865140    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d4ab71e-5ae6-47bd-a936-459584037f85-maas-api-tls\") pod \"6d4ab71e-5ae6-47bd-a936-459584037f85\" (UID: \"6d4ab71e-5ae6-47bd-a936-459584037f85\") "
Sep 11 17:00:44.865353 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:44.865249    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d4ab71e-5ae6-47bd-a936-459584037f85-openshift-service-ca\") pod \"6d4ab71e-5ae6-47bd-a936-459584037f85\" (UID: \"6d4ab71e-5ae6-47bd-a936-459584037f85\") "
Sep 11 17:00:44.865353 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:44.865266    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4ab71e-5ae6-47bd-a936-459584037f85-metrics-certs\") pod \"6d4ab71e-5ae6-47bd-a936-459584037f85\" (UID: \"6d4ab71e-5ae6-47bd-a936-459584037f85\") "
Sep 11 17:00:44.865353 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:44.865285    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knzl7\" (UniqueName: \"kubernetes.io/projected/6d4ab71e-5ae6-47bd-a936-459584037f85-kube-api-access-knzl7\") pod \"6d4ab71e-5ae6-47bd-a936-459584037f85\" (UID: \"6d4ab71e-5ae6-47bd-a936-459584037f85\") "
Sep 11 17:00:44.865677 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:44.865648    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d4ab71e-5ae6-47bd-a936-459584037f85-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6d4ab71e-5ae6-47bd-a936-459584037f85" (UID: "6d4ab71e-5ae6-47bd-a936-459584037f85"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:00:44.867532 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:44.867506    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d4ab71e-5ae6-47bd-a936-459584037f85-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6d4ab71e-5ae6-47bd-a936-459584037f85" (UID: "6d4ab71e-5ae6-47bd-a936-459584037f85"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:00:44.867532 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:44.867522    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d4ab71e-5ae6-47bd-a936-459584037f85-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6d4ab71e-5ae6-47bd-a936-459584037f85" (UID: "6d4ab71e-5ae6-47bd-a936-459584037f85"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:00:44.867711 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:44.867521    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d4ab71e-5ae6-47bd-a936-459584037f85-kube-api-access-knzl7" (OuterVolumeSpecName: "kube-api-access-knzl7") pod "6d4ab71e-5ae6-47bd-a936-459584037f85" (UID: "6d4ab71e-5ae6-47bd-a936-459584037f85"). InnerVolumeSpecName "kube-api-access-knzl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:00:44.966571 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:44.966533    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d4ab71e-5ae6-47bd-a936-459584037f85-maas-api-tls\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:44.966571 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:44.966565    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d4ab71e-5ae6-47bd-a936-459584037f85-openshift-service-ca\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:44.966571 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:44.966576    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d4ab71e-5ae6-47bd-a936-459584037f85-metrics-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:44.966840 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:44.966585    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knzl7\" (UniqueName: \"kubernetes.io/projected/6d4ab71e-5ae6-47bd-a936-459584037f85-kube-api-access-knzl7\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:45.137951 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:45.137857    2557 generic.go:356] "Generic (PLEG): container finished" podID="6d4ab71e-5ae6-47bd-a936-459584037f85" containerID="45bd2c1e62172467b211779d3f8c9a173c0b8889cee4831e004fd2725343f64e" exitCode=0
Sep 11 17:00:45.137951 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:45.137901    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"
Sep 11 17:00:45.137951 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:45.137937    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq" event={"ID":"6d4ab71e-5ae6-47bd-a936-459584037f85","Type":"ContainerDied","Data":"45bd2c1e62172467b211779d3f8c9a173c0b8889cee4831e004fd2725343f64e"}
Sep 11 17:00:45.138225 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:45.137992    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq" event={"ID":"6d4ab71e-5ae6-47bd-a936-459584037f85","Type":"ContainerDied","Data":"bca34d332467184425f6718984e672f38875d93051d89ca24c0a5b603e7dd963"}
Sep 11 17:00:45.138225 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:45.138016    2557 scope.go:117] "RemoveContainer" containerID="45bd2c1e62172467b211779d3f8c9a173c0b8889cee4831e004fd2725343f64e"
Sep 11 17:00:45.148399 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:45.148378    2557 scope.go:117] "RemoveContainer" containerID="45bd2c1e62172467b211779d3f8c9a173c0b8889cee4831e004fd2725343f64e"
Sep 11 17:00:45.148687 ip-10-0-134-196 kubenswrapper[2557]: E0911 17:00:45.148668    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45bd2c1e62172467b211779d3f8c9a173c0b8889cee4831e004fd2725343f64e\": container with ID starting with 45bd2c1e62172467b211779d3f8c9a173c0b8889cee4831e004fd2725343f64e not found: ID does not exist" containerID="45bd2c1e62172467b211779d3f8c9a173c0b8889cee4831e004fd2725343f64e"
Sep 11 17:00:45.148737 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:45.148697    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45bd2c1e62172467b211779d3f8c9a173c0b8889cee4831e004fd2725343f64e"} err="failed to get container status \"45bd2c1e62172467b211779d3f8c9a173c0b8889cee4831e004fd2725343f64e\": rpc error: code = NotFound desc = could not find container \"45bd2c1e62172467b211779d3f8c9a173c0b8889cee4831e004fd2725343f64e\": container with ID starting with 45bd2c1e62172467b211779d3f8c9a173c0b8889cee4831e004fd2725343f64e not found: ID does not exist"
Sep 11 17:00:45.156898 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:45.156865    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"]
Sep 11 17:00:45.161831 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:45.161806    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-ce902a-5df746c8b-gdddq"]
Sep 11 17:00:46.945840 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:46.945796    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d4ab71e-5ae6-47bd-a936-459584037f85" path="/var/lib/kubelet/pods/6d4ab71e-5ae6-47bd-a936-459584037f85/volumes"
Sep 11 17:00:54.462712 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:54.462676    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78c795f5ff-tj5wx"]
Sep 11 17:00:54.463219 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:54.462922    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-78c795f5ff-tj5wx" podUID="59190f43-195f-413e-9797-180f8c1c9e2a" containerName="manager" containerID="cri-o://a8adbcd4222605ec1e5ec4ff250ab696c3891e81e4baa686740bc73c77687a7a" gracePeriod=30
Sep 11 17:00:54.714062 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:54.714000    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78c795f5ff-tj5wx"
Sep 11 17:00:54.754080 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:54.754050    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pc7gd\" (UniqueName: \"kubernetes.io/projected/59190f43-195f-413e-9797-180f8c1c9e2a-kube-api-access-pc7gd\") pod \"59190f43-195f-413e-9797-180f8c1c9e2a\" (UID: \"59190f43-195f-413e-9797-180f8c1c9e2a\") "
Sep 11 17:00:54.754262 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:54.754093    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59190f43-195f-413e-9797-180f8c1c9e2a-webhook-cert\") pod \"59190f43-195f-413e-9797-180f8c1c9e2a\" (UID: \"59190f43-195f-413e-9797-180f8c1c9e2a\") "
Sep 11 17:00:54.754262 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:54.754131    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59190f43-195f-413e-9797-180f8c1c9e2a-metrics-certs\") pod \"59190f43-195f-413e-9797-180f8c1c9e2a\" (UID: \"59190f43-195f-413e-9797-180f8c1c9e2a\") "
Sep 11 17:00:54.756366 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:54.756338    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59190f43-195f-413e-9797-180f8c1c9e2a-kube-api-access-pc7gd" (OuterVolumeSpecName: "kube-api-access-pc7gd") pod "59190f43-195f-413e-9797-180f8c1c9e2a" (UID: "59190f43-195f-413e-9797-180f8c1c9e2a"). InnerVolumeSpecName "kube-api-access-pc7gd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:00:54.756676 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:54.756644    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59190f43-195f-413e-9797-180f8c1c9e2a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "59190f43-195f-413e-9797-180f8c1c9e2a" (UID: "59190f43-195f-413e-9797-180f8c1c9e2a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:00:54.756676 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:54.756659    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59190f43-195f-413e-9797-180f8c1c9e2a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "59190f43-195f-413e-9797-180f8c1c9e2a" (UID: "59190f43-195f-413e-9797-180f8c1c9e2a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:00:54.855440 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:54.855395    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pc7gd\" (UniqueName: \"kubernetes.io/projected/59190f43-195f-413e-9797-180f8c1c9e2a-kube-api-access-pc7gd\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:54.855440 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:54.855432    2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59190f43-195f-413e-9797-180f8c1c9e2a-webhook-cert\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:54.855440 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:54.855442    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59190f43-195f-413e-9797-180f8c1c9e2a-metrics-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:00:55.193752 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:55.193715    2557 generic.go:356] "Generic (PLEG): container finished" podID="59190f43-195f-413e-9797-180f8c1c9e2a" containerID="a8adbcd4222605ec1e5ec4ff250ab696c3891e81e4baa686740bc73c77687a7a" exitCode=0
Sep 11 17:00:55.193939 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:55.193772    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78c795f5ff-tj5wx"
Sep 11 17:00:55.193939 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:55.193797    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78c795f5ff-tj5wx" event={"ID":"59190f43-195f-413e-9797-180f8c1c9e2a","Type":"ContainerDied","Data":"a8adbcd4222605ec1e5ec4ff250ab696c3891e81e4baa686740bc73c77687a7a"}
Sep 11 17:00:55.193939 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:55.193879    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78c795f5ff-tj5wx" event={"ID":"59190f43-195f-413e-9797-180f8c1c9e2a","Type":"ContainerDied","Data":"6e81fbefeeb04e79481c20556c461b72f9cfb609549d8d8e28a98834c3e1f613"}
Sep 11 17:00:55.193939 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:55.193903    2557 scope.go:117] "RemoveContainer" containerID="a8adbcd4222605ec1e5ec4ff250ab696c3891e81e4baa686740bc73c77687a7a"
Sep 11 17:00:55.203540 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:55.203519    2557 scope.go:117] "RemoveContainer" containerID="a8adbcd4222605ec1e5ec4ff250ab696c3891e81e4baa686740bc73c77687a7a"
Sep 11 17:00:55.203833 ip-10-0-134-196 kubenswrapper[2557]: E0911 17:00:55.203816    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8adbcd4222605ec1e5ec4ff250ab696c3891e81e4baa686740bc73c77687a7a\": container with ID starting with a8adbcd4222605ec1e5ec4ff250ab696c3891e81e4baa686740bc73c77687a7a not found: ID does not exist" containerID="a8adbcd4222605ec1e5ec4ff250ab696c3891e81e4baa686740bc73c77687a7a"
Sep 11 17:00:55.203911 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:55.203840    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8adbcd4222605ec1e5ec4ff250ab696c3891e81e4baa686740bc73c77687a7a"} err="failed to get container status \"a8adbcd4222605ec1e5ec4ff250ab696c3891e81e4baa686740bc73c77687a7a\": rpc error: code = NotFound desc = could not find container \"a8adbcd4222605ec1e5ec4ff250ab696c3891e81e4baa686740bc73c77687a7a\": container with ID starting with a8adbcd4222605ec1e5ec4ff250ab696c3891e81e4baa686740bc73c77687a7a not found: ID does not exist"
Sep 11 17:00:55.213851 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:55.213826    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78c795f5ff-tj5wx"]
Sep 11 17:00:55.218649 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:55.218623    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-78c795f5ff-tj5wx"]
Sep 11 17:00:56.946127 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:00:56.946089    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59190f43-195f-413e-9797-180f8c1c9e2a" path="/var/lib/kubelet/pods/59190f43-195f-413e-9797-180f8c1c9e2a/volumes"
Sep 11 17:01:56.018844 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.018799    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78c795f5ff-mggn9"]
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019143    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adafb380-7908-49d2-b5a2-c9fc5bb5947d" containerName="payload-pre-processing"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019154    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="adafb380-7908-49d2-b5a2-c9fc5bb5947d" containerName="payload-pre-processing"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019168    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="978c3f52-9d01-4bbf-a221-e56079a8a418" containerName="payload-pre-processing"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019175    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="978c3f52-9d01-4bbf-a221-e56079a8a418" containerName="payload-pre-processing"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019182    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c0d8d32-77cd-4fc2-afb8-f79f621ca6be" containerName="maas-api"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019187    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c0d8d32-77cd-4fc2-afb8-f79f621ca6be" containerName="maas-api"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019197    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d4ab71e-5ae6-47bd-a936-459584037f85" containerName="maas-api"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019202    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d4ab71e-5ae6-47bd-a936-459584037f85" containerName="maas-api"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019211    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fabd1a9-a7c5-4ae9-af94-21402b4fee77" containerName="istio-proxy"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019216    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fabd1a9-a7c5-4ae9-af94-21402b4fee77" containerName="istio-proxy"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019223    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fabd1a9-a7c5-4ae9-af94-21402b4fee77" containerName="istio-proxy"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019228    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fabd1a9-a7c5-4ae9-af94-21402b4fee77" containerName="istio-proxy"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019234    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d30a833c-af8a-4cc1-91b0-7e03823eeda1" containerName="payload-processing"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019240    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d30a833c-af8a-4cc1-91b0-7e03823eeda1" containerName="payload-processing"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019249    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59190f43-195f-413e-9797-180f8c1c9e2a" containerName="manager"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019256    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="59190f43-195f-413e-9797-180f8c1c9e2a" containerName="manager"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019261    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a763300c-be16-4f26-bd1d-1c35d009a09b" containerName="maas-api"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019266    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a763300c-be16-4f26-bd1d-1c35d009a09b" containerName="maas-api"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019274    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49cde7b7-2aa3-4bec-8230-74c81647f815" containerName="payload-pre-processing"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019279    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="49cde7b7-2aa3-4bec-8230-74c81647f815" containerName="payload-pre-processing"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019325    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fabd1a9-a7c5-4ae9-af94-21402b4fee77" containerName="istio-proxy"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019333    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d4ab71e-5ae6-47bd-a936-459584037f85" containerName="maas-api"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019339    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="adafb380-7908-49d2-b5a2-c9fc5bb5947d" containerName="payload-pre-processing"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019345    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="49cde7b7-2aa3-4bec-8230-74c81647f815" containerName="payload-pre-processing"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019352    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="59190f43-195f-413e-9797-180f8c1c9e2a" containerName="manager"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019358    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a763300c-be16-4f26-bd1d-1c35d009a09b" containerName="maas-api"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019363    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d30a833c-af8a-4cc1-91b0-7e03823eeda1" containerName="payload-processing"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019369    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="978c3f52-9d01-4bbf-a221-e56079a8a418" containerName="payload-pre-processing"
Sep 11 17:01:56.019368 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.019376    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c0d8d32-77cd-4fc2-afb8-f79f621ca6be" containerName="maas-api"
Sep 11 17:01:56.022849 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.022826    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78c795f5ff-mggn9"
Sep 11 17:01:56.026830 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.026805    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 17:01:56.026830 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.026823    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cg4jx\""
Sep 11 17:01:56.027035 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.026851    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 17:01:56.027035 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.026874    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 17:01:56.036479 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.036450    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78c795f5ff-mggn9"]
Sep 11 17:01:56.092751 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.092704    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/caec5ddf-fa72-4b33-9247-5becb378263f-webhook-cert\") pod \"maas-controller-78c795f5ff-mggn9\" (UID: \"caec5ddf-fa72-4b33-9247-5becb378263f\") " pod="opendatahub/maas-controller-78c795f5ff-mggn9"
Sep 11 17:01:56.092951 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.092878    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw4p9\" (UniqueName: \"kubernetes.io/projected/caec5ddf-fa72-4b33-9247-5becb378263f-kube-api-access-dw4p9\") pod \"maas-controller-78c795f5ff-mggn9\" (UID: \"caec5ddf-fa72-4b33-9247-5becb378263f\") " pod="opendatahub/maas-controller-78c795f5ff-mggn9"
Sep 11 17:01:56.092951 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.092923    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caec5ddf-fa72-4b33-9247-5becb378263f-metrics-certs\") pod \"maas-controller-78c795f5ff-mggn9\" (UID: \"caec5ddf-fa72-4b33-9247-5becb378263f\") " pod="opendatahub/maas-controller-78c795f5ff-mggn9"
Sep 11 17:01:56.194064 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.194011    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/caec5ddf-fa72-4b33-9247-5becb378263f-webhook-cert\") pod \"maas-controller-78c795f5ff-mggn9\" (UID: \"caec5ddf-fa72-4b33-9247-5becb378263f\") " pod="opendatahub/maas-controller-78c795f5ff-mggn9"
Sep 11 17:01:56.194288 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.194145    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw4p9\" (UniqueName: \"kubernetes.io/projected/caec5ddf-fa72-4b33-9247-5becb378263f-kube-api-access-dw4p9\") pod \"maas-controller-78c795f5ff-mggn9\" (UID: \"caec5ddf-fa72-4b33-9247-5becb378263f\") " pod="opendatahub/maas-controller-78c795f5ff-mggn9"
Sep 11 17:01:56.194288 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.194188    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caec5ddf-fa72-4b33-9247-5becb378263f-metrics-certs\") pod \"maas-controller-78c795f5ff-mggn9\" (UID: \"caec5ddf-fa72-4b33-9247-5becb378263f\") " pod="opendatahub/maas-controller-78c795f5ff-mggn9"
Sep 11 17:01:56.196505 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.196477    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caec5ddf-fa72-4b33-9247-5becb378263f-metrics-certs\") pod \"maas-controller-78c795f5ff-mggn9\" (UID: \"caec5ddf-fa72-4b33-9247-5becb378263f\") " pod="opendatahub/maas-controller-78c795f5ff-mggn9"
Sep 11 17:01:56.196638 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.196565    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/caec5ddf-fa72-4b33-9247-5becb378263f-webhook-cert\") pod \"maas-controller-78c795f5ff-mggn9\" (UID: \"caec5ddf-fa72-4b33-9247-5becb378263f\") " pod="opendatahub/maas-controller-78c795f5ff-mggn9"
Sep 11 17:01:56.204133 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.204113    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw4p9\" (UniqueName: \"kubernetes.io/projected/caec5ddf-fa72-4b33-9247-5becb378263f-kube-api-access-dw4p9\") pod \"maas-controller-78c795f5ff-mggn9\" (UID: \"caec5ddf-fa72-4b33-9247-5becb378263f\") " pod="opendatahub/maas-controller-78c795f5ff-mggn9"
Sep 11 17:01:56.333254 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.333163    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78c795f5ff-mggn9"
Sep 11 17:01:56.606456 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:56.606430    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78c795f5ff-mggn9"]
Sep 11 17:01:56.608131 ip-10-0-134-196 kubenswrapper[2557]: W0911 17:01:56.608102    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaec5ddf_fa72_4b33_9247_5becb378263f.slice/crio-9c53fd8a59ed76c9d2a80593dfa99ca27b2dc61cac06b63e473c2253338d078a WatchSource:0}: Error finding container 9c53fd8a59ed76c9d2a80593dfa99ca27b2dc61cac06b63e473c2253338d078a: Status 404 returned error can't find the container with id 9c53fd8a59ed76c9d2a80593dfa99ca27b2dc61cac06b63e473c2253338d078a
Sep 11 17:01:57.530142 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:57.530103    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78c795f5ff-mggn9" event={"ID":"caec5ddf-fa72-4b33-9247-5becb378263f","Type":"ContainerStarted","Data":"463a9990d278f1280d90ecf1d48a2138335e20179c2c96f4bb3447178e24f8d4"}
Sep 11 17:01:57.530668 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:57.530199    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78c795f5ff-mggn9" event={"ID":"caec5ddf-fa72-4b33-9247-5becb378263f","Type":"ContainerStarted","Data":"9c53fd8a59ed76c9d2a80593dfa99ca27b2dc61cac06b63e473c2253338d078a"}
Sep 11 17:01:57.530668 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:57.530241    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78c795f5ff-mggn9"
Sep 11 17:01:57.553504 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:01:57.553451    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-78c795f5ff-mggn9" podStartSLOduration=1.18605501 podStartE2EDuration="1.553434967s" totalImagesPullingTime="367.379957ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:01:57.552407775 +0000 UTC m=+1937.170681948" watchObservedRunningTime="2026-09-11 17:01:57.553434967 +0000 UTC m=+1937.171709197"
Sep 11 17:02:08.538472 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:08.538435    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78c795f5ff-mggn9"
Sep 11 17:02:17.870012 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:17.869972    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78c795f5ff-mggn9"]
Sep 11 17:02:17.870554 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:17.870240    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-78c795f5ff-mggn9" podUID="caec5ddf-fa72-4b33-9247-5becb378263f" containerName="manager" containerID="cri-o://463a9990d278f1280d90ecf1d48a2138335e20179c2c96f4bb3447178e24f8d4" gracePeriod=30
Sep 11 17:02:18.119043 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.119008    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78c795f5ff-mggn9"
Sep 11 17:02:18.189545 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.189445    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw4p9\" (UniqueName: \"kubernetes.io/projected/caec5ddf-fa72-4b33-9247-5becb378263f-kube-api-access-dw4p9\") pod \"caec5ddf-fa72-4b33-9247-5becb378263f\" (UID: \"caec5ddf-fa72-4b33-9247-5becb378263f\") "
Sep 11 17:02:18.189545 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.189523    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/caec5ddf-fa72-4b33-9247-5becb378263f-webhook-cert\") pod \"caec5ddf-fa72-4b33-9247-5becb378263f\" (UID: \"caec5ddf-fa72-4b33-9247-5becb378263f\") "
Sep 11 17:02:18.189804 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.189554    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caec5ddf-fa72-4b33-9247-5becb378263f-metrics-certs\") pod \"caec5ddf-fa72-4b33-9247-5becb378263f\" (UID: \"caec5ddf-fa72-4b33-9247-5becb378263f\") "
Sep 11 17:02:18.192311 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.192264    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caec5ddf-fa72-4b33-9247-5becb378263f-kube-api-access-dw4p9" (OuterVolumeSpecName: "kube-api-access-dw4p9") pod "caec5ddf-fa72-4b33-9247-5becb378263f" (UID: "caec5ddf-fa72-4b33-9247-5becb378263f"). InnerVolumeSpecName "kube-api-access-dw4p9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:02:18.192467 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.192419    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caec5ddf-fa72-4b33-9247-5becb378263f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "caec5ddf-fa72-4b33-9247-5becb378263f" (UID: "caec5ddf-fa72-4b33-9247-5becb378263f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:02:18.192555 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.192537    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caec5ddf-fa72-4b33-9247-5becb378263f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "caec5ddf-fa72-4b33-9247-5becb378263f" (UID: "caec5ddf-fa72-4b33-9247-5becb378263f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:02:18.290559 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.290507    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw4p9\" (UniqueName: \"kubernetes.io/projected/caec5ddf-fa72-4b33-9247-5becb378263f-kube-api-access-dw4p9\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:02:18.290559 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.290558    2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/caec5ddf-fa72-4b33-9247-5becb378263f-webhook-cert\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:02:18.290798 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.290574    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caec5ddf-fa72-4b33-9247-5becb378263f-metrics-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:02:18.644730 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.644691    2557 generic.go:356] "Generic (PLEG): container finished" podID="caec5ddf-fa72-4b33-9247-5becb378263f" containerID="463a9990d278f1280d90ecf1d48a2138335e20179c2c96f4bb3447178e24f8d4" exitCode=0
Sep 11 17:02:18.644919 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.644752    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78c795f5ff-mggn9"
Sep 11 17:02:18.644919 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.644778    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78c795f5ff-mggn9" event={"ID":"caec5ddf-fa72-4b33-9247-5becb378263f","Type":"ContainerDied","Data":"463a9990d278f1280d90ecf1d48a2138335e20179c2c96f4bb3447178e24f8d4"}
Sep 11 17:02:18.644919 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.644835    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78c795f5ff-mggn9" event={"ID":"caec5ddf-fa72-4b33-9247-5becb378263f","Type":"ContainerDied","Data":"9c53fd8a59ed76c9d2a80593dfa99ca27b2dc61cac06b63e473c2253338d078a"}
Sep 11 17:02:18.644919 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.644857    2557 scope.go:117] "RemoveContainer" containerID="463a9990d278f1280d90ecf1d48a2138335e20179c2c96f4bb3447178e24f8d4"
Sep 11 17:02:18.654506 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.654482    2557 scope.go:117] "RemoveContainer" containerID="463a9990d278f1280d90ecf1d48a2138335e20179c2c96f4bb3447178e24f8d4"
Sep 11 17:02:18.654837 ip-10-0-134-196 kubenswrapper[2557]: E0911 17:02:18.654816    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"463a9990d278f1280d90ecf1d48a2138335e20179c2c96f4bb3447178e24f8d4\": container with ID starting with 463a9990d278f1280d90ecf1d48a2138335e20179c2c96f4bb3447178e24f8d4 not found: ID does not exist" containerID="463a9990d278f1280d90ecf1d48a2138335e20179c2c96f4bb3447178e24f8d4"
Sep 11 17:02:18.654903 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.654846    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"463a9990d278f1280d90ecf1d48a2138335e20179c2c96f4bb3447178e24f8d4"} err="failed to get container status \"463a9990d278f1280d90ecf1d48a2138335e20179c2c96f4bb3447178e24f8d4\": rpc error: code = NotFound desc = could not find container \"463a9990d278f1280d90ecf1d48a2138335e20179c2c96f4bb3447178e24f8d4\": container with ID starting with 463a9990d278f1280d90ecf1d48a2138335e20179c2c96f4bb3447178e24f8d4 not found: ID does not exist"
Sep 11 17:02:18.668092 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.668061    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78c795f5ff-mggn9"]
Sep 11 17:02:18.676003 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.675978    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-78c795f5ff-mggn9"]
Sep 11 17:02:18.945854 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:18.945756    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caec5ddf-fa72-4b33-9247-5becb378263f" path="/var/lib/kubelet/pods/caec5ddf-fa72-4b33-9247-5becb378263f/volumes"
Sep 11 17:02:19.446363 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.446326    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78c795f5ff-6pwvc"]
Sep 11 17:02:19.446706 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.446693    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caec5ddf-fa72-4b33-9247-5becb378263f" containerName="manager"
Sep 11 17:02:19.446768 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.446708    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="caec5ddf-fa72-4b33-9247-5becb378263f" containerName="manager"
Sep 11 17:02:19.446810 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.446774    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fabd1a9-a7c5-4ae9-af94-21402b4fee77" containerName="istio-proxy"
Sep 11 17:02:19.446810 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.446785    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="caec5ddf-fa72-4b33-9247-5becb378263f" containerName="manager"
Sep 11 17:02:19.451136 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.451112    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78c795f5ff-6pwvc"
Sep 11 17:02:19.454944 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.454912    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 17:02:19.454944 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.454920    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 17:02:19.455156 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.454976    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 17:02:19.455156 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.455065    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cg4jx\""
Sep 11 17:02:19.465593 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.465569    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78c795f5ff-6pwvc"]
Sep 11 17:02:19.602473 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.602434    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14efbacd-d118-4a00-92b4-353b5980d0f0-webhook-cert\") pod \"maas-controller-78c795f5ff-6pwvc\" (UID: \"14efbacd-d118-4a00-92b4-353b5980d0f0\") " pod="opendatahub/maas-controller-78c795f5ff-6pwvc"
Sep 11 17:02:19.602473 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.602478    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzddr\" (UniqueName: \"kubernetes.io/projected/14efbacd-d118-4a00-92b4-353b5980d0f0-kube-api-access-bzddr\") pod \"maas-controller-78c795f5ff-6pwvc\" (UID: \"14efbacd-d118-4a00-92b4-353b5980d0f0\") " pod="opendatahub/maas-controller-78c795f5ff-6pwvc"
Sep 11 17:02:19.602799 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.602644    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14efbacd-d118-4a00-92b4-353b5980d0f0-metrics-certs\") pod \"maas-controller-78c795f5ff-6pwvc\" (UID: \"14efbacd-d118-4a00-92b4-353b5980d0f0\") " pod="opendatahub/maas-controller-78c795f5ff-6pwvc"
Sep 11 17:02:19.703810 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.703709    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14efbacd-d118-4a00-92b4-353b5980d0f0-webhook-cert\") pod \"maas-controller-78c795f5ff-6pwvc\" (UID: \"14efbacd-d118-4a00-92b4-353b5980d0f0\") " pod="opendatahub/maas-controller-78c795f5ff-6pwvc"
Sep 11 17:02:19.703810 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.703761    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzddr\" (UniqueName: \"kubernetes.io/projected/14efbacd-d118-4a00-92b4-353b5980d0f0-kube-api-access-bzddr\") pod \"maas-controller-78c795f5ff-6pwvc\" (UID: \"14efbacd-d118-4a00-92b4-353b5980d0f0\") " pod="opendatahub/maas-controller-78c795f5ff-6pwvc"
Sep 11 17:02:19.704062 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.703867    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14efbacd-d118-4a00-92b4-353b5980d0f0-metrics-certs\") pod \"maas-controller-78c795f5ff-6pwvc\" (UID: \"14efbacd-d118-4a00-92b4-353b5980d0f0\") " pod="opendatahub/maas-controller-78c795f5ff-6pwvc"
Sep 11 17:02:19.706298 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.706265    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/14efbacd-d118-4a00-92b4-353b5980d0f0-metrics-certs\") pod \"maas-controller-78c795f5ff-6pwvc\" (UID: \"14efbacd-d118-4a00-92b4-353b5980d0f0\") " pod="opendatahub/maas-controller-78c795f5ff-6pwvc"
Sep 11 17:02:19.706424 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.706315    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14efbacd-d118-4a00-92b4-353b5980d0f0-webhook-cert\") pod \"maas-controller-78c795f5ff-6pwvc\" (UID: \"14efbacd-d118-4a00-92b4-353b5980d0f0\") " pod="opendatahub/maas-controller-78c795f5ff-6pwvc"
Sep 11 17:02:19.714092 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.714065    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzddr\" (UniqueName: \"kubernetes.io/projected/14efbacd-d118-4a00-92b4-353b5980d0f0-kube-api-access-bzddr\") pod \"maas-controller-78c795f5ff-6pwvc\" (UID: \"14efbacd-d118-4a00-92b4-353b5980d0f0\") " pod="opendatahub/maas-controller-78c795f5ff-6pwvc"
Sep 11 17:02:19.761942 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:19.761899    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78c795f5ff-6pwvc"
Sep 11 17:02:20.039020 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:20.038994    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78c795f5ff-6pwvc"]
Sep 11 17:02:20.039891 ip-10-0-134-196 kubenswrapper[2557]: W0911 17:02:20.039861    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14efbacd_d118_4a00_92b4_353b5980d0f0.slice/crio-b7b0db681eb158e1bd4e295814503cb074bf2596f5f49a7a99e0b7556656f248 WatchSource:0}: Error finding container b7b0db681eb158e1bd4e295814503cb074bf2596f5f49a7a99e0b7556656f248: Status 404 returned error can't find the container with id b7b0db681eb158e1bd4e295814503cb074bf2596f5f49a7a99e0b7556656f248
Sep 11 17:02:20.664588 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:20.664479    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78c795f5ff-6pwvc" event={"ID":"14efbacd-d118-4a00-92b4-353b5980d0f0","Type":"ContainerStarted","Data":"c09cf32cb5b01c9f6a9f80f40ddeb7f1e5965c8f8a9c763f44788b89a1f3db2c"}
Sep 11 17:02:20.664588 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:20.664539    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78c795f5ff-6pwvc" event={"ID":"14efbacd-d118-4a00-92b4-353b5980d0f0","Type":"ContainerStarted","Data":"b7b0db681eb158e1bd4e295814503cb074bf2596f5f49a7a99e0b7556656f248"}
Sep 11 17:02:20.664588 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:20.664560    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78c795f5ff-6pwvc"
Sep 11 17:02:20.698089 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:20.698029    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-78c795f5ff-6pwvc" podStartSLOduration=1.372696289 podStartE2EDuration="1.698014069s" totalImagesPullingTime="325.31778ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:02:20.69637541 +0000 UTC m=+1960.314649580" watchObservedRunningTime="2026-09-11 17:02:20.698014069 +0000 UTC m=+1960.316288239"
Sep 11 17:02:31.671882 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:02:31.671849    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78c795f5ff-6pwvc"
Sep 11 17:05:21.011520 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.011485    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"]
Sep 11 17:05:21.014814 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.014791    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.017838 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.017813    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-d07bc85f-kserve-self-signed-certs\""
Sep 11 17:05:21.029012 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.028981    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"]
Sep 11 17:05:21.144434 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.144351    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-tls-certs\") pod \"e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") " pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.144434 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.144393    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-home\") pod \"e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") " pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.144434 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.144421    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-tmp-dir\") pod \"e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") " pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.144719 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.144554    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-dshm\") pod \"e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") " pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.144719 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.144669    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-model-cache\") pod \"e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") " pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.144719 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.144699    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlg7n\" (UniqueName: \"kubernetes.io/projected/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-kube-api-access-jlg7n\") pod \"e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") " pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.246113 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.246072    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-dshm\") pod \"e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") " pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.246331 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.246135    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-model-cache\") pod \"e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") " pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.246331 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.246154    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlg7n\" (UniqueName: \"kubernetes.io/projected/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-kube-api-access-jlg7n\") pod \"e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") " pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.246331 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.246186    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-tls-certs\") pod \"e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") " pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.246331 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.246207    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-home\") pod \"e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") " pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.246331 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.246224    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-tmp-dir\") pod \"e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") " pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.246692 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.246670    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-model-cache\") pod \"e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") " pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.246766 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.246729    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-tmp-dir\") pod \"e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") " pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.246766 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.246752    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-home\") pod \"e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") " pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.248478 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.248454    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-dshm\") pod \"e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") " pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.248782 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.248761    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-tls-certs\") pod \"e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") " pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.258161 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.258128    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlg7n\" (UniqueName: \"kubernetes.io/projected/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-kube-api-access-jlg7n\") pod \"e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") " pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.325033 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.324995    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:21.602341 ip-10-0-134-196 kubenswrapper[2557]: W0911 17:05:21.602303    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod54cae3ee_74f3_43d2_a8dc_af18c7c5b8c6.slice/crio-b6686339324f7cfad8e5f079bb960a7644cb5e935d3d3c31b0f86fd40f905297 WatchSource:0}: Error finding container b6686339324f7cfad8e5f079bb960a7644cb5e935d3d3c31b0f86fd40f905297: Status 404 returned error can't find the container with id b6686339324f7cfad8e5f079bb960a7644cb5e935d3d3c31b0f86fd40f905297
Sep 11 17:05:21.603232 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.603206    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"]
Sep 11 17:05:21.622595 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:21.622559    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q" event={"ID":"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6","Type":"ContainerStarted","Data":"b6686339324f7cfad8e5f079bb960a7644cb5e935d3d3c31b0f86fd40f905297"}
Sep 11 17:05:22.628933 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:22.628897    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q" event={"ID":"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6","Type":"ContainerStarted","Data":"f0ac8d9a39197879b40724d525de638caea7bad8f6fcf250a3b56db2596be4ff"}
Sep 11 17:05:22.646601 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:22.646542    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q" podStartSLOduration=2.646524621 podStartE2EDuration="2.646524621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:05:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:05:22.645420593 +0000 UTC m=+2142.263694764" watchObservedRunningTime="2026-09-11 17:05:22.646524621 +0000 UTC m=+2142.264798810"
Sep 11 17:05:31.326080 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:31.326045    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:31.326498 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:31.326097    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:31.338527 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:31.338500    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:31.688915 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:31.688816    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:05:47.003385 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:05:47.003289    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"]
Sep 11 17:06:02.022891 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.022844    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q" podUID="54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6" containerName="main" containerID="cri-o://f0ac8d9a39197879b40724d525de638caea7bad8f6fcf250a3b56db2596be4ff" gracePeriod=45
Sep 11 17:06:02.270798 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.270772    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:06:02.317292 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.317200    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlg7n\" (UniqueName: \"kubernetes.io/projected/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-kube-api-access-jlg7n\") pod \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") "
Sep 11 17:06:02.317470 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.317292    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-tmp-dir\") pod \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") "
Sep 11 17:06:02.317470 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.317327    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-model-cache\") pod \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") "
Sep 11 17:06:02.317470 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.317384    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-home\") pod \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") "
Sep 11 17:06:02.317470 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.317437    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-dshm\") pod \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") "
Sep 11 17:06:02.317740 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.317492    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-tls-certs\") pod \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\" (UID: \"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6\") "
Sep 11 17:06:02.317740 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.317619    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6" (UID: "54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:06:02.317879 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.317850    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-tmp-dir\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:06:02.318038 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.318014    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-model-cache" (OuterVolumeSpecName: "model-cache") pod "54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6" (UID: "54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:06:02.318038 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.318027    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-home" (OuterVolumeSpecName: "home") pod "54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6" (UID: "54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:06:02.320142 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.320108    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6" (UID: "54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:06:02.320142 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.320120    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-kube-api-access-jlg7n" (OuterVolumeSpecName: "kube-api-access-jlg7n") pod "54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6" (UID: "54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6"). InnerVolumeSpecName "kube-api-access-jlg7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:06:02.320343 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.320148    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-dshm" (OuterVolumeSpecName: "dshm") pod "54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6" (UID: "54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:06:02.419325 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.419284    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlg7n\" (UniqueName: \"kubernetes.io/projected/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-kube-api-access-jlg7n\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:06:02.419325 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.419319    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-model-cache\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:06:02.419325 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.419329    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-home\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:06:02.419325 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.419336    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-dshm\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:06:02.419634 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.419345    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6-tls-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:06:02.843777 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.843738    2557 generic.go:356] "Generic (PLEG): container finished" podID="54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6" containerID="f0ac8d9a39197879b40724d525de638caea7bad8f6fcf250a3b56db2596be4ff" exitCode=0
Sep 11 17:06:02.843990 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.843789    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"
Sep 11 17:06:02.843990 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.843799    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q" event={"ID":"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6","Type":"ContainerDied","Data":"f0ac8d9a39197879b40724d525de638caea7bad8f6fcf250a3b56db2596be4ff"}
Sep 11 17:06:02.843990 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.843840    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q" event={"ID":"54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6","Type":"ContainerDied","Data":"b6686339324f7cfad8e5f079bb960a7644cb5e935d3d3c31b0f86fd40f905297"}
Sep 11 17:06:02.843990 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.843857    2557 scope.go:117] "RemoveContainer" containerID="f0ac8d9a39197879b40724d525de638caea7bad8f6fcf250a3b56db2596be4ff"
Sep 11 17:06:02.853351 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.853334    2557 scope.go:117] "RemoveContainer" containerID="f0ac8d9a39197879b40724d525de638caea7bad8f6fcf250a3b56db2596be4ff"
Sep 11 17:06:02.853652 ip-10-0-134-196 kubenswrapper[2557]: E0911 17:06:02.853632    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0ac8d9a39197879b40724d525de638caea7bad8f6fcf250a3b56db2596be4ff\": container with ID starting with f0ac8d9a39197879b40724d525de638caea7bad8f6fcf250a3b56db2596be4ff not found: ID does not exist" containerID="f0ac8d9a39197879b40724d525de638caea7bad8f6fcf250a3b56db2596be4ff"
Sep 11 17:06:02.853718 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.853662    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0ac8d9a39197879b40724d525de638caea7bad8f6fcf250a3b56db2596be4ff"} err="failed to get container status \"f0ac8d9a39197879b40724d525de638caea7bad8f6fcf250a3b56db2596be4ff\": rpc error: code = NotFound desc = could not find container \"f0ac8d9a39197879b40724d525de638caea7bad8f6fcf250a3b56db2596be4ff\": container with ID starting with f0ac8d9a39197879b40724d525de638caea7bad8f6fcf250a3b56db2596be4ff not found: ID does not exist"
Sep 11 17:06:02.873371 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.873336    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"]
Sep 11 17:06:02.883715 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.882333    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-d07bc85f-kserve-65b5c9754c-vns4q"]
Sep 11 17:06:02.946045 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:02.946007    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6" path="/var/lib/kubelet/pods/54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6/volumes"
Sep 11 17:06:06.438794 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:06.438762    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk"]
Sep 11 17:06:06.439187 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:06.439105    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6" containerName="main"
Sep 11 17:06:06.439187 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:06.439117    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6" containerName="main"
Sep 11 17:06:06.439187 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:06.439185    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="54cae3ee-74f3-43d2-a8dc-af18c7c5b8c6" containerName="main"
Sep 11 17:06:06.443337 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:06.443311    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk"
Sep 11 17:06:06.453951 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:06.453924    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk"]
Sep 11 17:06:06.557774 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:06.557732    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3279b3c5-9cc6-48c7-919d-a40462478d71-openshift-service-ca\") pod \"maas-api-dbdb6b6cd-8tnwk\" (UID: \"3279b3c5-9cc6-48c7-919d-a40462478d71\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk"
Sep 11 17:06:06.557962 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:06.557784    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjcsf\" (UniqueName: \"kubernetes.io/projected/3279b3c5-9cc6-48c7-919d-a40462478d71-kube-api-access-pjcsf\") pod \"maas-api-dbdb6b6cd-8tnwk\" (UID: \"3279b3c5-9cc6-48c7-919d-a40462478d71\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk"
Sep 11 17:06:06.557962 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:06.557820    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3279b3c5-9cc6-48c7-919d-a40462478d71-maas-api-tls\") pod \"maas-api-dbdb6b6cd-8tnwk\" (UID: \"3279b3c5-9cc6-48c7-919d-a40462478d71\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk"
Sep 11 17:06:06.557962 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:06.557851    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3279b3c5-9cc6-48c7-919d-a40462478d71-metrics-certs\") pod \"maas-api-dbdb6b6cd-8tnwk\" (UID: \"3279b3c5-9cc6-48c7-919d-a40462478d71\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk"
Sep 11 17:06:06.659120 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:06.659067    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3279b3c5-9cc6-48c7-919d-a40462478d71-openshift-service-ca\") pod \"maas-api-dbdb6b6cd-8tnwk\" (UID: \"3279b3c5-9cc6-48c7-919d-a40462478d71\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk"
Sep 11 17:06:06.659120 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:06.659131    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjcsf\" (UniqueName: \"kubernetes.io/projected/3279b3c5-9cc6-48c7-919d-a40462478d71-kube-api-access-pjcsf\") pod \"maas-api-dbdb6b6cd-8tnwk\" (UID: \"3279b3c5-9cc6-48c7-919d-a40462478d71\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk"
Sep 11 17:06:06.659378 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:06.659164    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3279b3c5-9cc6-48c7-919d-a40462478d71-maas-api-tls\") pod \"maas-api-dbdb6b6cd-8tnwk\" (UID: \"3279b3c5-9cc6-48c7-919d-a40462478d71\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk"
Sep 11 17:06:06.659378 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:06.659193    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3279b3c5-9cc6-48c7-919d-a40462478d71-metrics-certs\") pod \"maas-api-dbdb6b6cd-8tnwk\" (UID: \"3279b3c5-9cc6-48c7-919d-a40462478d71\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk"
Sep 11 17:06:06.659755 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:06.659728    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3279b3c5-9cc6-48c7-919d-a40462478d71-openshift-service-ca\") pod \"maas-api-dbdb6b6cd-8tnwk\" (UID: \"3279b3c5-9cc6-48c7-919d-a40462478d71\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk"
Sep 11 17:06:06.662052 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:06.662014    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3279b3c5-9cc6-48c7-919d-a40462478d71-maas-api-tls\") pod \"maas-api-dbdb6b6cd-8tnwk\" (UID: \"3279b3c5-9cc6-48c7-919d-a40462478d71\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk"
Sep 11 17:06:06.662389 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:06.662368    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3279b3c5-9cc6-48c7-919d-a40462478d71-metrics-certs\") pod \"maas-api-dbdb6b6cd-8tnwk\" (UID: \"3279b3c5-9cc6-48c7-919d-a40462478d71\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk"
Sep 11 17:06:06.669224 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:06.669199    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjcsf\" (UniqueName: \"kubernetes.io/projected/3279b3c5-9cc6-48c7-919d-a40462478d71-kube-api-access-pjcsf\") pod \"maas-api-dbdb6b6cd-8tnwk\" (UID: \"3279b3c5-9cc6-48c7-919d-a40462478d71\") " pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk"
Sep 11 17:06:06.755018 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:06.754930    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk"
Sep 11 17:06:07.032348 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:07.032316    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk"]
Sep 11 17:06:07.033591 ip-10-0-134-196 kubenswrapper[2557]: W0911 17:06:07.033560    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3279b3c5_9cc6_48c7_919d_a40462478d71.slice/crio-3c5394f5bbb20d304ff3ce4f37290f6ad37fc3680e83cdbbfb2aee432ce98cc7 WatchSource:0}: Error finding container 3c5394f5bbb20d304ff3ce4f37290f6ad37fc3680e83cdbbfb2aee432ce98cc7: Status 404 returned error can't find the container with id 3c5394f5bbb20d304ff3ce4f37290f6ad37fc3680e83cdbbfb2aee432ce98cc7
Sep 11 17:06:07.034980 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:07.034964    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 17:06:07.873161 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:07.873126    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk" event={"ID":"3279b3c5-9cc6-48c7-919d-a40462478d71","Type":"ContainerStarted","Data":"b81215b1293f2f364bd10e0368db9473ae2b1de67b425890b79fa04a30634db0"}
Sep 11 17:06:07.873643 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:07.873187    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk" event={"ID":"3279b3c5-9cc6-48c7-919d-a40462478d71","Type":"ContainerStarted","Data":"3c5394f5bbb20d304ff3ce4f37290f6ad37fc3680e83cdbbfb2aee432ce98cc7"}
Sep 11 17:06:07.873643 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:07.873230    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk"
Sep 11 17:06:07.893154 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:07.893095    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk" podStartSLOduration=1.435069489 podStartE2EDuration="1.893078652s" totalImagesPullingTime="458.009163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:06:07.89195295 +0000 UTC m=+2187.510227112" watchObservedRunningTime="2026-09-11 17:06:07.893078652 +0000 UTC m=+2187.511352822"
Sep 11 17:06:13.884281 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:13.884249    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-dbdb6b6cd-8tnwk"
Sep 11 17:06:21.442195 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:21.442155    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"]
Sep 11 17:06:21.442686 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:21.442360    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2" podUID="17785b6c-ce85-42c8-af89-813bb255ff79" containerName="maas-api" containerID="cri-o://a9d25a6ce8b45ba1a6a0b710810d752faec7c90d5096cf7b69e74e7b515061ec" gracePeriod=30
Sep 11 17:06:22.597479 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.597436    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2" podUID="17785b6c-ce85-42c8-af89-813bb255ff79" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.45:8443/health\": dial tcp 10.132.0.45:8443: connect: connection refused"
Sep 11 17:06:22.685127 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.685096    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"
Sep 11 17:06:22.813794 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.813701    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17785b6c-ce85-42c8-af89-813bb255ff79-metrics-certs\") pod \"17785b6c-ce85-42c8-af89-813bb255ff79\" (UID: \"17785b6c-ce85-42c8-af89-813bb255ff79\") "
Sep 11 17:06:22.813794 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.813748    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjvpx\" (UniqueName: \"kubernetes.io/projected/17785b6c-ce85-42c8-af89-813bb255ff79-kube-api-access-xjvpx\") pod \"17785b6c-ce85-42c8-af89-813bb255ff79\" (UID: \"17785b6c-ce85-42c8-af89-813bb255ff79\") "
Sep 11 17:06:22.813794 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.813776    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17785b6c-ce85-42c8-af89-813bb255ff79-maas-api-tls\") pod \"17785b6c-ce85-42c8-af89-813bb255ff79\" (UID: \"17785b6c-ce85-42c8-af89-813bb255ff79\") "
Sep 11 17:06:22.814052 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.813878    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17785b6c-ce85-42c8-af89-813bb255ff79-openshift-service-ca\") pod \"17785b6c-ce85-42c8-af89-813bb255ff79\" (UID: \"17785b6c-ce85-42c8-af89-813bb255ff79\") "
Sep 11 17:06:22.814306 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.814280    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17785b6c-ce85-42c8-af89-813bb255ff79-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "17785b6c-ce85-42c8-af89-813bb255ff79" (UID: "17785b6c-ce85-42c8-af89-813bb255ff79"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:06:22.816094 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.816059    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17785b6c-ce85-42c8-af89-813bb255ff79-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "17785b6c-ce85-42c8-af89-813bb255ff79" (UID: "17785b6c-ce85-42c8-af89-813bb255ff79"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:06:22.816245 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.816108    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17785b6c-ce85-42c8-af89-813bb255ff79-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "17785b6c-ce85-42c8-af89-813bb255ff79" (UID: "17785b6c-ce85-42c8-af89-813bb255ff79"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:06:22.816245 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.816179    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17785b6c-ce85-42c8-af89-813bb255ff79-kube-api-access-xjvpx" (OuterVolumeSpecName: "kube-api-access-xjvpx") pod "17785b6c-ce85-42c8-af89-813bb255ff79" (UID: "17785b6c-ce85-42c8-af89-813bb255ff79"). InnerVolumeSpecName "kube-api-access-xjvpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:06:22.915420 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.915378    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjvpx\" (UniqueName: \"kubernetes.io/projected/17785b6c-ce85-42c8-af89-813bb255ff79-kube-api-access-xjvpx\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:06:22.915420 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.915412    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/17785b6c-ce85-42c8-af89-813bb255ff79-maas-api-tls\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:06:22.915420 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.915422    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/17785b6c-ce85-42c8-af89-813bb255ff79-openshift-service-ca\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:06:22.915420 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.915430    2557 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17785b6c-ce85-42c8-af89-813bb255ff79-metrics-certs\") on node \"ip-10-0-134-196.ec2.internal\" DevicePath \"\""
Sep 11 17:06:22.955803 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.955767    2557 generic.go:356] "Generic (PLEG): container finished" podID="17785b6c-ce85-42c8-af89-813bb255ff79" containerID="a9d25a6ce8b45ba1a6a0b710810d752faec7c90d5096cf7b69e74e7b515061ec" exitCode=0
Sep 11 17:06:22.955964 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.955812    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"
Sep 11 17:06:22.955964 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.955851    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2" event={"ID":"17785b6c-ce85-42c8-af89-813bb255ff79","Type":"ContainerDied","Data":"a9d25a6ce8b45ba1a6a0b710810d752faec7c90d5096cf7b69e74e7b515061ec"}
Sep 11 17:06:22.955964 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.955913    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2" event={"ID":"17785b6c-ce85-42c8-af89-813bb255ff79","Type":"ContainerDied","Data":"6a41be64e4e92dbf75c71473becd0f545c224adff71ecee82059edbb2ee515d2"}
Sep 11 17:06:22.955964 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.955944    2557 scope.go:117] "RemoveContainer" containerID="a9d25a6ce8b45ba1a6a0b710810d752faec7c90d5096cf7b69e74e7b515061ec"
Sep 11 17:06:22.965524 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.965503    2557 scope.go:117] "RemoveContainer" containerID="a9d25a6ce8b45ba1a6a0b710810d752faec7c90d5096cf7b69e74e7b515061ec"
Sep 11 17:06:22.965849 ip-10-0-134-196 kubenswrapper[2557]: E0911 17:06:22.965824    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9d25a6ce8b45ba1a6a0b710810d752faec7c90d5096cf7b69e74e7b515061ec\": container with ID starting with a9d25a6ce8b45ba1a6a0b710810d752faec7c90d5096cf7b69e74e7b515061ec not found: ID does not exist" containerID="a9d25a6ce8b45ba1a6a0b710810d752faec7c90d5096cf7b69e74e7b515061ec"
Sep 11 17:06:22.965917 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.965859    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9d25a6ce8b45ba1a6a0b710810d752faec7c90d5096cf7b69e74e7b515061ec"} err="failed to get container status \"a9d25a6ce8b45ba1a6a0b710810d752faec7c90d5096cf7b69e74e7b515061ec\": rpc error: code = NotFound desc = could not find container \"a9d25a6ce8b45ba1a6a0b710810d752faec7c90d5096cf7b69e74e7b515061ec\": container with ID starting with a9d25a6ce8b45ba1a6a0b710810d752faec7c90d5096cf7b69e74e7b515061ec not found: ID does not exist"
Sep 11 17:06:22.977872 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.977840    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"]
Sep 11 17:06:22.982930 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:22.982902    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b9dddc78b-6hcg2"]
Sep 11 17:06:24.946873 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:24.946837    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17785b6c-ce85-42c8-af89-813bb255ff79" path="/var/lib/kubelet/pods/17785b6c-ce85-42c8-af89-813bb255ff79/volumes"
Sep 11 17:06:37.273762 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:37.273720    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c7d987cd5-cktdr_dbdc609d-0175-406f-8a6a-9d7c2ec98a66/authorino/0.log"
Sep 11 17:06:42.697596 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:42.697556    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-pwcdc_887a2e15-3397-46d1-8204-146b4de3ab23/manager/0.log"
Sep 11 17:06:42.831673 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:42.831634    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-78c795f5ff-6pwvc_14efbacd-d118-4a00-92b4-353b5980d0f0/manager/0.log"
Sep 11 17:06:43.177388 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:43.177352    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-665d69bffd-22ssr_21180bc2-30ff-4e46-b744-0f73b6d0730f/copy-manifests/0.log"
Sep 11 17:06:43.196263 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:43.196230    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-665d69bffd-22ssr_21180bc2-30ff-4e46-b744-0f73b6d0730f/manager/0.log"
Sep 11 17:06:43.799306 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:43.799270    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-dbdb6b6cd-8tnwk_3279b3c5-9cc6-48c7-919d-a40462478d71/maas-api/0.log"
Sep 11 17:06:44.250942 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:44.250854    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-hvpn8_f4f6e02c-775f-4fcf-8b53-164ad8871b5d/postgres/0.log"
Sep 11 17:06:45.015150 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:45.015115    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c7d987cd5-cktdr_dbdc609d-0175-406f-8a6a-9d7c2ec98a66/authorino/0.log"
Sep 11 17:06:45.134777 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:45.134741    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-hmsq8_838b3bbe-08e9-4981-9464-11fbc8958f4d/manager/0.log"
Sep 11 17:06:45.248127 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:45.248093    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-b4zpt_5b54ecb3-d19b-486d-b037-b9020676abfb/manager/0.log"
Sep 11 17:06:45.359887 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:45.359813    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-ksh97_c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc/kuadrant-console-plugin/0.log"
Sep 11 17:06:45.726794 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:45.726703    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-ph7lp_96291f61-606e-4691-8b08-03359bb8f1e3/manager/0.log"
Sep 11 17:06:46.416053 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:46.416020    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d87f6b9bb-57hz6_83a01613-65e7-40a8-b3dd-b5938cf4345b/kube-auth-proxy/0.log"
Sep 11 17:06:46.544889 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:46.544854    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-pxd9m_a86a6cec-b2d2-4385-acc2-6169e537a84f/istio-proxy/1.log"
Sep 11 17:06:46.667213 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:46.667130    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2tbqw_ae1cb97c-6f84-47cc-b9c8-2fd310ef96a0/payload-pre-processing/0.log"
Sep 11 17:06:46.791176 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:46.791137    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9qcfd_891ff581-1fa1-42ca-96be-ea2b43e402ac/payload-processing/0.log"
Sep 11 17:06:47.289721 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:47.289689    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-mhf8w_ec1f9318-4047-4dfd-b561-fb59802346ef/main/0.log"
Sep 11 17:06:47.514271 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:47.514238    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-f7f44_6643fdbf-2d04-4f05-9c9f-e5b7988ae44e/main/0.log"
Sep 11 17:06:47.749715 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:47.749632    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsd2r7_28092de8-d4f7-408e-8e22-b546a1822f90/main/0.log"
Sep 11 17:06:56.666011 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:56.665975    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4qbz6_35e7cb6b-bc4e-456f-94af-d0bf29f87e76/global-pull-secret-syncer/0.log"
Sep 11 17:06:56.888588 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:56.888551    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7f9zb_626143a7-d803-4b33-ae26-1cd1802b8cf0/konnectivity-agent/0.log"
Sep 11 17:06:56.970660 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:06:56.970553    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-196.ec2.internal_390ec4ba6e0c3aa7c2a9e1ee487282c4/haproxy/0.log"
Sep 11 17:07:01.441942 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:01.441899    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7c7d987cd5-cktdr_dbdc609d-0175-406f-8a6a-9d7c2ec98a66/authorino/0.log"
Sep 11 17:07:01.476870 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:01.476835    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-hmsq8_838b3bbe-08e9-4981-9464-11fbc8958f4d/manager/0.log"
Sep 11 17:07:01.510909 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:01.510878    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-b4zpt_5b54ecb3-d19b-486d-b037-b9020676abfb/manager/0.log"
Sep 11 17:07:01.546188 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:01.546156    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-ksh97_c6fe5d3c-e8c9-4f89-8335-e7a177bcaefc/kuadrant-console-plugin/0.log"
Sep 11 17:07:01.738453 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:01.738363    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-ph7lp_96291f61-606e-4691-8b08-03359bb8f1e3/manager/0.log"
Sep 11 17:07:03.874916 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:03.874883    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5gz7w_317842b7-0911-4518-91aa-9f7dcc0ae801/node-exporter/0.log"
Sep 11 17:07:03.901309 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:03.901277    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5gz7w_317842b7-0911-4518-91aa-9f7dcc0ae801/kube-rbac-proxy/0.log"
Sep 11 17:07:03.930192 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:03.930163    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5gz7w_317842b7-0911-4518-91aa-9f7dcc0ae801/init-textfile/0.log"
Sep 11 17:07:06.283836 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.283795    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"]
Sep 11 17:07:06.284277 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.284244    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17785b6c-ce85-42c8-af89-813bb255ff79" containerName="maas-api"
Sep 11 17:07:06.284277 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.284259    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="17785b6c-ce85-42c8-af89-813bb255ff79" containerName="maas-api"
Sep 11 17:07:06.284362 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.284312    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="17785b6c-ce85-42c8-af89-813bb255ff79" containerName="maas-api"
Sep 11 17:07:06.287456 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.287432    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"
Sep 11 17:07:06.289833 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.289814    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-df522\"/\"kube-root-ca.crt\""
Sep 11 17:07:06.290876 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.290859    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-df522\"/\"default-dockercfg-m8sb2\""
Sep 11 17:07:06.290930 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.290884    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-df522\"/\"openshift-service-ca.crt\""
Sep 11 17:07:06.298287 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.298262    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"]
Sep 11 17:07:06.361529 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.361487    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bjwk\" (UniqueName: \"kubernetes.io/projected/6406d1e0-948b-4c6b-82dd-97fa67e51a19-kube-api-access-6bjwk\") pod \"perf-node-gather-daemonset-7tmsq\" (UID: \"6406d1e0-948b-4c6b-82dd-97fa67e51a19\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"
Sep 11 17:07:06.361732 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.361546    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6406d1e0-948b-4c6b-82dd-97fa67e51a19-podres\") pod \"perf-node-gather-daemonset-7tmsq\" (UID: \"6406d1e0-948b-4c6b-82dd-97fa67e51a19\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"
Sep 11 17:07:06.361732 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.361591    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6406d1e0-948b-4c6b-82dd-97fa67e51a19-sys\") pod \"perf-node-gather-daemonset-7tmsq\" (UID: \"6406d1e0-948b-4c6b-82dd-97fa67e51a19\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"
Sep 11 17:07:06.361732 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.361662    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6406d1e0-948b-4c6b-82dd-97fa67e51a19-proc\") pod \"perf-node-gather-daemonset-7tmsq\" (UID: \"6406d1e0-948b-4c6b-82dd-97fa67e51a19\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"
Sep 11 17:07:06.361732 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.361691    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6406d1e0-948b-4c6b-82dd-97fa67e51a19-lib-modules\") pod \"perf-node-gather-daemonset-7tmsq\" (UID: \"6406d1e0-948b-4c6b-82dd-97fa67e51a19\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"
Sep 11 17:07:06.462671 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.462601    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6406d1e0-948b-4c6b-82dd-97fa67e51a19-sys\") pod \"perf-node-gather-daemonset-7tmsq\" (UID: \"6406d1e0-948b-4c6b-82dd-97fa67e51a19\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"
Sep 11 17:07:06.462830 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.462682    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6406d1e0-948b-4c6b-82dd-97fa67e51a19-proc\") pod \"perf-node-gather-daemonset-7tmsq\" (UID: \"6406d1e0-948b-4c6b-82dd-97fa67e51a19\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"
Sep 11 17:07:06.462830 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.462698    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6406d1e0-948b-4c6b-82dd-97fa67e51a19-lib-modules\") pod \"perf-node-gather-daemonset-7tmsq\" (UID: \"6406d1e0-948b-4c6b-82dd-97fa67e51a19\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"
Sep 11 17:07:06.462830 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.462734    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6406d1e0-948b-4c6b-82dd-97fa67e51a19-sys\") pod \"perf-node-gather-daemonset-7tmsq\" (UID: \"6406d1e0-948b-4c6b-82dd-97fa67e51a19\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"
Sep 11 17:07:06.462830 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.462793    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bjwk\" (UniqueName: \"kubernetes.io/projected/6406d1e0-948b-4c6b-82dd-97fa67e51a19-kube-api-access-6bjwk\") pod \"perf-node-gather-daemonset-7tmsq\" (UID: \"6406d1e0-948b-4c6b-82dd-97fa67e51a19\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"
Sep 11 17:07:06.462830 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.462800    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6406d1e0-948b-4c6b-82dd-97fa67e51a19-proc\") pod \"perf-node-gather-daemonset-7tmsq\" (UID: \"6406d1e0-948b-4c6b-82dd-97fa67e51a19\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"
Sep 11 17:07:06.462996 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.462853    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6406d1e0-948b-4c6b-82dd-97fa67e51a19-lib-modules\") pod \"perf-node-gather-daemonset-7tmsq\" (UID: \"6406d1e0-948b-4c6b-82dd-97fa67e51a19\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"
Sep 11 17:07:06.462996 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.462865    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6406d1e0-948b-4c6b-82dd-97fa67e51a19-podres\") pod \"perf-node-gather-daemonset-7tmsq\" (UID: \"6406d1e0-948b-4c6b-82dd-97fa67e51a19\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"
Sep 11 17:07:06.462996 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.462922    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6406d1e0-948b-4c6b-82dd-97fa67e51a19-podres\") pod \"perf-node-gather-daemonset-7tmsq\" (UID: \"6406d1e0-948b-4c6b-82dd-97fa67e51a19\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"
Sep 11 17:07:06.478256 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.478219    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bjwk\" (UniqueName: \"kubernetes.io/projected/6406d1e0-948b-4c6b-82dd-97fa67e51a19-kube-api-access-6bjwk\") pod \"perf-node-gather-daemonset-7tmsq\" (UID: \"6406d1e0-948b-4c6b-82dd-97fa67e51a19\") " pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"
Sep 11 17:07:06.598564 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.598471    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"
Sep 11 17:07:06.875693 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:06.875665    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"]
Sep 11 17:07:06.877441 ip-10-0-134-196 kubenswrapper[2557]: W0911 17:07:06.877412    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6406d1e0_948b_4c6b_82dd_97fa67e51a19.slice/crio-9a6a52d8b382602f9ede8c90306df0e8b33af825e099e0aae879545c7f502a4a WatchSource:0}: Error finding container 9a6a52d8b382602f9ede8c90306df0e8b33af825e099e0aae879545c7f502a4a: Status 404 returned error can't find the container with id 9a6a52d8b382602f9ede8c90306df0e8b33af825e099e0aae879545c7f502a4a
Sep 11 17:07:07.201447 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:07.201348    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq" event={"ID":"6406d1e0-948b-4c6b-82dd-97fa67e51a19","Type":"ContainerStarted","Data":"904e8b7315b76d8e227ecfd917840b907417b9f302493d608bd4ce2f2cd4d862"}
Sep 11 17:07:07.201447 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:07.201410    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq" event={"ID":"6406d1e0-948b-4c6b-82dd-97fa67e51a19","Type":"ContainerStarted","Data":"9a6a52d8b382602f9ede8c90306df0e8b33af825e099e0aae879545c7f502a4a"}
Sep 11 17:07:07.201788 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:07.201481    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"
Sep 11 17:07:07.219985 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:07.219932    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq" podStartSLOduration=1.219917358 podStartE2EDuration="1.219917358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:07:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:07:07.218750424 +0000 UTC m=+2246.837024595" watchObservedRunningTime="2026-09-11 17:07:07.219917358 +0000 UTC m=+2246.838191529"
Sep 11 17:07:07.375183 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:07.375155    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-65d856b777-6d8c8_eecdd074-33d6-4e9a-9c82-d9e1ce6cecbb/console/0.log"
Sep 11 17:07:09.430355 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:09.430313    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tvq8f_6cad760a-cbe5-4fb3-9229-ee77198fab07/dns/0.log"
Sep 11 17:07:09.465308 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:09.465264    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tvq8f_6cad760a-cbe5-4fb3-9229-ee77198fab07/kube-rbac-proxy/0.log"
Sep 11 17:07:09.559598 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:09.559561    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ptdtw_fac41999-310c-4cbe-aa82-073191607d1d/dns-node-resolver/0.log"
Sep 11 17:07:10.213745 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:10.213711    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-f9nlm_5da99747-5918-4454-b404-349af508e59b/node-ca/0.log"
Sep 11 17:07:11.496031 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:11.495998    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d87f6b9bb-57hz6_83a01613-65e7-40a8-b3dd-b5938cf4345b/kube-auth-proxy/0.log"
Sep 11 17:07:11.532116 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:11.532080    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-pxd9m_a86a6cec-b2d2-4385-acc2-6169e537a84f/istio-proxy/0.log"
Sep 11 17:07:11.550569 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:11.550526    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-pxd9m_a86a6cec-b2d2-4385-acc2-6169e537a84f/istio-proxy/1.log"
Sep 11 17:07:11.610060 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:11.610020    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2tbqw_ae1cb97c-6f84-47cc-b9c8-2fd310ef96a0/payload-pre-processing/0.log"
Sep 11 17:07:11.667987 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:11.667952    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9qcfd_891ff581-1fa1-42ca-96be-ea2b43e402ac/payload-processing/0.log"
Sep 11 17:07:12.689498 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:12.689461    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jmfl8_7830a971-ff74-4997-aa28-471e1d0686a3/serve-healthcheck-canary/0.log"
Sep 11 17:07:13.222933 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:13.222907    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-df522/perf-node-gather-daemonset-7tmsq"
Sep 11 17:07:13.347627 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:13.347572    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d5958_65fa786c-889c-4b0f-8a55-c738ceca7cc8/kube-rbac-proxy/0.log"
Sep 11 17:07:13.374780 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:13.374748    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d5958_65fa786c-889c-4b0f-8a55-c738ceca7cc8/exporter/0.log"
Sep 11 17:07:13.406579 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:13.406552    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d5958_65fa786c-889c-4b0f-8a55-c738ceca7cc8/extractor/0.log"
Sep 11 17:07:16.430668 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:16.430546    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-pwcdc_887a2e15-3397-46d1-8204-146b4de3ab23/manager/0.log"
Sep 11 17:07:16.502834 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:16.502798    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-78c795f5ff-6pwvc_14efbacd-d118-4a00-92b4-353b5980d0f0/manager/0.log"
Sep 11 17:07:16.849110 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:16.849070    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-665d69bffd-22ssr_21180bc2-30ff-4e46-b744-0f73b6d0730f/manager/0.log"
Sep 11 17:07:16.872008 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:16.871983    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-665d69bffd-22ssr_21180bc2-30ff-4e46-b744-0f73b6d0730f/copy-manifests/0.log"
Sep 11 17:07:17.270168 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:17.270135    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d87f6b9bb-57hz6_83a01613-65e7-40a8-b3dd-b5938cf4345b/kube-auth-proxy/0.log"
Sep 11 17:07:17.298178 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:17.298143    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-pxd9m_a86a6cec-b2d2-4385-acc2-6169e537a84f/istio-proxy/0.log"
Sep 11 17:07:17.316178 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:17.316145    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-pxd9m_a86a6cec-b2d2-4385-acc2-6169e537a84f/istio-proxy/1.log"
Sep 11 17:07:17.383954 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:17.383925    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2tbqw_ae1cb97c-6f84-47cc-b9c8-2fd310ef96a0/payload-pre-processing/0.log"
Sep 11 17:07:17.431121 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:17.431085    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9qcfd_891ff581-1fa1-42ca-96be-ea2b43e402ac/payload-processing/0.log"
Sep 11 17:07:19.172257 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:19.172223    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d87f6b9bb-57hz6_83a01613-65e7-40a8-b3dd-b5938cf4345b/kube-auth-proxy/0.log"
Sep 11 17:07:19.202131 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:19.202100    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-pxd9m_a86a6cec-b2d2-4385-acc2-6169e537a84f/istio-proxy/0.log"
Sep 11 17:07:19.217193 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:19.217158    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-pxd9m_a86a6cec-b2d2-4385-acc2-6169e537a84f/istio-proxy/1.log"
Sep 11 17:07:19.264835 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:19.264807    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-2tbqw_ae1cb97c-6f84-47cc-b9c8-2fd310ef96a0/payload-pre-processing/0.log"
Sep 11 17:07:19.318706 ip-10-0-134-196 kubenswrapper[2557]: I0911 17:07:19.318676    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9qcfd_891ff581-1fa1-42ca-96be-ea2b43e402ac/payload-processing/0.log"