Sep 17 10:51:25.604884 ip-10-0-138-123 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 17 10:51:25.604897 ip-10-0-138-123 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 17 10:51:25.604907 ip-10-0-138-123 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 17 10:51:25.605119 ip-10-0-138-123 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 17 10:51:35.619830 ip-10-0-138-123 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 17 10:51:35.619848 ip-10-0-138-123 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1c5f9dfbbd3c48a9bd584433ae725d20 --
Sep 17 10:53:30.085789 ip-10-0-138-123 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 10:53:30.490153 ip-10-0-138-123 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 10:53:30.490153 ip-10-0-138-123 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 10:53:30.490153 ip-10-0-138-123 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 10:53:30.490153 ip-10-0-138-123 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 10:53:30.490153 ip-10-0-138-123 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 10:53:30.490757 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.490208    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 10:53:30.496911 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496886    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 10:53:30.496911 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496903    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 10:53:30.496911 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496906    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 10:53:30.496911 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496910    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 10:53:30.496911 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496913    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 10:53:30.496911 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496917    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 10:53:30.496911 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496920    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496923    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496925    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496928    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496931    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496934    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496936    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496939    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496942    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496944    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496947    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496950    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496952    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496955    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496957    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496960    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496962    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496965    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496967    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496970    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 10:53:30.497151 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496972    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 10:53:30.497639 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496975    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 10:53:30.497639 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496980    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 10:53:30.497639 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496983    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 10:53:30.497639 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496986    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 10:53:30.497639 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496990    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 10:53:30.497639 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496993    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 10:53:30.497639 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496995    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 10:53:30.497639 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.496998    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 10:53:30.497639 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497001    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 10:53:30.497639 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497004    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 10:53:30.497639 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497007    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 10:53:30.497639 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497010    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 10:53:30.497639 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497012    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 10:53:30.497639 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497015    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 10:53:30.497639 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497018    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 10:53:30.497639 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497021    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 10:53:30.497639 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497023    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 10:53:30.497639 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497026    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 10:53:30.497639 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497029    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 10:53:30.498109 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497031    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 10:53:30.498109 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497034    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 10:53:30.498109 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497039    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 10:53:30.498109 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497042    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 10:53:30.498109 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497045    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 10:53:30.498109 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497048    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 10:53:30.498109 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497051    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 10:53:30.498109 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497053    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 10:53:30.498109 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497056    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 10:53:30.498109 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497058    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 10:53:30.498109 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497061    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 10:53:30.498109 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497065    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 10:53:30.498109 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497070    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 10:53:30.498109 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497073    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 10:53:30.498109 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497076    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 10:53:30.498109 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497079    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 10:53:30.498109 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497082    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 10:53:30.498109 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497085    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 10:53:30.498109 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497088    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497092    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497094    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497097    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497100    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497102    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497105    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497108    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497112    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497114    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497117    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497120    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497122    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497125    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497128    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497131    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497133    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497136    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497138    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497141    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 10:53:30.498571 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497144    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 10:53:30.499043 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497147    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 10:53:30.499043 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497149    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 10:53:30.499043 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497152    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 10:53:30.499043 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497155    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 10:53:30.499043 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497158    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 10:53:30.499043 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497160    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 10:53:30.499043 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497163    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 10:53:30.499043 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497166    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 10:53:30.499043 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497169    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 10:53:30.499043 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497171    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 10:53:30.499043 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497175    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 10:53:30.499043 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497177    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 10:53:30.499043 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497180    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 10:53:30.499043 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.497183    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 10:53:30.499043 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498859    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 10:53:30.499043 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498867    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 10:53:30.499043 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498870    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 10:53:30.499043 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498873    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 10:53:30.499043 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498876    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498879    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498882    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498884    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498888    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498890    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498892    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498895    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498898    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498900    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498903    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498905    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498908    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498911    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498915    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498919    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498922    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498925    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498929    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498931    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 10:53:30.499653 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498934    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498936    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498939    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498942    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498945    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498948    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498951    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498953    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498956    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498958    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498961    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498963    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498966    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498968    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498971    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498974    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498977    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498979    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498982    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498984    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 10:53:30.500187 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498987    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498989    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498992    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498994    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.498997    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499000    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499003    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499005    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499008    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499011    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499013    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499016    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499019    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499021    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499024    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499026    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499029    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499032    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499035    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499037    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 10:53:30.500701 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499040    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499042    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499045    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499048    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499050    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499053    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499056    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499058    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499062    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499064    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499066    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499069    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499071    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499074    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499077    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499079    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499081    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499085    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499089    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499092    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 10:53:30.501196 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499095    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 10:53:30.501694 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499099    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 10:53:30.501694 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499101    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 10:53:30.501694 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499104    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 10:53:30.501694 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499106    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 10:53:30.501694 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499109    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 10:53:30.501694 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499113    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 10:53:30.501694 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499115    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 10:53:30.501694 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499120    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 10:53:30.501694 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499123    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 10:53:30.501694 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499126    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 10:53:30.501694 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499129    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 10:53:30.501694 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499132    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 10:53:30.501694 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499135    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 10:53:30.501694 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499138    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 10:53:30.501694 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499497    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 10:53:30.501694 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499503    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 10:53:30.501694 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499528    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 10:53:30.501694 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499533    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 10:53:30.501694 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499535    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499538    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499541    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499543    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499546    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499549    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499552    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499555    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499559    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499561    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499564    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499566    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499570    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499573    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499575    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499578    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499580    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499583    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499585    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499588    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 10:53:30.502160 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499591    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499593    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499596    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499599    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499602    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499605    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499607    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499610    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499612    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499615    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499617    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499620    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499622    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499624    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499627    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499629    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499632    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499634    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499637    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499639    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 10:53:30.502652 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499642    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499644    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499647    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499649    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499652    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499656    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499659    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499661    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499664    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499667    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499669    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499672    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499674    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499677    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499680    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499682    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499685    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499687    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499690    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499692    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 10:53:30.503132 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499695    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 10:53:30.503675 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499697    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 10:53:30.503675 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499700    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 10:53:30.503675 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499703    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 10:53:30.503675 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499705    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 10:53:30.503675 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499708    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 10:53:30.503675 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499712    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 10:53:30.503675 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499715    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 10:53:30.503675 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499718    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 10:53:30.503675 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499720    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 10:53:30.503675 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499723    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 10:53:30.503675 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499726    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 10:53:30.503675 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499728    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 10:53:30.503675 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499731    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 10:53:30.503675 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499734    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 10:53:30.503675 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499737    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 10:53:30.503675 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499741    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 10:53:30.503675 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499745    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 10:53:30.503675 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499749    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 10:53:30.503675 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499753    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499756    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499759    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499762    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499765    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499768    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499771    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499774    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499776    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499779    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499781    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499784    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499787    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499789    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499792    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.499794    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499868    2570 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499912    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499919    2570 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499924    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 10:53:30.504175 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499928    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499931    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499935    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499939    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499942    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499945    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499948    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499951    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499954    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499957    2570 flags.go:64] FLAG: --cgroup-root=""
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499961    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499963    2570 flags.go:64] FLAG: --client-ca-file=""
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499967    2570 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499970    2570 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499974    2570 flags.go:64] FLAG: --cluster-domain=""
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499977    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499980    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499983    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499986    2570 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499989    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499992    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499996    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.499999    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500002    2570 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 10:53:30.504675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500005    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500008    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500011    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500014    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500018    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500021    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500024    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500026    2570 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500029    2570 flags.go:64] FLAG: --enable-server="true"
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500032    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500037    2570 flags.go:64] FLAG: --event-burst="100"
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500040    2570 flags.go:64] FLAG: --event-qps="50"
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500042    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500045    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500048    2570 flags.go:64] FLAG: --eviction-hard=""
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500052    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500055    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500061    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500064    2570 flags.go:64] FLAG: --eviction-soft=""
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500067    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500070    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500073    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500076    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500079    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500082    2570 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 10:53:30.505247 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500085    2570 flags.go:64] FLAG: --feature-gates=""
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500089    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500091    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500094    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500097    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500100    2570 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500103    2570 flags.go:64] FLAG: --help="false"
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500106    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-138-123.ec2.internal"
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500109    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500112    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500115    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500118    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500121    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500124    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500127    2570 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500130    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500132    2570 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500135    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500138    2570 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500141    2570 flags.go:64] FLAG: --kube-reserved=""
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500144    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500146    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500149    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500152    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 10:53:30.505883 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500158    2570 flags.go:64] FLAG: --lock-file=""
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500160    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500163    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500166    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500172    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500175    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500178    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500182    2570 flags.go:64] FLAG: --logging-format="text"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500185    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500188    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500191    2570 flags.go:64] FLAG: --manifest-url=""
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500194    2570 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500198    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500201    2570 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500208    2570 flags.go:64] FLAG: --max-pods="110"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500211    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500214    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500217    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500219    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500223    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500226    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500229    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500236    2570 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500239    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500242    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 10:53:30.506469 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500245    2570 flags.go:64] FLAG: --pod-cidr=""
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500248    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500252    2570 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500255    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500258    2570 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500261    2570 flags.go:64] FLAG: --port="10250"
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500264    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500268    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-031ce1116b72b1aab"
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500273    2570 flags.go:64] FLAG: --qos-reserved=""
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500276    2570 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500278    2570 flags.go:64] FLAG: --register-node="true"
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500281    2570 flags.go:64] FLAG: --register-with-taints=""
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500289    2570 flags.go:64] FLAG: --registry-burst="10"
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500293    2570 flags.go:64] FLAG: --registry-qps="5"
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500296    2570 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500298    2570 flags.go:64] FLAG: --reserved-memory=""
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500302    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500305    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500308    2570 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500311    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500314    2570 flags.go:64] FLAG: --runonce="false"
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500317    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500320    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500323    2570 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500326    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 10:53:30.507093 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500329    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500332    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500334    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500338    2570 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500340    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500343    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500346    2570 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500349    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500351    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500354    2570 flags.go:64] FLAG: --system-cgroups=""
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500357    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500362    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500365    2570 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500367    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500372    2570 flags.go:64] FLAG: --tls-min-version=""
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500376    2570 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500379    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500382    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500385    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500388    2570 flags.go:64] FLAG: --v="2"
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500392    2570 flags.go:64] FLAG: --version="false"
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500396    2570 flags.go:64] FLAG: --vmodule=""
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500400    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500403    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500524    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 10:53:30.507756 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500530    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500534    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500539    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500542    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500545    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500547    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500550    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500553    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500556    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500558    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500561    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500563    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500566    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500568    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500571    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500574    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500576    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500579    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500582    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500584    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 10:53:30.508362 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500587    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500593    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500598    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500600    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500603    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500606    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500609    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500612    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500614    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500617    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500620    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500623    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500625    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500628    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500630    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500633    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500636    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500639    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500641    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500644    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 10:53:30.508905 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500646    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500649    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500652    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500655    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500657    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500660    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500663    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500665    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500668    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500670    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500673    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500675    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500678    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500682    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500686    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500688    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500691    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500694    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500696    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500699    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 10:53:30.509388 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500702    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500706    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500709    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500712    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500715    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500718    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500720    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500723    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500726    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500729    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500731    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500734    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500736    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500739    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500742    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500744    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500747    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500749    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500752    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500755    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 10:53:30.509877 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500757    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 10:53:30.510366 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500760    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 10:53:30.510366 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500762    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 10:53:30.510366 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500765    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 10:53:30.510366 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500767    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 10:53:30.510366 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500773    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 10:53:30.510366 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500778    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 10:53:30.510366 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500781    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 10:53:30.510366 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500784    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 10:53:30.510366 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500786    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 10:53:30.510366 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500789    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 10:53:30.510366 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500792    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 10:53:30.510366 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500795    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 10:53:30.510366 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500799    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 10:53:30.510366 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500803    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 10:53:30.510366 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500807    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 10:53:30.510366 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500810    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 10:53:30.510366 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.500813    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 10:53:30.510806 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.500818    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 10:53:30.510806 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.507849    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 10:53:30.510806 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.507865    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 10:53:30.510806 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.508637    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 10:53:30.510806 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.508645    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 10:53:30.510806 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508698    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 10:53:30.510806 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508703    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 10:53:30.510806 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508707    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 10:53:30.510806 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508710    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 10:53:30.510806 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508714    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 10:53:30.510806 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508716    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 10:53:30.510806 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508719    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 10:53:30.510806 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508722    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 10:53:30.510806 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508726    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508730    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508734    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508737    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508739    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508742    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508745    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508748    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508750    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508753    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508755    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508758    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508761    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508763    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508766    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508769    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508771    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508774    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508777    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508780    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 10:53:30.511171 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508783    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508787    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508790    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508793    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508795    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508798    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508801    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508803    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508806    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508808    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508811    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508814    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508817    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508820    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508822    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508825    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508828    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508830    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508833    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508835    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 10:53:30.511667 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508838    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508840    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508843    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508846    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508848    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508851    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508853    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508856    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508858    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508861    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508863    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508867    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508871    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508874    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508877    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508880    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508882    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508885    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508887    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508890    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 10:53:30.512137 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508892    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508895    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508897    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508900    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508902    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508905    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508908    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508911    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508913    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508916    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508919    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508921    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508924    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508926    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508929    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508931    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508934    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508936    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508939    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508941    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 10:53:30.512658 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508944    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 10:53:30.513134 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508947    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 10:53:30.513134 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508949    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 10:53:30.513134 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508951    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 10:53:30.513134 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508954    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 10:53:30.513134 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508957    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 10:53:30.513134 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508961    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 10:53:30.513134 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508965    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 10:53:30.513134 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508968    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 10:53:30.513134 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508972    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 10:53:30.513134 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.508975    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 10:53:30.513134 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.508980    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 10:53:30.513134 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509083    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 10:53:30.513134 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509087    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 10:53:30.513134 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509090    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 10:53:30.513134 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509094    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509097    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509099    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509102    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509105    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509107    2570 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509110    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509112    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509115    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509117    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509120    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509123    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509125    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509128    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509130    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509133    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509135    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509138    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509141    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509144    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 10:53:30.513520 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509146    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 10:53:30.513994 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509149    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 10:53:30.513994 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509152    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 10:53:30.513994 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509155    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 10:53:30.513994 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509158    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 10:53:30.513994 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509161    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 10:53:30.513994 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509163    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 10:53:30.513994 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509166    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 10:53:30.513994 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509168    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 10:53:30.513994 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509171    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 10:53:30.513994 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509173    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 10:53:30.513994 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509176    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 10:53:30.513994 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509178    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 10:53:30.513994 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509181    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 10:53:30.513994 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509183    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 10:53:30.513994 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509185    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 10:53:30.513994 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509188    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 10:53:30.513994 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509191    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 10:53:30.513994 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509193    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 10:53:30.513994 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509195    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509198    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509200    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509203    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509205    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509208    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509211    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509214    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509216    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509219    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509221    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509224    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509226    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509229    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509231    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509234    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509237    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509240    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509244    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509248    2570 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 10:53:30.514449 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509250    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 10:53:30.514945 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509253    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 10:53:30.514945 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509256    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 10:53:30.514945 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509258    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 10:53:30.514945 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509261    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 10:53:30.514945 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509263    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 10:53:30.514945 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509266    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 10:53:30.514945 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509270    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 10:53:30.514945 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509273    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 10:53:30.514945 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509276    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 10:53:30.514945 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509279    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 10:53:30.514945 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509282    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 10:53:30.514945 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509284    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 10:53:30.514945 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509287    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 10:53:30.514945 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509289    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 10:53:30.514945 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509292    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 10:53:30.514945 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509294    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 10:53:30.514945 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509297    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 10:53:30.514945 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509299    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 10:53:30.514945 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509302    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 10:53:30.515400 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509304    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 10:53:30.515400 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509307    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 10:53:30.515400 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509309    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 10:53:30.515400 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509311    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 10:53:30.515400 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509314    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 10:53:30.515400 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509316    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 10:53:30.515400 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509319    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 10:53:30.515400 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509324    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 10:53:30.515400 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509327    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 10:53:30.515400 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509329    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 10:53:30.515400 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509333    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 10:53:30.515400 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509336    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 10:53:30.515400 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509340    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 10:53:30.515400 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509342    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 10:53:30.515400 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509345    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 10:53:30.515400 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509348    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 10:53:30.515400 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:30.509351    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 10:53:30.515824 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.509355    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 10:53:30.515824 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.509446    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 10:53:30.515824 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.511404    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 10:53:30.515824 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.512217    2570 server.go:1019] "Starting client certificate rotation"
Sep 17 10:53:30.515824 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.512317    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 10:53:30.515824 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.513093    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 10:53:30.515824 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.515094    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 10:53:30.516166 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.516149    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 10:53:30.525817 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.525795    2570 log.go:25] "Validated CRI v1 runtime API"
Sep 17 10:53:30.530626 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.530609    2570 log.go:25] "Validated CRI v1 image API"
Sep 17 10:53:30.531412 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.531391    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 10:53:30.534795 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.534772    2570 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a1fc862c-8878-4873-bf16-a1b9880d326a:/dev/nvme0n1p4 d3c2cf22-d730-4a8c-a1f9-e690c151d808:/dev/nvme0n1p3]
Sep 17 10:53:30.534861 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.534794    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 10:53:30.539681 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.539575    2570 manager.go:216] Machine: {Timestamp:2026-09-17 10:53:30.538239204 +0000 UTC m=+0.333573641 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3113179 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2753eb02a9f75748bde68ab6b974d4 SystemUUID:ec2753eb-02a9-f757-48bd-e68ab6b974d4 BootID:1c5f9dfb-bd3c-48a9-bd58-4433ae725d20 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f6:20:eb:37 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f6:20:eb:37 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:6b:3a:b9:17:62 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 10:53:30.539681 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.539679    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 10:53:30.539782 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.539771    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 10:53:30.542364 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.542338    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 10:53:30.542487 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.542367    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-123.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 10:53:30.543053 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.543044    2570 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 10:53:30.543084 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.543055    2570 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 10:53:30.543084 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.543063    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 10:53:30.543695 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.543685    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 10:53:30.544569 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.544559    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 10:53:30.547333 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.547322    2570 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 10:53:30.547447 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.547438    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 10:53:30.547481 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.547470    2570 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 10:53:30.547481 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.547478    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 10:53:30.547547 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.547493    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 10:53:30.547547 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.547502    2570 kubelet.go:398] "Adding apiserver pod source"
Sep 17 10:53:30.547547 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.547521    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 10:53:30.547833 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.547822    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 10:53:30.547865 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.547843    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 10:53:30.549981 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.549963    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 17 10:53:30.552320 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.551386    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 10:53:30.552640 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.552623    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 10:53:30.552696 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.552665    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 10:53:30.555190 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.555176    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 10:53:30.555400 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.555386    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 10:53:30.555400 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.555400    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 10:53:30.555495 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.555406    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 10:53:30.555495 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.555416    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 10:53:30.555495 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.555422    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 10:53:30.555495 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.555437    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 10:53:30.555495 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.555442    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 10:53:30.555495 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.555449    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 10:53:30.555495 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.555455    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 10:53:30.555495 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.555475    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 10:53:30.555495 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.555480    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 10:53:30.556236 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.556227    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 10:53:30.556236 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.556237    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 10:53:30.558132 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.558118    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-123.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 10:53:30.558183 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.558149    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 10:53:30.558337 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.558322    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 10:53:30.559941 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.559930    2570 server.go:1268] "Started kubelet"
Sep 17 10:53:30.560002 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.559981    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 10:53:30.560116 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.560074    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 10:53:30.560154 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.560137    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 10:53:30.561005 ip-10-0-138-123 systemd[1]: Started Kubernetes Kubelet.
Sep 17 10:53:30.562013 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.561997    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 10:53:30.562114 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.562101    2570 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 10:53:30.565958 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.565940    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 10:53:30.566430 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.566415    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 10:53:30.566979 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.566963    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 10:53:30.567091 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.567070    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found"
Sep 17 10:53:30.567502 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.567483    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 10:53:30.567599 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.567488    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 10:53:30.567599 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.567531    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 10:53:30.567699 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.567632    2570 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 10:53:30.567699 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.567640    2570 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 10:53:30.567969 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.567953    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 10:53:30.568029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.567970    2570 factory.go:55] Registering systemd factory
Sep 17 10:53:30.568029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.567981    2570 factory.go:223] Registration of the systemd container factory successfully
Sep 17 10:53:30.568184 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.568170    2570 factory.go:153] Registering CRI-O factory
Sep 17 10:53:30.568238 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.568185    2570 factory.go:223] Registration of the crio container factory successfully
Sep 17 10:53:30.568238 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.568198    2570 factory.go:103] Registering Raw factory
Sep 17 10:53:30.568238 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.568207    2570 manager.go:1196] Started watching for new ooms in manager
Sep 17 10:53:30.568961 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.568950    2570 manager.go:349] Starting recovery of all containers
Sep 17 10:53:30.576824 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.576592    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 17 10:53:30.576824 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.576802    2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 17 10:53:30.581545 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.581528    2570 manager.go:354] Recovery completed
Sep 17 10:53:30.582541 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.576572    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-123.ec2.internal.18d6164a5c65972a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-123.ec2.internal,UID:ip-10-0-138-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-123.ec2.internal,},FirstTimestamp:2026-09-17 10:53:30.55990353 +0000 UTC m=+0.355237960,LastTimestamp:2026-09-17 10:53:30.55990353 +0000 UTC m=+0.355237960,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-123.ec2.internal,}"
Sep 17 10:53:30.588113 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.588097    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 10:53:30.589916 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.589887    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 10:53:30.589989 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.589931    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 10:53:30.589989 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.589945    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientPID"
Sep 17 10:53:30.590462 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.590444    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 10:53:30.590462 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.590459    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 10:53:30.590613 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.590461    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 10:53:30.590613 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.590496    2570 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 10:53:30.591154 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.591139    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 10:53:30.591198 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.591168    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 10:53:30.591198 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.591179    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientPID"
Sep 17 10:53:30.591646 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.591635    2570 policy_none.go:49] "None policy: Start"
Sep 17 10:53:30.591683 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.591651    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 10:53:30.591683 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.591660    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 10:53:30.592671 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.592661    2570 policy_none.go:47] "Start"
Sep 17 10:53:30.595636 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.595489    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-123.ec2.internal.18d6164a5e2f8570  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-123.ec2.internal,UID:ip-10-0-138-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-123.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-123.ec2.internal,},FirstTimestamp:2026-09-17 10:53:30.58991448 +0000 UTC m=+0.385248912,LastTimestamp:2026-09-17 10:53:30.58991448 +0000 UTC m=+0.385248912,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-123.ec2.internal,}"
Sep 17 10:53:30.598742 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.598679    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-123.ec2.internal.18d6164a5e2fe024  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-123.ec2.internal,UID:ip-10-0-138-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-123.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-123.ec2.internal,},FirstTimestamp:2026-09-17 10:53:30.5899377 +0000 UTC m=+0.385272131,LastTimestamp:2026-09-17 10:53:30.5899377 +0000 UTC m=+0.385272131,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-123.ec2.internal,}"
Sep 17 10:53:30.609867 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.609810    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-123.ec2.internal.18d6164a5e30167f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-123.ec2.internal,UID:ip-10-0-138-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-123.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-123.ec2.internal,},FirstTimestamp:2026-09-17 10:53:30.589951615 +0000 UTC m=+0.385286050,LastTimestamp:2026-09-17 10:53:30.589951615 +0000 UTC m=+0.385286050,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-123.ec2.internal,}"
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.617050    2570 manager.go:337] "Starting Device Plugin manager"
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.617078    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.617086    2570 server.go:87] "Starting device plugin registration server"
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.617335    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.617347    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.617471    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.617566    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.617576    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.618083    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.618126    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-123.ec2.internal\" not found"
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.628040    2570 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-123.ec2.internal.18d6164a5e2f8570\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-123.ec2.internal.18d6164a5e2f8570  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-123.ec2.internal,UID:ip-10-0-138-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-123.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-123.ec2.internal,},FirstTimestamp:2026-09-17 10:53:30.58991448 +0000 UTC m=+0.385248912,LastTimestamp:2026-09-17 10:53:30.591152928 +0000 UTC m=+0.386487385,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-123.ec2.internal,}"
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.631911    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gc72x"
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.647836    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gc72x"
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.648431    2570 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-123.ec2.internal.18d6164a5e2fe024\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-123.ec2.internal.18d6164a5e2fe024  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-123.ec2.internal,UID:ip-10-0-138-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-123.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-123.ec2.internal,},FirstTimestamp:2026-09-17 10:53:30.5899377 +0000 UTC m=+0.385272131,LastTimestamp:2026-09-17 10:53:30.591173437 +0000 UTC m=+0.386507866,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-123.ec2.internal,}"
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.662774    2570 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-123.ec2.internal.18d6164a5e30167f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-123.ec2.internal.18d6164a5e30167f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-123.ec2.internal,UID:ip-10-0-138-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-123.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-123.ec2.internal,},FirstTimestamp:2026-09-17 10:53:30.589951615 +0000 UTC m=+0.385286050,LastTimestamp:2026-09-17 10:53:30.59118397 +0000 UTC m=+0.386518401,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-123.ec2.internal,}"
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.675439    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-123.ec2.internal.18d6164a5ff44f7a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-123.ec2.internal,UID:ip-10-0-138-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-138-123.ec2.internal,},FirstTimestamp:2026-09-17 10:53:30.619588474 +0000 UTC m=+0.414922895,LastTimestamp:2026-09-17 10:53:30.619588474 +0000 UTC m=+0.414922895,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-123.ec2.internal,}"
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.682370    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.683453    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.683502    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 10:53:30.741489 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.683538    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 10:53:30.742101 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.683609    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 10:53:30.742101 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.694125    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Sep 17 10:53:30.742101 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.718272    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 10:53:30.742101 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.719022    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 10:53:30.742101 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.719049    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 10:53:30.742101 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.719062    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientPID"
Sep 17 10:53:30.742101 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.719081    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-123.ec2.internal"
Sep 17 10:53:30.742101 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.731889    2570 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-123.ec2.internal.18d6164a5e2f8570\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-123.ec2.internal.18d6164a5e2f8570  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-123.ec2.internal,UID:ip-10-0-138-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-123.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-123.ec2.internal,},FirstTimestamp:2026-09-17 10:53:30.58991448 +0000 UTC m=+0.385248912,LastTimestamp:2026-09-17 10:53:30.719033453 +0000 UTC m=+0.514367888,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-123.ec2.internal,}"
Sep 17 10:53:30.743448 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.743386    2570 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-123.ec2.internal.18d6164a5e2fe024\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-123.ec2.internal.18d6164a5e2fe024  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-123.ec2.internal,UID:ip-10-0-138-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-123.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-123.ec2.internal,},FirstTimestamp:2026-09-17 10:53:30.5899377 +0000 UTC m=+0.385272131,LastTimestamp:2026-09-17 10:53:30.719055615 +0000 UTC m=+0.514390049,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-123.ec2.internal,}"
Sep 17 10:53:30.743581 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.743484    2570 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-138-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-138-123.ec2.internal"
Sep 17 10:53:30.784286 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.784265    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal"]
Sep 17 10:53:30.784360 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.784317    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 10:53:30.785601 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.785575    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 10:53:30.785693 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.785604    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 10:53:30.785693 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.785617    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientPID"
Sep 17 10:53:30.787104 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.787090    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 10:53:30.787230 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.787218    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal"
Sep 17 10:53:30.787303 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.787241    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 10:53:30.787766 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.787752    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 10:53:30.787829 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.787779    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 10:53:30.787829 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.787791    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientPID"
Sep 17 10:53:30.788032 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.788012    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 10:53:30.788128 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.788038    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 10:53:30.788128 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.788051    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientPID"
Sep 17 10:53:30.789647 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.789628    2570 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-123.ec2.internal\" not found" node="ip-10-0-138-123.ec2.internal"
Sep 17 10:53:30.789817 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.789803    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal"
Sep 17 10:53:30.789898 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.789832    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 10:53:30.790576 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.790560    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 10:53:30.790639 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.790589    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 10:53:30.790639 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.790600    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientPID"
Sep 17 10:53:30.813106 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.813089    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-123.ec2.internal\" not found" node="ip-10-0-138-123.ec2.internal"
Sep 17 10:53:30.817318 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.817300    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-123.ec2.internal\" not found" node="ip-10-0-138-123.ec2.internal"
Sep 17 10:53:30.943851 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.943832    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 10:53:30.944647 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.944633    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 10:53:30.944721 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.944659    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 10:53:30.944721 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.944669    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientPID"
Sep 17 10:53:30.944721 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.944693    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-123.ec2.internal"
Sep 17 10:53:30.961053 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.961038    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-123.ec2.internal"
Sep 17 10:53:30.961107 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:30.961055    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-123.ec2.internal\": node \"ip-10-0-138-123.ec2.internal\" not found"
Sep 17 10:53:30.969234 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.969220    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/629fab160c36a1e0f1caa6028bf89993-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal\" (UID: \"629fab160c36a1e0f1caa6028bf89993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal"
Sep 17 10:53:30.969291 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.969243    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/629fab160c36a1e0f1caa6028bf89993-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal\" (UID: \"629fab160c36a1e0f1caa6028bf89993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal"
Sep 17 10:53:30.969291 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:30.969269    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e9bd5460479070ecb380c4ff6316476-config\") pod \"kube-apiserver-proxy-ip-10-0-138-123.ec2.internal\" (UID: \"0e9bd5460479070ecb380c4ff6316476\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal"
Sep 17 10:53:31.004315 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:31.004272    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found"
Sep 17 10:53:31.069787 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:31.069769    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/629fab160c36a1e0f1caa6028bf89993-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal\" (UID: \"629fab160c36a1e0f1caa6028bf89993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal"
Sep 17 10:53:31.069842 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:31.069791    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/629fab160c36a1e0f1caa6028bf89993-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal\" (UID: \"629fab160c36a1e0f1caa6028bf89993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal"
Sep 17 10:53:31.069842 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:31.069813    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e9bd5460479070ecb380c4ff6316476-config\") pod \"kube-apiserver-proxy-ip-10-0-138-123.ec2.internal\" (UID: \"0e9bd5460479070ecb380c4ff6316476\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal"
Sep 17 10:53:31.069907 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:31.069837    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/629fab160c36a1e0f1caa6028bf89993-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal\" (UID: \"629fab160c36a1e0f1caa6028bf89993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal"
Sep 17 10:53:31.069907 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:31.069843    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e9bd5460479070ecb380c4ff6316476-config\") pod \"kube-apiserver-proxy-ip-10-0-138-123.ec2.internal\" (UID: \"0e9bd5460479070ecb380c4ff6316476\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal"
Sep 17 10:53:31.069907 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:31.069852    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/629fab160c36a1e0f1caa6028bf89993-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal\" (UID: \"629fab160c36a1e0f1caa6028bf89993\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal"
Sep 17 10:53:31.104897 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:31.104873    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found"
Sep 17 10:53:31.116034 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:31.116021    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal"
Sep 17 10:53:31.120292 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:31.120050    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal"
Sep 17 10:53:31.205012 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:31.204983    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found"
Sep 17 10:53:31.305464 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:31.305414    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found"
Sep 17 10:53:31.405627 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:31.405600    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found"
Sep 17 10:53:31.505951 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:31.505917    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found"
Sep 17 10:53:31.512019 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:31.512003    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 10:53:31.606851 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:31.606779    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found"
Sep 17 10:53:31.674225 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:31.674198    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 10:53:31.675283 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:31.675262    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 10:53:31.675380 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:31.675291    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 10:53:31.675380 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:31.675301    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeHasSufficientPID"
Sep 17 10:53:31.707210 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:31.707184    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found"
Sep 17 10:53:31.745286 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:31.745248    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 10:48:30 +0000 UTC" deadline="2028-05-30 18:59:44.792915684 +0000 UTC"
Sep 17 10:53:31.745286 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:31.745283    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14912h6m13.047636604s"
Sep 17 10:53:31.763069 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:31.763036    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod629fab160c36a1e0f1caa6028bf89993.slice/crio-7f506f017f09e85f9881cde0a15c5f833df31ee3bce5aeb0ca470b5909e6cb18 WatchSource:0}: Error finding container 7f506f017f09e85f9881cde0a15c5f833df31ee3bce5aeb0ca470b5909e6cb18: Status 404 returned error can't find the container with id 7f506f017f09e85f9881cde0a15c5f833df31ee3bce5aeb0ca470b5909e6cb18
Sep 17 10:53:31.768950 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:31.768931    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 10:53:31.769537 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:31.769493    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9bd5460479070ecb380c4ff6316476.slice/crio-115e04d7f51efb67dad7a515f84cafbd07049167611dd699f6909dffed31dadd WatchSource:0}: Error finding container 115e04d7f51efb67dad7a515f84cafbd07049167611dd699f6909dffed31dadd: Status 404 returned error can't find the container with id 115e04d7f51efb67dad7a515f84cafbd07049167611dd699f6909dffed31dadd
Sep 17 10:53:31.784690 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:31.784670    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 10:53:31.807952 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:31.807929    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found"
Sep 17 10:53:31.896435 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:31.896369    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 10:53:31.908745 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:31.908726    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-123.ec2.internal\" not found"
Sep 17 10:53:31.977841 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:31.977825    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 10:53:32.067547 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.067526    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal"
Sep 17 10:53:32.082326 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.082312    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 10:53:32.084269 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.084258    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal"
Sep 17 10:53:32.099369 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.099354    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 10:53:32.143308 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.143290    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 10:53:32.549055 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.549027    2570 apiserver.go:52] "Watching apiserver"
Sep 17 10:53:32.557094 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.557069    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 10:53:32.557553 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.557531    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-snvdp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9","openshift-cluster-node-tuning-operator/tuned-nvvk5","openshift-dns/node-resolver-nwlxk","openshift-multus/multus-additional-cni-plugins-287pf","openshift-multus/network-metrics-daemon-9vjl6","openshift-network-diagnostics/network-check-target-l9f4s","kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal","openshift-image-registry/node-ca-jv7wk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal","openshift-multus/multus-hbhhp","openshift-network-operator/iptables-alerter-2s6tr","openshift-ovn-kubernetes/ovnkube-node-lv7s5","kube-system/global-pull-secret-syncer-v56d8"]
Sep 17 10:53:32.559016 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.558991    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:32.559120 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:32.559074    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vjl6" podUID="ac33a910-7eec-4397-8b78-0ebce51a572d"
Sep 17 10:53:32.560138 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.560112    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2s6tr"
Sep 17 10:53:32.561337 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.561318    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.562617 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.562594    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:32.562708 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:32.562652    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9f4s" podUID="2e6652dd-cd64-4562-9340-bba6e831af73"
Sep 17 10:53:32.563837 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.563815    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 10:53:32.564141 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.564120    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jbb5p\""
Sep 17 10:53:32.564241 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.564148    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nwlxk"
Sep 17 10:53:32.564372 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.564355    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 10:53:32.564472 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.564417    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 10:53:32.564689 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.564665    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 10:53:32.564776 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.564720    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 10:53:32.564776 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.564725    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gxh4j\""
Sep 17 10:53:32.565448 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.565431    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.567147 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.566763    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-snvdp"
Sep 17 10:53:32.567147 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.567119    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 10:53:32.567147 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.567130    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 10:53:32.567369 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.567152    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 10:53:32.567965 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.567917    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7g47n\""
Sep 17 10:53:32.568192 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.568170    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 10:53:32.568270 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.568207    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 10:53:32.568329 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.568268    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fmzpj\""
Sep 17 10:53:32.568329 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.568212    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 10:53:32.568448 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.568353    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 10:53:32.568752 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.568735    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 10:53:32.569022 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.569007    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jv7wk"
Sep 17 10:53:32.569803 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.569710    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5brkj\""
Sep 17 10:53:32.570030 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.569862    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 10:53:32.570030 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.569992    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 10:53:32.573404 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.573381    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.574067 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.574047    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 10:53:32.574067 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.574062    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 10:53:32.574295 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.574280    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 10:53:32.574377 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.574362    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rb9z7\""
Sep 17 10:53:32.575673 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.575651    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.576972 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.576948    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6q66\" (UniqueName: \"kubernetes.io/projected/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-kube-api-access-m6q66\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.577063 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.576987    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-system-cni-dir\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.577063 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577014    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cckzp\" (UniqueName: \"kubernetes.io/projected/afe38f2b-75ab-4150-87dc-a948eba57e44-kube-api-access-cckzp\") pod \"node-resolver-nwlxk\" (UID: \"afe38f2b-75ab-4150-87dc-a948eba57e44\") " pod="openshift-dns/node-resolver-nwlxk"
Sep 17 10:53:32.577063 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577041    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-modprobe-d\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.577223 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577065    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-sysctl-d\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.577223 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577111    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-sysctl-conf\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.577223 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577132    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-sys\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.577223 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577155    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs\") pod \"network-metrics-daemon-9vjl6\" (UID: \"ac33a910-7eec-4397-8b78-0ebce51a572d\") " pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:32.577223 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577197    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5sk5\" (UniqueName: \"kubernetes.io/projected/ac33a910-7eec-4397-8b78-0ebce51a572d-kube-api-access-h5sk5\") pod \"network-metrics-daemon-9vjl6\" (UID: \"ac33a910-7eec-4397-8b78-0ebce51a572d\") " pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:32.577223 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577219    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-sysconfig\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.577539 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577239    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-systemd\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.577539 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577278    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-lib-modules\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.577539 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577300    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-host\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.577539 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577321    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afe38f2b-75ab-4150-87dc-a948eba57e44-tmp-dir\") pod \"node-resolver-nwlxk\" (UID: \"afe38f2b-75ab-4150-87dc-a948eba57e44\") " pod="openshift-dns/node-resolver-nwlxk"
Sep 17 10:53:32.577539 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577340    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-cnibin\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.577539 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577355    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-tmp\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.577539 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577370    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-cni-binary-copy\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.577539 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577406    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkgnf\" (UniqueName: \"kubernetes.io/projected/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-kube-api-access-nkgnf\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.577539 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577458    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djpkb\" (UniqueName: \"kubernetes.io/projected/35649e42-ddd5-4c48-a38c-a7486bbcd3e4-kube-api-access-djpkb\") pod \"iptables-alerter-2s6tr\" (UID: \"35649e42-ddd5-4c48-a38c-a7486bbcd3e4\") " pod="openshift-network-operator/iptables-alerter-2s6tr"
Sep 17 10:53:32.578033 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577847    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-run\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.578033 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577880    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.578033 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577906    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-kubernetes\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.578033 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577933    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.578033 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577956    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/436e3582-44b3-4a08-9192-c700c482f195-konnectivity-ca\") pod \"konnectivity-agent-snvdp\" (UID: \"436e3582-44b3-4a08-9192-c700c482f195\") " pod="kube-system/konnectivity-agent-snvdp"
Sep 17 10:53:32.578033 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.577978    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89b9f0b0-986a-461c-bb56-8c747c1e21bd-host\") pod \"node-ca-jv7wk\" (UID: \"89b9f0b0-986a-461c-bb56-8c747c1e21bd\") " pod="openshift-image-registry/node-ca-jv7wk"
Sep 17 10:53:32.578033 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.578002    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rkvc\" (UniqueName: \"kubernetes.io/projected/89b9f0b0-986a-461c-bb56-8c747c1e21bd-kube-api-access-5rkvc\") pod \"node-ca-jv7wk\" (UID: \"89b9f0b0-986a-461c-bb56-8c747c1e21bd\") " pod="openshift-image-registry/node-ca-jv7wk"
Sep 17 10:53:32.578033 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.578028    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-var-lib-kubelet\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.578533 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.578052    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/afe38f2b-75ab-4150-87dc-a948eba57e44-hosts-file\") pod \"node-resolver-nwlxk\" (UID: \"afe38f2b-75ab-4150-87dc-a948eba57e44\") " pod="openshift-dns/node-resolver-nwlxk"
Sep 17 10:53:32.578533 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.578075    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/436e3582-44b3-4a08-9192-c700c482f195-agent-certs\") pod \"konnectivity-agent-snvdp\" (UID: \"436e3582-44b3-4a08-9192-c700c482f195\") " pod="kube-system/konnectivity-agent-snvdp"
Sep 17 10:53:32.578533 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.578098    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89b9f0b0-986a-461c-bb56-8c747c1e21bd-serviceca\") pod \"node-ca-jv7wk\" (UID: \"89b9f0b0-986a-461c-bb56-8c747c1e21bd\") " pod="openshift-image-registry/node-ca-jv7wk"
Sep 17 10:53:32.578533 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.578123    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/35649e42-ddd5-4c48-a38c-a7486bbcd3e4-iptables-alerter-script\") pod \"iptables-alerter-2s6tr\" (UID: \"35649e42-ddd5-4c48-a38c-a7486bbcd3e4\") " pod="openshift-network-operator/iptables-alerter-2s6tr"
Sep 17 10:53:32.578533 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.578163    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvz8g\" (UniqueName: \"kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g\") pod \"network-check-target-l9f4s\" (UID: \"2e6652dd-cd64-4562-9340-bba6e831af73\") " pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:32.578533 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.578204    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.578533 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.578230    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35649e42-ddd5-4c48-a38c-a7486bbcd3e4-host-slash\") pod \"iptables-alerter-2s6tr\" (UID: \"35649e42-ddd5-4c48-a38c-a7486bbcd3e4\") " pod="openshift-network-operator/iptables-alerter-2s6tr"
Sep 17 10:53:32.578533 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.578258    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-tuned\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.579366 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.579348    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.581088 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.581070    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:32.581165 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:32.581130    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v56d8" podUID="ef38bd1a-72d9-451f-b754-72d2fd579687"
Sep 17 10:53:32.585439 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.585420    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 10:53:32.585833 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.585598    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-98pzb\""
Sep 17 10:53:32.585833 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.585734    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 10:53:32.585833 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.585765    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 10:53:32.585833 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.585825    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 10:53:32.586060 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.585848    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 10:53:32.586060 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.586031    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 10:53:32.586158 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.586126    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-96p5l\""
Sep 17 10:53:32.586208 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.586190    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 10:53:32.586817 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.586797    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 10:53:32.587073 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.587059    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 10:53:32.587417 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.587262    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 10:53:32.587417 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.587269    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kjhsk\""
Sep 17 10:53:32.605304 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.605242    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 10:53:32.660068 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.660044    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ssbb4"
Sep 17 10:53:32.668899 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.668874    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 10:53:32.672633 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.672613    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ssbb4"
Sep 17 10:53:32.679240 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679217    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac62c987-276e-4087-917b-cd0d72f5faa7-ovnkube-config\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.679349 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679255    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dbg4\" (UniqueName: \"kubernetes.io/projected/0a7d16ad-7271-4ca2-b3fa-0f8886981659-kube-api-access-9dbg4\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.679349 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679278    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/baf17d4d-3a35-4d1c-8f55-56ced95456e5-registration-dir\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.679349 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679309    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.679349 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679333    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-multus-cni-dir\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.679556 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679359    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-host-var-lib-cni-multus\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.679556 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679383    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0a7d16ad-7271-4ca2-b3fa-0f8886981659-multus-daemon-config\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.679556 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679407    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef38bd1a-72d9-451f-b754-72d2fd579687-kubelet-config\") pod \"global-pull-secret-syncer-v56d8\" (UID: \"ef38bd1a-72d9-451f-b754-72d2fd579687\") " pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:32.679556 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679431    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/baf17d4d-3a35-4d1c-8f55-56ced95456e5-socket-dir\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.679556 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679455    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-kubernetes\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.679556 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679489    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.679556 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679528    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/436e3582-44b3-4a08-9192-c700c482f195-konnectivity-ca\") pod \"konnectivity-agent-snvdp\" (UID: \"436e3582-44b3-4a08-9192-c700c482f195\") " pod="kube-system/konnectivity-agent-snvdp"
Sep 17 10:53:32.679556 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679552    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rkvc\" (UniqueName: \"kubernetes.io/projected/89b9f0b0-986a-461c-bb56-8c747c1e21bd-kube-api-access-5rkvc\") pod \"node-ca-jv7wk\" (UID: \"89b9f0b0-986a-461c-bb56-8c747c1e21bd\") " pod="openshift-image-registry/node-ca-jv7wk"
Sep 17 10:53:32.679922 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679597    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-kubelet\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.679922 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679671    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-var-lib-openvswitch\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.679922 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679711    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-run-openvswitch\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.679922 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679734    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef38bd1a-72d9-451f-b754-72d2fd579687-dbus\") pod \"global-pull-secret-syncer-v56d8\" (UID: \"ef38bd1a-72d9-451f-b754-72d2fd579687\") " pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:32.679922 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679763    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/afe38f2b-75ab-4150-87dc-a948eba57e44-hosts-file\") pod \"node-resolver-nwlxk\" (UID: \"afe38f2b-75ab-4150-87dc-a948eba57e44\") " pod="openshift-dns/node-resolver-nwlxk"
Sep 17 10:53:32.679922 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679780    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.679922 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679789    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-hostroot\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.679922 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679817    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-etc-openvswitch\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.679922 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679878    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-run-ovn-kubernetes\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.679922 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679901    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-cni-netd\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.679922 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679909    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/afe38f2b-75ab-4150-87dc-a948eba57e44-hosts-file\") pod \"node-resolver-nwlxk\" (UID: \"afe38f2b-75ab-4150-87dc-a948eba57e44\") " pod="openshift-dns/node-resolver-nwlxk"
Sep 17 10:53:32.680279 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679936    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret\") pod \"global-pull-secret-syncer-v56d8\" (UID: \"ef38bd1a-72d9-451f-b754-72d2fd579687\") " pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:32.680279 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679964    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sxlh\" (UniqueName: \"kubernetes.io/projected/baf17d4d-3a35-4d1c-8f55-56ced95456e5-kube-api-access-6sxlh\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.680279 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.679992    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/35649e42-ddd5-4c48-a38c-a7486bbcd3e4-iptables-alerter-script\") pod \"iptables-alerter-2s6tr\" (UID: \"35649e42-ddd5-4c48-a38c-a7486bbcd3e4\") " pod="openshift-network-operator/iptables-alerter-2s6tr"
Sep 17 10:53:32.680279 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680017    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.680279 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680024    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-kubernetes\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.680279 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680046    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35649e42-ddd5-4c48-a38c-a7486bbcd3e4-host-slash\") pod \"iptables-alerter-2s6tr\" (UID: \"35649e42-ddd5-4c48-a38c-a7486bbcd3e4\") " pod="openshift-network-operator/iptables-alerter-2s6tr"
Sep 17 10:53:32.680279 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680076    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-system-cni-dir\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.680279 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680127    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35649e42-ddd5-4c48-a38c-a7486bbcd3e4-host-slash\") pod \"iptables-alerter-2s6tr\" (UID: \"35649e42-ddd5-4c48-a38c-a7486bbcd3e4\") " pod="openshift-network-operator/iptables-alerter-2s6tr"
Sep 17 10:53:32.680279 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680163    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a7d16ad-7271-4ca2-b3fa-0f8886981659-cni-binary-copy\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.680279 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680169    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/436e3582-44b3-4a08-9192-c700c482f195-konnectivity-ca\") pod \"konnectivity-agent-snvdp\" (UID: \"436e3582-44b3-4a08-9192-c700c482f195\") " pod="kube-system/konnectivity-agent-snvdp"
Sep 17 10:53:32.680279 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680188    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-run-netns\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.680279 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680215    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/baf17d4d-3a35-4d1c-8f55-56ced95456e5-device-dir\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.680279 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680220    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.680279 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680245    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-system-cni-dir\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.680699 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680305    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-host-run-netns\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.680699 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680335    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-host-var-lib-cni-bin\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.680699 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680361    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-sysctl-d\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.680699 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680390    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-sys\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.680699 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680415    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5sk5\" (UniqueName: \"kubernetes.io/projected/ac33a910-7eec-4397-8b78-0ebce51a572d-kube-api-access-h5sk5\") pod \"network-metrics-daemon-9vjl6\" (UID: \"ac33a910-7eec-4397-8b78-0ebce51a572d\") " pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:32.680699 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680449    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-cnibin\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.680699 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680471    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-system-cni-dir\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.680699 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680492    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-sysctl-d\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.680699 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680529    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-run-systemd\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.680699 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680548    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-sys\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.680699 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680555    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-systemd\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.680699 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680584    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-cnibin\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.680699 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680601    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/35649e42-ddd5-4c48-a38c-a7486bbcd3e4-iptables-alerter-script\") pod \"iptables-alerter-2s6tr\" (UID: \"35649e42-ddd5-4c48-a38c-a7486bbcd3e4\") " pod="openshift-network-operator/iptables-alerter-2s6tr"
Sep 17 10:53:32.680699 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680614    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-host\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.680699 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680633    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-systemd\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.680699 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680677    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afe38f2b-75ab-4150-87dc-a948eba57e44-tmp-dir\") pod \"node-resolver-nwlxk\" (UID: \"afe38f2b-75ab-4150-87dc-a948eba57e44\") " pod="openshift-dns/node-resolver-nwlxk"
Sep 17 10:53:32.680699 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680694    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-host\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.681220 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680722    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-log-socket\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.681220 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680763    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac62c987-276e-4087-917b-cd0d72f5faa7-env-overrides\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.681220 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680859    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac62c987-276e-4087-917b-cd0d72f5faa7-ovn-node-metrics-cert\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.681220 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680889    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-tmp\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.681220 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680924    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-cni-binary-copy\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.681220 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680956    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkgnf\" (UniqueName: \"kubernetes.io/projected/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-kube-api-access-nkgnf\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.681220 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680983    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-cni-bin\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.681220 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.681010    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djpkb\" (UniqueName: \"kubernetes.io/projected/35649e42-ddd5-4c48-a38c-a7486bbcd3e4-kube-api-access-djpkb\") pod \"iptables-alerter-2s6tr\" (UID: \"35649e42-ddd5-4c48-a38c-a7486bbcd3e4\") " pod="openshift-network-operator/iptables-alerter-2s6tr"
Sep 17 10:53:32.681220 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.680984    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/afe38f2b-75ab-4150-87dc-a948eba57e44-tmp-dir\") pod \"node-resolver-nwlxk\" (UID: \"afe38f2b-75ab-4150-87dc-a948eba57e44\") " pod="openshift-dns/node-resolver-nwlxk"
Sep 17 10:53:32.681713 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.681341    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 10:53:32.681713 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.681422    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-cni-binary-copy\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.681713 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.681437    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-run\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.681893 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.681757    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-run\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.681893 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.681797    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-slash\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.681893 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.681823    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-run-ovn\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.681893 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.681847    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/baf17d4d-3a35-4d1c-8f55-56ced95456e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.681893 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.681872    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89b9f0b0-986a-461c-bb56-8c747c1e21bd-host\") pod \"node-ca-jv7wk\" (UID: \"89b9f0b0-986a-461c-bb56-8c747c1e21bd\") " pod="openshift-image-registry/node-ca-jv7wk"
Sep 17 10:53:32.682235 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.681904    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-multus-conf-dir\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.682235 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.681927    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac62c987-276e-4087-917b-cd0d72f5faa7-ovnkube-script-lib\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.682235 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.681951    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/baf17d4d-3a35-4d1c-8f55-56ced95456e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.682235 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.681975    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-var-lib-kubelet\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.682235 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.681999    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/436e3582-44b3-4a08-9192-c700c482f195-agent-certs\") pod \"konnectivity-agent-snvdp\" (UID: \"436e3582-44b3-4a08-9192-c700c482f195\") " pod="kube-system/konnectivity-agent-snvdp"
Sep 17 10:53:32.682235 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682020    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89b9f0b0-986a-461c-bb56-8c747c1e21bd-serviceca\") pod \"node-ca-jv7wk\" (UID: \"89b9f0b0-986a-461c-bb56-8c747c1e21bd\") " pod="openshift-image-registry/node-ca-jv7wk"
Sep 17 10:53:32.682235 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682045    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-host-run-multus-certs\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.682235 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682069    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/baf17d4d-3a35-4d1c-8f55-56ced95456e5-sys-fs\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.682235 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682093    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvz8g\" (UniqueName: \"kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g\") pod \"network-check-target-l9f4s\" (UID: \"2e6652dd-cd64-4562-9340-bba6e831af73\") " pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:32.682235 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682117    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.682235 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682143    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-host-run-k8s-cni-cncf-io\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.682235 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682166    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-node-log\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.682235 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682189    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-tuned\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.682235 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682213    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6q66\" (UniqueName: \"kubernetes.io/projected/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-kube-api-access-m6q66\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.682235 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682235    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-host-var-lib-kubelet\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.683066 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682258    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-multus-socket-dir-parent\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.683066 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682281    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cckzp\" (UniqueName: \"kubernetes.io/projected/afe38f2b-75ab-4150-87dc-a948eba57e44-kube-api-access-cckzp\") pod \"node-resolver-nwlxk\" (UID: \"afe38f2b-75ab-4150-87dc-a948eba57e44\") " pod="openshift-dns/node-resolver-nwlxk"
Sep 17 10:53:32.683066 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682305    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-modprobe-d\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.683066 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682328    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-sysctl-conf\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.683066 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682352    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs\") pod \"network-metrics-daemon-9vjl6\" (UID: \"ac33a910-7eec-4397-8b78-0ebce51a572d\") " pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:32.683066 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682376    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf8gs\" (UniqueName: \"kubernetes.io/projected/ac62c987-276e-4087-917b-cd0d72f5faa7-kube-api-access-nf8gs\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.683066 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682398    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-sysconfig\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.683066 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682420    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-lib-modules\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.683066 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682441    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-cnibin\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.683066 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682462    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-etc-kubernetes\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.683066 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682484    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-systemd-units\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.683066 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682860    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-sysctl-conf\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.683066 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682873    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.683066 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.682951    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89b9f0b0-986a-461c-bb56-8c747c1e21bd-host\") pod \"node-ca-jv7wk\" (UID: \"89b9f0b0-986a-461c-bb56-8c747c1e21bd\") " pod="openshift-image-registry/node-ca-jv7wk"
Sep 17 10:53:32.683066 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.683068    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-modprobe-d\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.683823 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.683113    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-var-lib-kubelet\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.683823 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.683173    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-sysconfig\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.683823 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:32.683252    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 10:53:32.683823 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:32.683309    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs podName:ac33a910-7eec-4397-8b78-0ebce51a572d nodeName:}" failed. No retries permitted until 2026-09-17 10:53:33.183290484 +0000 UTC m=+2.978624922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs") pod "network-metrics-daemon-9vjl6" (UID: "ac33a910-7eec-4397-8b78-0ebce51a572d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 10:53:32.683823 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.683367    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-lib-modules\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.683823 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.683461    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89b9f0b0-986a-461c-bb56-8c747c1e21bd-serviceca\") pod \"node-ca-jv7wk\" (UID: \"89b9f0b0-986a-461c-bb56-8c747c1e21bd\") " pod="openshift-image-registry/node-ca-jv7wk"
Sep 17 10:53:32.686060 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.685880    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-etc-tuned\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.686407 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.686340    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-tmp\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.686407 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.686352    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/436e3582-44b3-4a08-9192-c700c482f195-agent-certs\") pod \"konnectivity-agent-snvdp\" (UID: \"436e3582-44b3-4a08-9192-c700c482f195\") " pod="kube-system/konnectivity-agent-snvdp"
Sep 17 10:53:32.688156 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.688088    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal" event={"ID":"0e9bd5460479070ecb380c4ff6316476","Type":"ContainerStarted","Data":"115e04d7f51efb67dad7a515f84cafbd07049167611dd699f6909dffed31dadd"}
Sep 17 10:53:32.689761 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.689715    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal" event={"ID":"629fab160c36a1e0f1caa6028bf89993","Type":"ContainerStarted","Data":"7f506f017f09e85f9881cde0a15c5f833df31ee3bce5aeb0ca470b5909e6cb18"}
Sep 17 10:53:32.701062 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.700959    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rkvc\" (UniqueName: \"kubernetes.io/projected/89b9f0b0-986a-461c-bb56-8c747c1e21bd-kube-api-access-5rkvc\") pod \"node-ca-jv7wk\" (UID: \"89b9f0b0-986a-461c-bb56-8c747c1e21bd\") " pod="openshift-image-registry/node-ca-jv7wk"
Sep 17 10:53:32.701062 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.700962    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cckzp\" (UniqueName: \"kubernetes.io/projected/afe38f2b-75ab-4150-87dc-a948eba57e44-kube-api-access-cckzp\") pod \"node-resolver-nwlxk\" (UID: \"afe38f2b-75ab-4150-87dc-a948eba57e44\") " pod="openshift-dns/node-resolver-nwlxk"
Sep 17 10:53:32.703070 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.703050    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkgnf\" (UniqueName: \"kubernetes.io/projected/d69fbe5e-a4fa-4c31-bea1-4a64c368957a-kube-api-access-nkgnf\") pod \"multus-additional-cni-plugins-287pf\" (UID: \"d69fbe5e-a4fa-4c31-bea1-4a64c368957a\") " pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.703504 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.703482    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5sk5\" (UniqueName: \"kubernetes.io/projected/ac33a910-7eec-4397-8b78-0ebce51a572d-kube-api-access-h5sk5\") pod \"network-metrics-daemon-9vjl6\" (UID: \"ac33a910-7eec-4397-8b78-0ebce51a572d\") " pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:32.703893 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.703876    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djpkb\" (UniqueName: \"kubernetes.io/projected/35649e42-ddd5-4c48-a38c-a7486bbcd3e4-kube-api-access-djpkb\") pod \"iptables-alerter-2s6tr\" (UID: \"35649e42-ddd5-4c48-a38c-a7486bbcd3e4\") " pod="openshift-network-operator/iptables-alerter-2s6tr"
Sep 17 10:53:32.704914 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.704895    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6q66\" (UniqueName: \"kubernetes.io/projected/00b01da5-a5aa-4a50-bf07-08c3c8f31aba-kube-api-access-m6q66\") pod \"tuned-nvvk5\" (UID: \"00b01da5-a5aa-4a50-bf07-08c3c8f31aba\") " pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.710091 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:32.710072    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 10:53:32.710091 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:32.710093    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 10:53:32.710211 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:32.710103    2570 projected.go:196] Error preparing data for projected volume kube-api-access-xvz8g for pod openshift-network-diagnostics/network-check-target-l9f4s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 10:53:32.710211 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:32.710161    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g podName:2e6652dd-cd64-4562-9340-bba6e831af73 nodeName:}" failed. No retries permitted until 2026-09-17 10:53:33.210146045 +0000 UTC m=+3.005480464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xvz8g" (UniqueName: "kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g") pod "network-check-target-l9f4s" (UID: "2e6652dd-cd64-4562-9340-bba6e831af73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 10:53:32.783271 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783234    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-host-run-multus-certs\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.783271 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783279    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/baf17d4d-3a35-4d1c-8f55-56ced95456e5-sys-fs\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.783490 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783316    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-host-run-k8s-cni-cncf-io\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.783490 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783341    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-node-log\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.783490 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783351    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-host-run-multus-certs\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.783490 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783366    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-host-var-lib-kubelet\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.783490 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783405    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-multus-socket-dir-parent\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.783490 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783416    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-host-run-k8s-cni-cncf-io\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.783490 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783419    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-node-log\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.783490 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783448    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/baf17d4d-3a35-4d1c-8f55-56ced95456e5-sys-fs\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.783490 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783455    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf8gs\" (UniqueName: \"kubernetes.io/projected/ac62c987-276e-4087-917b-cd0d72f5faa7-kube-api-access-nf8gs\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.783490 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783461    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-host-var-lib-kubelet\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.783490 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783482    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-cnibin\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.784035 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783471    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-multus-socket-dir-parent\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.784035 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783505    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-etc-kubernetes\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.784035 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783554    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-etc-kubernetes\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.784035 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783561    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-cnibin\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.784035 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783569    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-systemd-units\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.784035 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783596    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac62c987-276e-4087-917b-cd0d72f5faa7-ovnkube-config\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.784035 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783599    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-systemd-units\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.784035 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783621    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dbg4\" (UniqueName: \"kubernetes.io/projected/0a7d16ad-7271-4ca2-b3fa-0f8886981659-kube-api-access-9dbg4\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.784035 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783648    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/baf17d4d-3a35-4d1c-8f55-56ced95456e5-registration-dir\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.784035 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783682    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-multus-cni-dir\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.784035 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783705    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-host-var-lib-cni-multus\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.784035 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783728    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0a7d16ad-7271-4ca2-b3fa-0f8886981659-multus-daemon-config\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.784035 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783729    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/baf17d4d-3a35-4d1c-8f55-56ced95456e5-registration-dir\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.784035 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783761    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef38bd1a-72d9-451f-b754-72d2fd579687-kubelet-config\") pod \"global-pull-secret-syncer-v56d8\" (UID: \"ef38bd1a-72d9-451f-b754-72d2fd579687\") " pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:32.784035 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783788    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/baf17d4d-3a35-4d1c-8f55-56ced95456e5-socket-dir\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.784035 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783815    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-kubelet\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.784035 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783827    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef38bd1a-72d9-451f-b754-72d2fd579687-kubelet-config\") pod \"global-pull-secret-syncer-v56d8\" (UID: \"ef38bd1a-72d9-451f-b754-72d2fd579687\") " pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:32.784772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783838    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-var-lib-openvswitch\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.784772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783850    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-multus-cni-dir\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.784772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783861    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-run-openvswitch\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.784772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783883    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef38bd1a-72d9-451f-b754-72d2fd579687-dbus\") pod \"global-pull-secret-syncer-v56d8\" (UID: \"ef38bd1a-72d9-451f-b754-72d2fd579687\") " pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:32.784772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783893    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-host-var-lib-cni-multus\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.784772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783906    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-hostroot\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.784772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783907    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-kubelet\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.784772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783942    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-run-openvswitch\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.784772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783945    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/baf17d4d-3a35-4d1c-8f55-56ced95456e5-socket-dir\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.784772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783944    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-hostroot\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.784772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783959    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef38bd1a-72d9-451f-b754-72d2fd579687-dbus\") pod \"global-pull-secret-syncer-v56d8\" (UID: \"ef38bd1a-72d9-451f-b754-72d2fd579687\") " pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:32.784772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783943    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-var-lib-openvswitch\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.784772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783962    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-etc-openvswitch\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.784772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.783989    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-etc-openvswitch\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.784772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784001    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-run-ovn-kubernetes\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.784772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784024    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-cni-netd\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.784772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784048    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret\") pod \"global-pull-secret-syncer-v56d8\" (UID: \"ef38bd1a-72d9-451f-b754-72d2fd579687\") " pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:32.784772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784056    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-run-ovn-kubernetes\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.785430 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784072    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sxlh\" (UniqueName: \"kubernetes.io/projected/baf17d4d-3a35-4d1c-8f55-56ced95456e5-kube-api-access-6sxlh\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.785430 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784091    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-cni-netd\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.785430 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784101    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.785430 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:32.784137    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 10:53:32.785430 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784172    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ac62c987-276e-4087-917b-cd0d72f5faa7-ovnkube-config\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.785430 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784139    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a7d16ad-7271-4ca2-b3fa-0f8886981659-cni-binary-copy\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.785430 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:32.784201    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret podName:ef38bd1a-72d9-451f-b754-72d2fd579687 nodeName:}" failed. No retries permitted until 2026-09-17 10:53:33.284184079 +0000 UTC m=+3.079518512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret") pod "global-pull-secret-syncer-v56d8" (UID: "ef38bd1a-72d9-451f-b754-72d2fd579687") : object "kube-system"/"original-pull-secret" not registered
Sep 17 10:53:32.785430 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784136    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.785430 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784231    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-run-netns\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.785430 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784258    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/baf17d4d-3a35-4d1c-8f55-56ced95456e5-device-dir\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.785430 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784280    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-host-run-netns\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.785430 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784306    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-run-netns\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.785430 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784323    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-host-run-netns\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.785430 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784328    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/baf17d4d-3a35-4d1c-8f55-56ced95456e5-device-dir\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.785430 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784325    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0a7d16ad-7271-4ca2-b3fa-0f8886981659-multus-daemon-config\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.785430 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784355    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-host-var-lib-cni-bin\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.785430 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784383    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-system-cni-dir\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.786029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784409    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-run-systemd\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.786029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784410    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-host-var-lib-cni-bin\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.786029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784436    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-log-socket\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.786029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784438    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-system-cni-dir\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.786029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784441    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-run-systemd\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.786029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784460    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac62c987-276e-4087-917b-cd0d72f5faa7-env-overrides\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.786029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784485    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac62c987-276e-4087-917b-cd0d72f5faa7-ovn-node-metrics-cert\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.786029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784497    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-log-socket\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.786029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784534    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-cni-bin\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.786029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784560    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-slash\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.786029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784582    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-run-ovn\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.786029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784593    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0a7d16ad-7271-4ca2-b3fa-0f8886981659-cni-binary-copy\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.786029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784606    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/baf17d4d-3a35-4d1c-8f55-56ced95456e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.786029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784630    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-multus-conf-dir\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.786029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784651    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-cni-bin\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.786029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784652    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac62c987-276e-4087-917b-cd0d72f5faa7-ovnkube-script-lib\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.786029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784690    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/baf17d4d-3a35-4d1c-8f55-56ced95456e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.786029 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784720    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/baf17d4d-3a35-4d1c-8f55-56ced95456e5-etc-selinux\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.786639 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784751    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/baf17d4d-3a35-4d1c-8f55-56ced95456e5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.786639 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784769    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-run-ovn\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.786639 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784789    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ac62c987-276e-4087-917b-cd0d72f5faa7-host-slash\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.786639 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784813    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0a7d16ad-7271-4ca2-b3fa-0f8886981659-multus-conf-dir\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.786639 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.784873    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ac62c987-276e-4087-917b-cd0d72f5faa7-env-overrides\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.786639 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.785111    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ac62c987-276e-4087-917b-cd0d72f5faa7-ovnkube-script-lib\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.787017 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.787000    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ac62c987-276e-4087-917b-cd0d72f5faa7-ovn-node-metrics-cert\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.802587 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.802539    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sxlh\" (UniqueName: \"kubernetes.io/projected/baf17d4d-3a35-4d1c-8f55-56ced95456e5-kube-api-access-6sxlh\") pod \"aws-ebs-csi-driver-node-k8td9\" (UID: \"baf17d4d-3a35-4d1c-8f55-56ced95456e5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.804658 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.804637    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf8gs\" (UniqueName: \"kubernetes.io/projected/ac62c987-276e-4087-917b-cd0d72f5faa7-kube-api-access-nf8gs\") pod \"ovnkube-node-lv7s5\" (UID: \"ac62c987-276e-4087-917b-cd0d72f5faa7\") " pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:32.804742 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.804677    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dbg4\" (UniqueName: \"kubernetes.io/projected/0a7d16ad-7271-4ca2-b3fa-0f8886981659-kube-api-access-9dbg4\") pod \"multus-hbhhp\" (UID: \"0a7d16ad-7271-4ca2-b3fa-0f8886981659\") " pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.875189 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.875152    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2s6tr"
Sep 17 10:53:32.882132 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.882115    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nvvk5"
Sep 17 10:53:32.891030 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.891013    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nwlxk"
Sep 17 10:53:32.897849 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.897827    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-287pf"
Sep 17 10:53:32.906487 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.906470    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-snvdp"
Sep 17 10:53:32.914394 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.914376    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jv7wk"
Sep 17 10:53:32.922039 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.922021    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hbhhp"
Sep 17 10:53:32.938561 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.938540    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9"
Sep 17 10:53:32.943615 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:32.943599    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:33.187855 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:33.187770    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs\") pod \"network-metrics-daemon-9vjl6\" (UID: \"ac33a910-7eec-4397-8b78-0ebce51a572d\") " pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:33.188050 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:33.187905    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 10:53:33.188050 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:33.187970    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs podName:ac33a910-7eec-4397-8b78-0ebce51a572d nodeName:}" failed. No retries permitted until 2026-09-17 10:53:34.18795203 +0000 UTC m=+3.983286452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs") pod "network-metrics-daemon-9vjl6" (UID: "ac33a910-7eec-4397-8b78-0ebce51a572d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 10:53:33.288503 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:33.288471    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret\") pod \"global-pull-secret-syncer-v56d8\" (UID: \"ef38bd1a-72d9-451f-b754-72d2fd579687\") " pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:33.288681 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:33.288653    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 10:53:33.288742 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:33.288719    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret podName:ef38bd1a-72d9-451f-b754-72d2fd579687 nodeName:}" failed. No retries permitted until 2026-09-17 10:53:34.288703193 +0000 UTC m=+4.084037610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret") pod "global-pull-secret-syncer-v56d8" (UID: "ef38bd1a-72d9-451f-b754-72d2fd579687") : object "kube-system"/"original-pull-secret" not registered
Sep 17 10:53:33.288742 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:33.288662    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvz8g\" (UniqueName: \"kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g\") pod \"network-check-target-l9f4s\" (UID: \"2e6652dd-cd64-4562-9340-bba6e831af73\") " pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:33.288874 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:33.288785    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 10:53:33.288874 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:33.288807    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 10:53:33.288874 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:33.288820    2570 projected.go:196] Error preparing data for projected volume kube-api-access-xvz8g for pod openshift-network-diagnostics/network-check-target-l9f4s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 10:53:33.289015 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:33.288882    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g podName:2e6652dd-cd64-4562-9340-bba6e831af73 nodeName:}" failed. No retries permitted until 2026-09-17 10:53:34.288863376 +0000 UTC m=+4.084197797 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xvz8g" (UniqueName: "kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g") pod "network-check-target-l9f4s" (UID: "2e6652dd-cd64-4562-9340-bba6e831af73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 10:53:33.655924 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:33.655899    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89b9f0b0_986a_461c_bb56_8c747c1e21bd.slice/crio-eb2b991a4ffa7583b550685f74f05cd8e217f63f63fac61ed85a916ebc3e969d WatchSource:0}: Error finding container eb2b991a4ffa7583b550685f74f05cd8e217f63f63fac61ed85a916ebc3e969d: Status 404 returned error can't find the container with id eb2b991a4ffa7583b550685f74f05cd8e217f63f63fac61ed85a916ebc3e969d
Sep 17 10:53:33.657837 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:33.657446    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd69fbe5e_a4fa_4c31_bea1_4a64c368957a.slice/crio-2e632e0d0f59466264dbfa9e3a712c06748e7c0c8a2be06770838efbf040ccf9 WatchSource:0}: Error finding container 2e632e0d0f59466264dbfa9e3a712c06748e7c0c8a2be06770838efbf040ccf9: Status 404 returned error can't find the container with id 2e632e0d0f59466264dbfa9e3a712c06748e7c0c8a2be06770838efbf040ccf9
Sep 17 10:53:33.661101 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:33.660142    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a7d16ad_7271_4ca2_b3fa_0f8886981659.slice/crio-e693fd01789c953ff6032e8a1747de03e716d31acfcb5ed3f6aa481661ef0be0 WatchSource:0}: Error finding container e693fd01789c953ff6032e8a1747de03e716d31acfcb5ed3f6aa481661ef0be0: Status 404 returned error can't find the container with id e693fd01789c953ff6032e8a1747de03e716d31acfcb5ed3f6aa481661ef0be0
Sep 17 10:53:33.663445 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:33.663402    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaf17d4d_3a35_4d1c_8f55_56ced95456e5.slice/crio-c7158d4ad4c3023277515dbaedf7fff8398ed0e6270534084a3d9357cb23efd2 WatchSource:0}: Error finding container c7158d4ad4c3023277515dbaedf7fff8398ed0e6270534084a3d9357cb23efd2: Status 404 returned error can't find the container with id c7158d4ad4c3023277515dbaedf7fff8398ed0e6270534084a3d9357cb23efd2
Sep 17 10:53:33.665338 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:33.664965    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b01da5_a5aa_4a50_bf07_08c3c8f31aba.slice/crio-5947fd558dfa65e8d206c85d14d1ebc385854ea5f69fd8fbb7b53a78c4bb0696 WatchSource:0}: Error finding container 5947fd558dfa65e8d206c85d14d1ebc385854ea5f69fd8fbb7b53a78c4bb0696: Status 404 returned error can't find the container with id 5947fd558dfa65e8d206c85d14d1ebc385854ea5f69fd8fbb7b53a78c4bb0696
Sep 17 10:53:33.667322 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:33.667292    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35649e42_ddd5_4c48_a38c_a7486bbcd3e4.slice/crio-8c2e8272078874cced8a6136a244f5e8e462f85df7f901b43d915ee2c15932d8 WatchSource:0}: Error finding container 8c2e8272078874cced8a6136a244f5e8e462f85df7f901b43d915ee2c15932d8: Status 404 returned error can't find the container with id 8c2e8272078874cced8a6136a244f5e8e462f85df7f901b43d915ee2c15932d8
Sep 17 10:53:33.668796 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:33.668716    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac62c987_276e_4087_917b_cd0d72f5faa7.slice/crio-9c0ea6f412989d2208d8d33aff6a702b18641cc2ad4c338e0c8d5fd0dc445f24 WatchSource:0}: Error finding container 9c0ea6f412989d2208d8d33aff6a702b18641cc2ad4c338e0c8d5fd0dc445f24: Status 404 returned error can't find the container with id 9c0ea6f412989d2208d8d33aff6a702b18641cc2ad4c338e0c8d5fd0dc445f24
Sep 17 10:53:33.669811 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:53:33.669791    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe38f2b_75ab_4150_87dc_a948eba57e44.slice/crio-01641e36065615466a32b2aa0ee0db5bdec3c465eba00d616c8dfd0be4ea5c57 WatchSource:0}: Error finding container 01641e36065615466a32b2aa0ee0db5bdec3c465eba00d616c8dfd0be4ea5c57: Status 404 returned error can't find the container with id 01641e36065615466a32b2aa0ee0db5bdec3c465eba00d616c8dfd0be4ea5c57
Sep 17 10:53:33.674726 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:33.674679    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 10:48:32 +0000 UTC" deadline="2028-05-01 13:22:05.1493365 +0000 UTC"
Sep 17 10:53:33.674726 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:33.674725    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14210h28m31.474614683s"
Sep 17 10:53:33.696623 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:33.696449    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nwlxk" event={"ID":"afe38f2b-75ab-4150-87dc-a948eba57e44","Type":"ContainerStarted","Data":"01641e36065615466a32b2aa0ee0db5bdec3c465eba00d616c8dfd0be4ea5c57"}
Sep 17 10:53:33.699621 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:33.699597    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2s6tr" event={"ID":"35649e42-ddd5-4c48-a38c-a7486bbcd3e4","Type":"ContainerStarted","Data":"8c2e8272078874cced8a6136a244f5e8e462f85df7f901b43d915ee2c15932d8"}
Sep 17 10:53:33.701142 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:33.701122    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-snvdp" event={"ID":"436e3582-44b3-4a08-9192-c700c482f195","Type":"ContainerStarted","Data":"8fc9eb5b9d558478e2e52445fa1789aee68374cd7e65540d4995f286701632b0"}
Sep 17 10:53:33.702792 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:33.702767    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9" event={"ID":"baf17d4d-3a35-4d1c-8f55-56ced95456e5","Type":"ContainerStarted","Data":"c7158d4ad4c3023277515dbaedf7fff8398ed0e6270534084a3d9357cb23efd2"}
Sep 17 10:53:33.703823 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:33.703798    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-287pf" event={"ID":"d69fbe5e-a4fa-4c31-bea1-4a64c368957a","Type":"ContainerStarted","Data":"2e632e0d0f59466264dbfa9e3a712c06748e7c0c8a2be06770838efbf040ccf9"}
Sep 17 10:53:33.706211 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:33.706187    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5" event={"ID":"ac62c987-276e-4087-917b-cd0d72f5faa7","Type":"ContainerStarted","Data":"9c0ea6f412989d2208d8d33aff6a702b18641cc2ad4c338e0c8d5fd0dc445f24"}
Sep 17 10:53:33.709446 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:33.709427    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nvvk5" event={"ID":"00b01da5-a5aa-4a50-bf07-08c3c8f31aba","Type":"ContainerStarted","Data":"5947fd558dfa65e8d206c85d14d1ebc385854ea5f69fd8fbb7b53a78c4bb0696"}
Sep 17 10:53:33.711461 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:33.711442    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hbhhp" event={"ID":"0a7d16ad-7271-4ca2-b3fa-0f8886981659","Type":"ContainerStarted","Data":"e693fd01789c953ff6032e8a1747de03e716d31acfcb5ed3f6aa481661ef0be0"}
Sep 17 10:53:33.712472 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:33.712454    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jv7wk" event={"ID":"89b9f0b0-986a-461c-bb56-8c747c1e21bd","Type":"ContainerStarted","Data":"eb2b991a4ffa7583b550685f74f05cd8e217f63f63fac61ed85a916ebc3e969d"}
Sep 17 10:53:34.195847 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:34.195233    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs\") pod \"network-metrics-daemon-9vjl6\" (UID: \"ac33a910-7eec-4397-8b78-0ebce51a572d\") " pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:34.195847 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:34.195391    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 10:53:34.195847 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:34.195452    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs podName:ac33a910-7eec-4397-8b78-0ebce51a572d nodeName:}" failed. No retries permitted until 2026-09-17 10:53:36.195433927 +0000 UTC m=+5.990768349 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs") pod "network-metrics-daemon-9vjl6" (UID: "ac33a910-7eec-4397-8b78-0ebce51a572d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 10:53:34.296411 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:34.296376    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret\") pod \"global-pull-secret-syncer-v56d8\" (UID: \"ef38bd1a-72d9-451f-b754-72d2fd579687\") " pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:34.296606 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:34.296445    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvz8g\" (UniqueName: \"kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g\") pod \"network-check-target-l9f4s\" (UID: \"2e6652dd-cd64-4562-9340-bba6e831af73\") " pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:34.296671 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:34.296612    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 10:53:34.296671 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:34.296629    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 10:53:34.296671 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:34.296641    2570 projected.go:196] Error preparing data for projected volume kube-api-access-xvz8g for pod openshift-network-diagnostics/network-check-target-l9f4s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 10:53:34.296823 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:34.296701    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g podName:2e6652dd-cd64-4562-9340-bba6e831af73 nodeName:}" failed. No retries permitted until 2026-09-17 10:53:36.296677138 +0000 UTC m=+6.092011557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xvz8g" (UniqueName: "kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g") pod "network-check-target-l9f4s" (UID: "2e6652dd-cd64-4562-9340-bba6e831af73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 10:53:34.297100 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:34.297071    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 10:53:34.297168 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:34.297132    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret podName:ef38bd1a-72d9-451f-b754-72d2fd579687 nodeName:}" failed. No retries permitted until 2026-09-17 10:53:36.297107751 +0000 UTC m=+6.092442173 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret") pod "global-pull-secret-syncer-v56d8" (UID: "ef38bd1a-72d9-451f-b754-72d2fd579687") : object "kube-system"/"original-pull-secret" not registered
Sep 17 10:53:34.675188 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:34.675082    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 10:48:32 +0000 UTC" deadline="2028-04-29 04:55:17.635014227 +0000 UTC"
Sep 17 10:53:34.675188 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:34.675121    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14154h1m42.959897806s"
Sep 17 10:53:34.686480 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:34.684097    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:34.686480 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:34.684204    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9f4s" podUID="2e6652dd-cd64-4562-9340-bba6e831af73"
Sep 17 10:53:34.686480 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:34.684602    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:34.686480 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:34.684711    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vjl6" podUID="ac33a910-7eec-4397-8b78-0ebce51a572d"
Sep 17 10:53:34.686480 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:34.684784    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:34.686480 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:34.684852    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v56d8" podUID="ef38bd1a-72d9-451f-b754-72d2fd579687"
Sep 17 10:53:34.728019 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:34.727812    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal" event={"ID":"0e9bd5460479070ecb380c4ff6316476","Type":"ContainerStarted","Data":"e8b425b3d6a2fe9036e4d2e9b33e71ae534174dc71b86629676deeff4c6bef2a"}
Sep 17 10:53:34.745615 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:34.745435    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-123.ec2.internal" podStartSLOduration=2.745416988 podStartE2EDuration="2.745416988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 10:53:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:53:34.74510487 +0000 UTC m=+4.540439310" watchObservedRunningTime="2026-09-17 10:53:34.745416988 +0000 UTC m=+4.540751428"
Sep 17 10:53:34.747594 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:34.746987    2570 generic.go:356] "Generic (PLEG): container finished" podID="629fab160c36a1e0f1caa6028bf89993" containerID="0ce96d83c7e5fe5ba26842fcee7c8772d46423624eb1b1d5546d1561382e4620" exitCode=0
Sep 17 10:53:34.747594 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:34.747033    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal" event={"ID":"629fab160c36a1e0f1caa6028bf89993","Type":"ContainerDied","Data":"0ce96d83c7e5fe5ba26842fcee7c8772d46423624eb1b1d5546d1561382e4620"}
Sep 17 10:53:35.788617 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:35.788579    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal" event={"ID":"629fab160c36a1e0f1caa6028bf89993","Type":"ContainerStarted","Data":"e1f857e729e571c59d81e7d825aa90a1208cb2c403b5b6d06e57729a7124ba9e"}
Sep 17 10:53:36.216903 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:36.216730    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs\") pod \"network-metrics-daemon-9vjl6\" (UID: \"ac33a910-7eec-4397-8b78-0ebce51a572d\") " pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:36.217079 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:36.216967    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 10:53:36.217079 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:36.217039    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs podName:ac33a910-7eec-4397-8b78-0ebce51a572d nodeName:}" failed. No retries permitted until 2026-09-17 10:53:40.217020085 +0000 UTC m=+10.012354506 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs") pod "network-metrics-daemon-9vjl6" (UID: "ac33a910-7eec-4397-8b78-0ebce51a572d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 10:53:36.318778 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:36.317972    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret\") pod \"global-pull-secret-syncer-v56d8\" (UID: \"ef38bd1a-72d9-451f-b754-72d2fd579687\") " pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:36.318778 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:36.318036    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvz8g\" (UniqueName: \"kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g\") pod \"network-check-target-l9f4s\" (UID: \"2e6652dd-cd64-4562-9340-bba6e831af73\") " pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:36.318778 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:36.318220    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 10:53:36.318778 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:36.318239    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 10:53:36.318778 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:36.318253    2570 projected.go:196] Error preparing data for projected volume kube-api-access-xvz8g for pod openshift-network-diagnostics/network-check-target-l9f4s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 10:53:36.318778 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:36.318310    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g podName:2e6652dd-cd64-4562-9340-bba6e831af73 nodeName:}" failed. No retries permitted until 2026-09-17 10:53:40.318291197 +0000 UTC m=+10.113625622 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xvz8g" (UniqueName: "kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g") pod "network-check-target-l9f4s" (UID: "2e6652dd-cd64-4562-9340-bba6e831af73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 10:53:36.318778 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:36.318701    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 10:53:36.318778 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:36.318749    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret podName:ef38bd1a-72d9-451f-b754-72d2fd579687 nodeName:}" failed. No retries permitted until 2026-09-17 10:53:40.318735147 +0000 UTC m=+10.114069569 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret") pod "global-pull-secret-syncer-v56d8" (UID: "ef38bd1a-72d9-451f-b754-72d2fd579687") : object "kube-system"/"original-pull-secret" not registered
Sep 17 10:53:36.693797 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:36.693724    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:36.694039 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:36.693841    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9f4s" podUID="2e6652dd-cd64-4562-9340-bba6e831af73"
Sep 17 10:53:36.694541 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:36.694247    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:36.694541 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:36.694354    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vjl6" podUID="ac33a910-7eec-4397-8b78-0ebce51a572d"
Sep 17 10:53:36.694541 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:36.694420    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:36.694541 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:36.694488    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v56d8" podUID="ef38bd1a-72d9-451f-b754-72d2fd579687"
Sep 17 10:53:38.684750 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:38.684720    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:38.684750 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:38.684753    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:38.685264 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:38.684720    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:38.685264 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:38.684889    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vjl6" podUID="ac33a910-7eec-4397-8b78-0ebce51a572d"
Sep 17 10:53:38.685264 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:38.684941    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v56d8" podUID="ef38bd1a-72d9-451f-b754-72d2fd579687"
Sep 17 10:53:38.685264 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:38.685013    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9f4s" podUID="2e6652dd-cd64-4562-9340-bba6e831af73"
Sep 17 10:53:40.252276 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:40.252234    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs\") pod \"network-metrics-daemon-9vjl6\" (UID: \"ac33a910-7eec-4397-8b78-0ebce51a572d\") " pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:40.252768 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:40.252394    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 10:53:40.252768 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:40.252457    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs podName:ac33a910-7eec-4397-8b78-0ebce51a572d nodeName:}" failed. No retries permitted until 2026-09-17 10:53:48.252438199 +0000 UTC m=+18.047772630 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs") pod "network-metrics-daemon-9vjl6" (UID: "ac33a910-7eec-4397-8b78-0ebce51a572d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 10:53:40.353561 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:40.353378    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret\") pod \"global-pull-secret-syncer-v56d8\" (UID: \"ef38bd1a-72d9-451f-b754-72d2fd579687\") " pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:40.353561 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:40.353460    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvz8g\" (UniqueName: \"kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g\") pod \"network-check-target-l9f4s\" (UID: \"2e6652dd-cd64-4562-9340-bba6e831af73\") " pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:40.353561 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:40.353560    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 10:53:40.353865 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:40.353633    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 10:53:40.353865 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:40.353652    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 10:53:40.353865 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:40.353663    2570 projected.go:196] Error preparing data for projected volume kube-api-access-xvz8g for pod openshift-network-diagnostics/network-check-target-l9f4s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 10:53:40.353865 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:40.353635    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret podName:ef38bd1a-72d9-451f-b754-72d2fd579687 nodeName:}" failed. No retries permitted until 2026-09-17 10:53:48.353615931 +0000 UTC m=+18.148950363 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret") pod "global-pull-secret-syncer-v56d8" (UID: "ef38bd1a-72d9-451f-b754-72d2fd579687") : object "kube-system"/"original-pull-secret" not registered
Sep 17 10:53:40.353865 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:40.353719    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g podName:2e6652dd-cd64-4562-9340-bba6e831af73 nodeName:}" failed. No retries permitted until 2026-09-17 10:53:48.353705166 +0000 UTC m=+18.149039585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xvz8g" (UniqueName: "kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g") pod "network-check-target-l9f4s" (UID: "2e6652dd-cd64-4562-9340-bba6e831af73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 10:53:40.685084 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:40.684952    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:40.685084 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:40.685070    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vjl6" podUID="ac33a910-7eec-4397-8b78-0ebce51a572d"
Sep 17 10:53:40.685661 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:40.685531    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:40.685661 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:40.685627    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v56d8" podUID="ef38bd1a-72d9-451f-b754-72d2fd579687"
Sep 17 10:53:40.685836 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:40.685671    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:40.685836 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:40.685766    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9f4s" podUID="2e6652dd-cd64-4562-9340-bba6e831af73"
Sep 17 10:53:42.684010 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:42.683978    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:42.684569 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:42.684017    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:42.684569 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:42.684105    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v56d8" podUID="ef38bd1a-72d9-451f-b754-72d2fd579687"
Sep 17 10:53:42.684569 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:42.684253    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:42.684569 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:42.684377    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9f4s" podUID="2e6652dd-cd64-4562-9340-bba6e831af73"
Sep 17 10:53:42.684569 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:42.684480    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vjl6" podUID="ac33a910-7eec-4397-8b78-0ebce51a572d"
Sep 17 10:53:44.683945 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:44.683915    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:44.684438 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:44.683926    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:44.684438 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:44.684011    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v56d8" podUID="ef38bd1a-72d9-451f-b754-72d2fd579687"
Sep 17 10:53:44.684438 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:44.684032    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:44.684438 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:44.684124    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9f4s" podUID="2e6652dd-cd64-4562-9340-bba6e831af73"
Sep 17 10:53:44.684438 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:44.684219    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vjl6" podUID="ac33a910-7eec-4397-8b78-0ebce51a572d"
Sep 17 10:53:46.684715 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:46.684682    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:46.684715 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:46.684701    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:46.685196 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:46.684683    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:46.685196 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:46.684810    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9f4s" podUID="2e6652dd-cd64-4562-9340-bba6e831af73"
Sep 17 10:53:46.685196 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:46.684890    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v56d8" podUID="ef38bd1a-72d9-451f-b754-72d2fd579687"
Sep 17 10:53:46.685196 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:46.684989    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vjl6" podUID="ac33a910-7eec-4397-8b78-0ebce51a572d"
Sep 17 10:53:48.314061 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:48.314023    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs\") pod \"network-metrics-daemon-9vjl6\" (UID: \"ac33a910-7eec-4397-8b78-0ebce51a572d\") " pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:48.314521 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:48.314136    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 10:53:48.314521 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:48.314189    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs podName:ac33a910-7eec-4397-8b78-0ebce51a572d nodeName:}" failed. No retries permitted until 2026-09-17 10:54:04.3141751 +0000 UTC m=+34.109509518 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs") pod "network-metrics-daemon-9vjl6" (UID: "ac33a910-7eec-4397-8b78-0ebce51a572d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 10:53:48.414738 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:48.414708    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret\") pod \"global-pull-secret-syncer-v56d8\" (UID: \"ef38bd1a-72d9-451f-b754-72d2fd579687\") " pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:48.414898 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:48.414756    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvz8g\" (UniqueName: \"kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g\") pod \"network-check-target-l9f4s\" (UID: \"2e6652dd-cd64-4562-9340-bba6e831af73\") " pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:48.414898 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:48.414863    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 10:53:48.414898 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:48.414873    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 10:53:48.414898 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:48.414889    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 10:53:48.414898 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:48.414897    2570 projected.go:196] Error preparing data for projected volume kube-api-access-xvz8g for pod openshift-network-diagnostics/network-check-target-l9f4s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 10:53:48.415143 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:48.414934    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret podName:ef38bd1a-72d9-451f-b754-72d2fd579687 nodeName:}" failed. No retries permitted until 2026-09-17 10:54:04.414910787 +0000 UTC m=+34.210245217 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret") pod "global-pull-secret-syncer-v56d8" (UID: "ef38bd1a-72d9-451f-b754-72d2fd579687") : object "kube-system"/"original-pull-secret" not registered
Sep 17 10:53:48.415143 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:48.414953    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g podName:2e6652dd-cd64-4562-9340-bba6e831af73 nodeName:}" failed. No retries permitted until 2026-09-17 10:54:04.414943633 +0000 UTC m=+34.210278055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xvz8g" (UniqueName: "kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g") pod "network-check-target-l9f4s" (UID: "2e6652dd-cd64-4562-9340-bba6e831af73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 10:53:48.684859 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:48.684786    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:48.684859 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:48.684808    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:48.684859 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:48.684809    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:48.685131 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:48.684886    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9f4s" podUID="2e6652dd-cd64-4562-9340-bba6e831af73"
Sep 17 10:53:48.685131 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:48.684978    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v56d8" podUID="ef38bd1a-72d9-451f-b754-72d2fd579687"
Sep 17 10:53:48.685131 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:48.685059    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vjl6" podUID="ac33a910-7eec-4397-8b78-0ebce51a572d"
Sep 17 10:53:50.684746 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:50.684709    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:50.685174 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:50.684826    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:50.685174 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:50.684836    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vjl6" podUID="ac33a910-7eec-4397-8b78-0ebce51a572d"
Sep 17 10:53:50.685174 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:50.684941    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v56d8" podUID="ef38bd1a-72d9-451f-b754-72d2fd579687"
Sep 17 10:53:50.685174 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:50.684975    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:50.685174 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:50.685047    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9f4s" podUID="2e6652dd-cd64-4562-9340-bba6e831af73"
Sep 17 10:53:51.822767 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:51.822560    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nwlxk" event={"ID":"afe38f2b-75ab-4150-87dc-a948eba57e44","Type":"ContainerStarted","Data":"d538729081ce15fca157b9f0d86a0080fc81b8ff185cbe5e4a5f3d78d29d7065"}
Sep 17 10:53:51.824023 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:51.823999    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-snvdp" event={"ID":"436e3582-44b3-4a08-9192-c700c482f195","Type":"ContainerStarted","Data":"18d1f8c54e296cf3ef6f566bdd3ccca7f713854f3386766aaa55e87af34b0ab3"}
Sep 17 10:53:51.825360 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:51.825341    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9" event={"ID":"baf17d4d-3a35-4d1c-8f55-56ced95456e5","Type":"ContainerStarted","Data":"32aa2dbcb28827a6fa36b3f16c9bc8e78b55ef9428d3fa2e6fd5bd02077a8960"}
Sep 17 10:53:51.826750 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:51.826730    2570 generic.go:356] "Generic (PLEG): container finished" podID="d69fbe5e-a4fa-4c31-bea1-4a64c368957a" containerID="036088e2f9ae9f4efc722bf15fa3706ebec3ed46e826c2097f3a9109a7f6e716" exitCode=0
Sep 17 10:53:51.826839 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:51.826803    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-287pf" event={"ID":"d69fbe5e-a4fa-4c31-bea1-4a64c368957a","Type":"ContainerDied","Data":"036088e2f9ae9f4efc722bf15fa3706ebec3ed46e826c2097f3a9109a7f6e716"}
Sep 17 10:53:51.828677 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:51.828657    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 10:53:51.829026 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:51.829009    2570 generic.go:356] "Generic (PLEG): container finished" podID="ac62c987-276e-4087-917b-cd0d72f5faa7" containerID="b102efea614b3fed93cbbc21ef9bf137f816af10ccbb1640d781e169e6315137" exitCode=1
Sep 17 10:53:51.829073 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:51.829061    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5" event={"ID":"ac62c987-276e-4087-917b-cd0d72f5faa7","Type":"ContainerStarted","Data":"8b3a724c29389b603c366084e1f0ba857a0a547158805a8d4a3806157e9ddea6"}
Sep 17 10:53:51.829140 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:51.829126    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5" event={"ID":"ac62c987-276e-4087-917b-cd0d72f5faa7","Type":"ContainerDied","Data":"b102efea614b3fed93cbbc21ef9bf137f816af10ccbb1640d781e169e6315137"}
Sep 17 10:53:51.829193 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:51.829180    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5" event={"ID":"ac62c987-276e-4087-917b-cd0d72f5faa7","Type":"ContainerStarted","Data":"2c2626e57a8dbcb13a9043fc3994d92bf75a0b07bf2d33b4aa37ccabe1806ca4"}
Sep 17 10:53:51.830571 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:51.830550    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nvvk5" event={"ID":"00b01da5-a5aa-4a50-bf07-08c3c8f31aba","Type":"ContainerStarted","Data":"661d2e7d6a4920b67ed5e4f1b72288ac290c3a13bdd2c5082c09edc664ef8498"}
Sep 17 10:53:51.831791 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:51.831772    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jv7wk" event={"ID":"89b9f0b0-986a-461c-bb56-8c747c1e21bd","Type":"ContainerStarted","Data":"440d0f9603f058405b5d3b09fff8e69bf5b002547abd22376f374a2d4eb82b47"}
Sep 17 10:53:51.842232 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:51.842197    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nwlxk" podStartSLOduration=3.198102866 podStartE2EDuration="20.842187396s" totalImagesPullingTime="17.64408453s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 10:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:53:51.841818193 +0000 UTC m=+21.637152632" watchObservedRunningTime="2026-09-17 10:53:51.842187396 +0000 UTC m=+21.637521834"
Sep 17 10:53:51.842422 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:51.842404    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-123.ec2.internal" podStartSLOduration=19.842400901 podStartE2EDuration="19.842400901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 10:53:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:53:35.807343365 +0000 UTC m=+5.602677805" watchObservedRunningTime="2026-09-17 10:53:51.842400901 +0000 UTC m=+21.637735339"
Sep 17 10:53:51.884787 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:51.884690    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-snvdp" podStartSLOduration=10.699858601 podStartE2EDuration="20.884667899s" totalImagesPullingTime="10.184809298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 10:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:53:51.884405323 +0000 UTC m=+21.679739762" watchObservedRunningTime="2026-09-17 10:53:51.884667899 +0000 UTC m=+21.680002340"
Sep 17 10:53:51.902670 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:51.902632    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jv7wk" podStartSLOduration=3.256551566 podStartE2EDuration="20.902617532s" totalImagesPullingTime="17.646065966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 10:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:53:51.902598606 +0000 UTC m=+21.697933045" watchObservedRunningTime="2026-09-17 10:53:51.902617532 +0000 UTC m=+21.697951970"
Sep 17 10:53:52.683829 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:52.683789    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:52.684000 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:52.683791    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:52.684000 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:52.683924    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v56d8" podUID="ef38bd1a-72d9-451f-b754-72d2fd579687"
Sep 17 10:53:52.684127 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:52.684001    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vjl6" podUID="ac33a910-7eec-4397-8b78-0ebce51a572d"
Sep 17 10:53:52.684127 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:52.683806    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:52.684127 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:52.684111    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9f4s" podUID="2e6652dd-cd64-4562-9340-bba6e831af73"
Sep 17 10:53:52.836057 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:52.836025    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2s6tr" event={"ID":"35649e42-ddd5-4c48-a38c-a7486bbcd3e4","Type":"ContainerStarted","Data":"9ab684e6ae5e31a59c2c5ee3f308ee743521b3d5df9ca649e150400463614644"}
Sep 17 10:53:52.839243 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:52.839225    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 10:53:52.839691 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:52.839664    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5" event={"ID":"ac62c987-276e-4087-917b-cd0d72f5faa7","Type":"ContainerStarted","Data":"8a101f26fd9cc5b51c3c1991db63ea49481a4bb2e1d55195e8bac47fcbdc3c3b"}
Sep 17 10:53:52.839789 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:52.839754    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5" event={"ID":"ac62c987-276e-4087-917b-cd0d72f5faa7","Type":"ContainerStarted","Data":"fcbaefcfda309d887f1d3fb1cac3123cb2b7d35d8e369671877128fabee14177"}
Sep 17 10:53:52.839855 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:52.839789    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5" event={"ID":"ac62c987-276e-4087-917b-cd0d72f5faa7","Type":"ContainerStarted","Data":"ce49672321b8749a54027a0b66a019800902f6a8596846c29b2ecede9b73e2e4"}
Sep 17 10:53:52.841296 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:52.841267    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hbhhp" event={"ID":"0a7d16ad-7271-4ca2-b3fa-0f8886981659","Type":"ContainerStarted","Data":"d05e217711d69977fad3f5dffcca130370c3fa328c0602948ea1e9b7e05fc49b"}
Sep 17 10:53:52.853259 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:52.853216    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nvvk5" podStartSLOduration=5.199285925 podStartE2EDuration="22.853188551s" totalImagesPullingTime="17.653902626s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 10:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:53:51.921987129 +0000 UTC m=+21.717321568" watchObservedRunningTime="2026-09-17 10:53:52.853188551 +0000 UTC m=+22.648522990"
Sep 17 10:53:52.853640 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:52.853612    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2s6tr" podStartSLOduration=5.203276115 podStartE2EDuration="22.853605898s" totalImagesPullingTime="17.650329783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 10:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:53:52.85314282 +0000 UTC m=+22.648477272" watchObservedRunningTime="2026-09-17 10:53:52.853605898 +0000 UTC m=+22.648940349"
Sep 17 10:53:52.876082 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:52.876039    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hbhhp" podStartSLOduration=3.807354949 podStartE2EDuration="21.876022359s" totalImagesPullingTime="18.06866741s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 10:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:53:52.875734659 +0000 UTC m=+22.671069098" watchObservedRunningTime="2026-09-17 10:53:52.876022359 +0000 UTC m=+22.671356799"
Sep 17 10:53:52.995701 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:52.995631    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-snvdp"
Sep 17 10:53:52.996130 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:52.996111    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-snvdp"
Sep 17 10:53:53.168288 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:53.168261    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 10:53:53.628907 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:53.628795    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T10:53:53.16828527Z","UUID":"caf926f1-8450-497e-8a80-58cd421fcfe2","Handler":null,"Name":"","Endpoint":""}
Sep 17 10:53:53.630425 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:53.630403    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 10:53:53.630578 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:53.630438    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 10:53:53.846077 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:53.846041    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9" event={"ID":"baf17d4d-3a35-4d1c-8f55-56ced95456e5","Type":"ContainerStarted","Data":"9109ae6d5f355f38c406429651709559bf678f21e2e5c154ab4519279a78da7e"}
Sep 17 10:53:54.683841 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:54.683811    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:54.684120 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:54.683848    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:54.684120 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:54.683812    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:54.684120 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:54.683945    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vjl6" podUID="ac33a910-7eec-4397-8b78-0ebce51a572d"
Sep 17 10:53:54.684120 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:54.684036    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v56d8" podUID="ef38bd1a-72d9-451f-b754-72d2fd579687"
Sep 17 10:53:54.684301 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:54.684123    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9f4s" podUID="2e6652dd-cd64-4562-9340-bba6e831af73"
Sep 17 10:53:54.851784 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:54.851762    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 10:53:54.852235 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:54.852219    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 17 10:53:54.852311 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:54.852219    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5" event={"ID":"ac62c987-276e-4087-917b-cd0d72f5faa7","Type":"ContainerStarted","Data":"e6473e734b8a21ad674aa167a527b3963b95ccd7dc798814eef2e3f1e624691e"}
Sep 17 10:53:56.683881 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:56.683851    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:56.684205 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:56.683852    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:56.684205 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:56.683953    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vjl6" podUID="ac33a910-7eec-4397-8b78-0ebce51a572d"
Sep 17 10:53:56.684205 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:56.683857    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:56.684205 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:56.684024    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9f4s" podUID="2e6652dd-cd64-4562-9340-bba6e831af73"
Sep 17 10:53:56.684205 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:56.684119    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v56d8" podUID="ef38bd1a-72d9-451f-b754-72d2fd579687"
Sep 17 10:53:56.858633 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:56.858566    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9" event={"ID":"baf17d4d-3a35-4d1c-8f55-56ced95456e5","Type":"ContainerStarted","Data":"ddc6968f3cfce5016731ae0c81fd76408c235acd12afb8f0f6df72283d540ed1"}
Sep 17 10:53:56.860266 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:56.860244    2570 generic.go:356] "Generic (PLEG): container finished" podID="d69fbe5e-a4fa-4c31-bea1-4a64c368957a" containerID="47fd72cc5b5450dc7f3274af2ca722f0b68fe04fd8c9ebd55621183a5dd8060b" exitCode=0
Sep 17 10:53:56.860369 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:56.860316    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-287pf" event={"ID":"d69fbe5e-a4fa-4c31-bea1-4a64c368957a","Type":"ContainerDied","Data":"47fd72cc5b5450dc7f3274af2ca722f0b68fe04fd8c9ebd55621183a5dd8060b"}
Sep 17 10:53:56.864240 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:56.864223    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 10:53:56.864592 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:56.864575    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5" event={"ID":"ac62c987-276e-4087-917b-cd0d72f5faa7","Type":"ContainerStarted","Data":"1be079cf0cccf51ba3a3aa6df60c0fae86910cb0895ae6c5c507272b5e5b6dcf"}
Sep 17 10:53:56.864787 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:56.864766    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:56.864834 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:56.864813    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:56.864965 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:56.864946    2570 scope.go:117] "RemoveContainer" containerID="b102efea614b3fed93cbbc21ef9bf137f816af10ccbb1640d781e169e6315137"
Sep 17 10:53:56.879765 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:56.879746    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:56.883933 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:56.883898    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-k8td9" podStartSLOduration=3.693980849 podStartE2EDuration="25.88388706s" totalImagesPullingTime="22.189906211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 10:53:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:53:56.883550426 +0000 UTC m=+26.678884866" watchObservedRunningTime="2026-09-17 10:53:56.88388706 +0000 UTC m=+26.679221496"
Sep 17 10:53:57.870531 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:57.870496    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 10:53:57.871026 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:57.870836    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5" event={"ID":"ac62c987-276e-4087-917b-cd0d72f5faa7","Type":"ContainerStarted","Data":"b87c621932270ecb98b62c375b77a2bebe8a0b39fd6d097bc4955424c6722487"}
Sep 17 10:53:57.871160 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:57.871142    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:57.886666 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:57.886647    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:53:57.910613 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:57.910567    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5" podStartSLOduration=9.243625521 podStartE2EDuration="26.910550379s" totalImagesPullingTime="17.666924858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 10:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:53:57.908919645 +0000 UTC m=+27.704254088" watchObservedRunningTime="2026-09-17 10:53:57.910550379 +0000 UTC m=+27.705884837"
Sep 17 10:53:58.684394 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:58.684362    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:58.684524 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:58.684403    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:58.684524 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:58.684362    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:58.684524 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:58.684460    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9f4s" podUID="2e6652dd-cd64-4562-9340-bba6e831af73"
Sep 17 10:53:58.684754 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:58.684573    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v56d8" podUID="ef38bd1a-72d9-451f-b754-72d2fd579687"
Sep 17 10:53:58.684754 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:58.684653    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vjl6" podUID="ac33a910-7eec-4397-8b78-0ebce51a572d"
Sep 17 10:53:58.709188 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:58.709163    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l9f4s"]
Sep 17 10:53:58.709981 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:58.709951    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v56d8"]
Sep 17 10:53:58.710490 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:58.710471    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9vjl6"]
Sep 17 10:53:58.875414 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:58.875345    2570 generic.go:356] "Generic (PLEG): container finished" podID="d69fbe5e-a4fa-4c31-bea1-4a64c368957a" containerID="e0170cf539e5836a015be0a51f26f98af3c29e631496997fa9eeb32e0d352d08" exitCode=0
Sep 17 10:53:58.875993 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:58.875445    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-287pf" event={"ID":"d69fbe5e-a4fa-4c31-bea1-4a64c368957a","Type":"ContainerDied","Data":"e0170cf539e5836a015be0a51f26f98af3c29e631496997fa9eeb32e0d352d08"}
Sep 17 10:53:58.875993 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:58.875531    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:53:58.875993 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:58.875542    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:53:58.875993 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:58.875636    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vjl6" podUID="ac33a910-7eec-4397-8b78-0ebce51a572d"
Sep 17 10:53:58.875993 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:58.875729    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v56d8" podUID="ef38bd1a-72d9-451f-b754-72d2fd579687"
Sep 17 10:53:58.876270 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:53:58.876110    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:53:58.876270 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:53:58.876204    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9f4s" podUID="2e6652dd-cd64-4562-9340-bba6e831af73"
Sep 17 10:54:00.685476 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:00.685267    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:54:00.685853 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:00.685320    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:54:00.685853 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:00.685534    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vjl6" podUID="ac33a910-7eec-4397-8b78-0ebce51a572d"
Sep 17 10:54:00.685853 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:00.685630    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9f4s" podUID="2e6652dd-cd64-4562-9340-bba6e831af73"
Sep 17 10:54:00.685853 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:00.685345    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:54:00.685853 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:00.685742    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v56d8" podUID="ef38bd1a-72d9-451f-b754-72d2fd579687"
Sep 17 10:54:00.883129 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:00.883099    2570 generic.go:356] "Generic (PLEG): container finished" podID="d69fbe5e-a4fa-4c31-bea1-4a64c368957a" containerID="dfb74b124be6b875e260819bba6b363cf502751596c2e304ce1a36568832d064" exitCode=0
Sep 17 10:54:00.883231 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:00.883170    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-287pf" event={"ID":"d69fbe5e-a4fa-4c31-bea1-4a64c368957a","Type":"ContainerDied","Data":"dfb74b124be6b875e260819bba6b363cf502751596c2e304ce1a36568832d064"}
Sep 17 10:54:02.684013 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:02.683982    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:54:02.684446 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:02.683982    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:54:02.684446 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:02.684116    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vjl6" podUID="ac33a910-7eec-4397-8b78-0ebce51a572d"
Sep 17 10:54:02.684446 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:02.683986    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:54:02.684446 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:02.684183    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-l9f4s" podUID="2e6652dd-cd64-4562-9340-bba6e831af73"
Sep 17 10:54:02.684446 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:02.684235    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v56d8" podUID="ef38bd1a-72d9-451f-b754-72d2fd579687"
Sep 17 10:54:02.713275 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:02.713249    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-snvdp"
Sep 17 10:54:02.713393 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:02.713366    2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 17 10:54:02.713829 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:02.713814    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-snvdp"
Sep 17 10:54:04.330646 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.330609    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs\") pod \"network-metrics-daemon-9vjl6\" (UID: \"ac33a910-7eec-4397-8b78-0ebce51a572d\") " pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:54:04.331120 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:04.330748    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 10:54:04.331120 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:04.330811    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs podName:ac33a910-7eec-4397-8b78-0ebce51a572d nodeName:}" failed. No retries permitted until 2026-09-17 10:54:36.330795428 +0000 UTC m=+66.126129844 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs") pod "network-metrics-daemon-9vjl6" (UID: "ac33a910-7eec-4397-8b78-0ebce51a572d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 10:54:04.431245 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.431202    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret\") pod \"global-pull-secret-syncer-v56d8\" (UID: \"ef38bd1a-72d9-451f-b754-72d2fd579687\") " pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:54:04.431414 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.431257    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvz8g\" (UniqueName: \"kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g\") pod \"network-check-target-l9f4s\" (UID: \"2e6652dd-cd64-4562-9340-bba6e831af73\") " pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:54:04.431414 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:04.431351    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 10:54:04.431414 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:04.431368    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 10:54:04.431414 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:04.431385    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 10:54:04.431414 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:04.431396    2570 projected.go:196] Error preparing data for projected volume kube-api-access-xvz8g for pod openshift-network-diagnostics/network-check-target-l9f4s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 10:54:04.431414 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:04.431416    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret podName:ef38bd1a-72d9-451f-b754-72d2fd579687 nodeName:}" failed. No retries permitted until 2026-09-17 10:54:36.43139939 +0000 UTC m=+66.226733821 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret") pod "global-pull-secret-syncer-v56d8" (UID: "ef38bd1a-72d9-451f-b754-72d2fd579687") : object "kube-system"/"original-pull-secret" not registered
Sep 17 10:54:04.431715 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:04.431435    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g podName:2e6652dd-cd64-4562-9340-bba6e831af73 nodeName:}" failed. No retries permitted until 2026-09-17 10:54:36.431425463 +0000 UTC m=+66.226759883 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xvz8g" (UniqueName: "kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g") pod "network-check-target-l9f4s" (UID: "2e6652dd-cd64-4562-9340-bba6e831af73") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 10:54:04.432611 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.432580    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-123.ec2.internal" event="NodeReady"
Sep 17 10:54:04.432740 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.432727    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 10:54:04.494559 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.494476    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hmpqk"]
Sep 17 10:54:04.497068 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.497050    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:04.501785 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.501764    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 10:54:04.501895 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.501764    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lfdp8\""
Sep 17 10:54:04.502066 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.502039    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 10:54:04.502657 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.502636    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-k5q5b"]
Sep 17 10:54:04.504281 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.504261    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k5q5b"
Sep 17 10:54:04.508829 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.508809    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 10:54:04.509424 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.509407    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 10:54:04.509424 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.509416    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 10:54:04.509596 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.509456    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bbfck\""
Sep 17 10:54:04.513923 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.513896    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hmpqk"]
Sep 17 10:54:04.518823 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.518598    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k5q5b"]
Sep 17 10:54:04.633735 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.633699    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2062301-9298-4b90-b0b2-9cbbac41130a-tmp-dir\") pod \"dns-default-hmpqk\" (UID: \"a2062301-9298-4b90-b0b2-9cbbac41130a\") " pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:04.633904 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.633751    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9591f62-675e-42af-8cdc-7a201faa92da-cert\") pod \"ingress-canary-k5q5b\" (UID: \"a9591f62-675e-42af-8cdc-7a201faa92da\") " pod="openshift-ingress-canary/ingress-canary-k5q5b"
Sep 17 10:54:04.633904 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.633853    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7zzp\" (UniqueName: \"kubernetes.io/projected/a2062301-9298-4b90-b0b2-9cbbac41130a-kube-api-access-x7zzp\") pod \"dns-default-hmpqk\" (UID: \"a2062301-9298-4b90-b0b2-9cbbac41130a\") " pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:04.633904 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.633888    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwt88\" (UniqueName: \"kubernetes.io/projected/a9591f62-675e-42af-8cdc-7a201faa92da-kube-api-access-dwt88\") pod \"ingress-canary-k5q5b\" (UID: \"a9591f62-675e-42af-8cdc-7a201faa92da\") " pod="openshift-ingress-canary/ingress-canary-k5q5b"
Sep 17 10:54:04.634060 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.633913    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2062301-9298-4b90-b0b2-9cbbac41130a-config-volume\") pod \"dns-default-hmpqk\" (UID: \"a2062301-9298-4b90-b0b2-9cbbac41130a\") " pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:04.634060 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.634017    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2062301-9298-4b90-b0b2-9cbbac41130a-metrics-tls\") pod \"dns-default-hmpqk\" (UID: \"a2062301-9298-4b90-b0b2-9cbbac41130a\") " pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:04.684106 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.684072    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:54:04.684106 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.684097    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:54:04.684106 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.684114    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:54:04.688558 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.688450    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 10:54:04.688558 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.688524    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gx69l\""
Sep 17 10:54:04.689768 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.689748    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 10:54:04.692527 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.692491    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 10:54:04.692632 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.692491    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 10:54:04.692632 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.692495    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4chbd\""
Sep 17 10:54:04.735237 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.735199    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7zzp\" (UniqueName: \"kubernetes.io/projected/a2062301-9298-4b90-b0b2-9cbbac41130a-kube-api-access-x7zzp\") pod \"dns-default-hmpqk\" (UID: \"a2062301-9298-4b90-b0b2-9cbbac41130a\") " pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:04.735361 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.735243    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwt88\" (UniqueName: \"kubernetes.io/projected/a9591f62-675e-42af-8cdc-7a201faa92da-kube-api-access-dwt88\") pod \"ingress-canary-k5q5b\" (UID: \"a9591f62-675e-42af-8cdc-7a201faa92da\") " pod="openshift-ingress-canary/ingress-canary-k5q5b"
Sep 17 10:54:04.735452 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.735435    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2062301-9298-4b90-b0b2-9cbbac41130a-config-volume\") pod \"dns-default-hmpqk\" (UID: \"a2062301-9298-4b90-b0b2-9cbbac41130a\") " pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:04.735548 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.735531    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2062301-9298-4b90-b0b2-9cbbac41130a-metrics-tls\") pod \"dns-default-hmpqk\" (UID: \"a2062301-9298-4b90-b0b2-9cbbac41130a\") " pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:04.735620 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.735582    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2062301-9298-4b90-b0b2-9cbbac41130a-tmp-dir\") pod \"dns-default-hmpqk\" (UID: \"a2062301-9298-4b90-b0b2-9cbbac41130a\") " pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:04.735672 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.735622    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9591f62-675e-42af-8cdc-7a201faa92da-cert\") pod \"ingress-canary-k5q5b\" (UID: \"a9591f62-675e-42af-8cdc-7a201faa92da\") " pod="openshift-ingress-canary/ingress-canary-k5q5b"
Sep 17 10:54:04.735672 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:04.735662    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 10:54:04.735766 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:04.735733    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2062301-9298-4b90-b0b2-9cbbac41130a-metrics-tls podName:a2062301-9298-4b90-b0b2-9cbbac41130a nodeName:}" failed. No retries permitted until 2026-09-17 10:54:05.235712598 +0000 UTC m=+35.031047022 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2062301-9298-4b90-b0b2-9cbbac41130a-metrics-tls") pod "dns-default-hmpqk" (UID: "a2062301-9298-4b90-b0b2-9cbbac41130a") : secret "dns-default-metrics-tls" not found
Sep 17 10:54:04.735908 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.735884    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2062301-9298-4b90-b0b2-9cbbac41130a-tmp-dir\") pod \"dns-default-hmpqk\" (UID: \"a2062301-9298-4b90-b0b2-9cbbac41130a\") " pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:04.736067 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.736037    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a2062301-9298-4b90-b0b2-9cbbac41130a-config-volume\") pod \"dns-default-hmpqk\" (UID: \"a2062301-9298-4b90-b0b2-9cbbac41130a\") " pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:04.740171 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.740153    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9591f62-675e-42af-8cdc-7a201faa92da-cert\") pod \"ingress-canary-k5q5b\" (UID: \"a9591f62-675e-42af-8cdc-7a201faa92da\") " pod="openshift-ingress-canary/ingress-canary-k5q5b"
Sep 17 10:54:04.746060 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.746009    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwt88\" (UniqueName: \"kubernetes.io/projected/a9591f62-675e-42af-8cdc-7a201faa92da-kube-api-access-dwt88\") pod \"ingress-canary-k5q5b\" (UID: \"a9591f62-675e-42af-8cdc-7a201faa92da\") " pod="openshift-ingress-canary/ingress-canary-k5q5b"
Sep 17 10:54:04.752052 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.752009    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7zzp\" (UniqueName: \"kubernetes.io/projected/a2062301-9298-4b90-b0b2-9cbbac41130a-kube-api-access-x7zzp\") pod \"dns-default-hmpqk\" (UID: \"a2062301-9298-4b90-b0b2-9cbbac41130a\") " pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:04.816089 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:04.816061    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-k5q5b"
Sep 17 10:54:05.230691 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:05.230426    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-k5q5b"]
Sep 17 10:54:05.236340 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:54:05.236314    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9591f62_675e_42af_8cdc_7a201faa92da.slice/crio-650969656d118e3b9c8352b81c212d1eaf5728da374d0c39f067e96b71b4513b WatchSource:0}: Error finding container 650969656d118e3b9c8352b81c212d1eaf5728da374d0c39f067e96b71b4513b: Status 404 returned error can't find the container with id 650969656d118e3b9c8352b81c212d1eaf5728da374d0c39f067e96b71b4513b
Sep 17 10:54:05.241066 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:05.241043    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2062301-9298-4b90-b0b2-9cbbac41130a-metrics-tls\") pod \"dns-default-hmpqk\" (UID: \"a2062301-9298-4b90-b0b2-9cbbac41130a\") " pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:05.241165 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:05.241142    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 10:54:05.241209 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:05.241184    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2062301-9298-4b90-b0b2-9cbbac41130a-metrics-tls podName:a2062301-9298-4b90-b0b2-9cbbac41130a nodeName:}" failed. No retries permitted until 2026-09-17 10:54:06.241172355 +0000 UTC m=+36.036506771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2062301-9298-4b90-b0b2-9cbbac41130a-metrics-tls") pod "dns-default-hmpqk" (UID: "a2062301-9298-4b90-b0b2-9cbbac41130a") : secret "dns-default-metrics-tls" not found
Sep 17 10:54:05.898964 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:05.898932    2570 generic.go:356] "Generic (PLEG): container finished" podID="d69fbe5e-a4fa-4c31-bea1-4a64c368957a" containerID="6d145588aa037588df12d0524ad3e09299521ac759d366dc19753b0620ec68df" exitCode=0
Sep 17 10:54:05.899602 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:05.899012    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-287pf" event={"ID":"d69fbe5e-a4fa-4c31-bea1-4a64c368957a","Type":"ContainerDied","Data":"6d145588aa037588df12d0524ad3e09299521ac759d366dc19753b0620ec68df"}
Sep 17 10:54:05.900373 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:05.900347    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k5q5b" event={"ID":"a9591f62-675e-42af-8cdc-7a201faa92da","Type":"ContainerStarted","Data":"650969656d118e3b9c8352b81c212d1eaf5728da374d0c39f067e96b71b4513b"}
Sep 17 10:54:06.248821 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:06.248743    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2062301-9298-4b90-b0b2-9cbbac41130a-metrics-tls\") pod \"dns-default-hmpqk\" (UID: \"a2062301-9298-4b90-b0b2-9cbbac41130a\") " pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:06.248952 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:06.248898    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 10:54:06.249011 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:06.248970    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2062301-9298-4b90-b0b2-9cbbac41130a-metrics-tls podName:a2062301-9298-4b90-b0b2-9cbbac41130a nodeName:}" failed. No retries permitted until 2026-09-17 10:54:08.248954421 +0000 UTC m=+38.044288838 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2062301-9298-4b90-b0b2-9cbbac41130a-metrics-tls") pod "dns-default-hmpqk" (UID: "a2062301-9298-4b90-b0b2-9cbbac41130a") : secret "dns-default-metrics-tls" not found
Sep 17 10:54:06.906955 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:06.906912    2570 generic.go:356] "Generic (PLEG): container finished" podID="d69fbe5e-a4fa-4c31-bea1-4a64c368957a" containerID="fcb666abe043d4cb910710af427f0294e42b14594b2c7dd6584bb211b5e325cf" exitCode=0
Sep 17 10:54:06.907542 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:06.907005    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-287pf" event={"ID":"d69fbe5e-a4fa-4c31-bea1-4a64c368957a","Type":"ContainerDied","Data":"fcb666abe043d4cb910710af427f0294e42b14594b2c7dd6584bb211b5e325cf"}
Sep 17 10:54:07.915387 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:07.915128    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-287pf" event={"ID":"d69fbe5e-a4fa-4c31-bea1-4a64c368957a","Type":"ContainerStarted","Data":"11c6a7b14a4e876eba22c2afbdde738c2be5a15ca8342d6449f0329f95aa6b70"}
Sep 17 10:54:07.916742 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:07.916715    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-k5q5b" event={"ID":"a9591f62-675e-42af-8cdc-7a201faa92da","Type":"ContainerStarted","Data":"2315ae4ed8f3af6f334b3c54d3ba579929123dbf8b0115f8349899337046f69b"}
Sep 17 10:54:07.941375 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:07.941334    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-287pf" podStartSLOduration=8.607169715 podStartE2EDuration="36.941320712s" totalImagesPullingTime="28.334150997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 10:53:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:54:07.939679398 +0000 UTC m=+37.735013836" watchObservedRunningTime="2026-09-17 10:54:07.941320712 +0000 UTC m=+37.736655151"
Sep 17 10:54:07.960978 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:07.960937    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-k5q5b" podStartSLOduration=1.649236299 podStartE2EDuration="3.960922844s" totalImagesPullingTime="2.311686545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 10:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:54:07.960007308 +0000 UTC m=+37.755341758" watchObservedRunningTime="2026-09-17 10:54:07.960922844 +0000 UTC m=+37.756257277"
Sep 17 10:54:08.260904 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:08.260799    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2062301-9298-4b90-b0b2-9cbbac41130a-metrics-tls\") pod \"dns-default-hmpqk\" (UID: \"a2062301-9298-4b90-b0b2-9cbbac41130a\") " pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:08.261025 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:08.260943    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 10:54:08.261025 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:08.261004    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2062301-9298-4b90-b0b2-9cbbac41130a-metrics-tls podName:a2062301-9298-4b90-b0b2-9cbbac41130a nodeName:}" failed. No retries permitted until 2026-09-17 10:54:12.260988962 +0000 UTC m=+42.056323398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2062301-9298-4b90-b0b2-9cbbac41130a-metrics-tls") pod "dns-default-hmpqk" (UID: "a2062301-9298-4b90-b0b2-9cbbac41130a") : secret "dns-default-metrics-tls" not found
Sep 17 10:54:10.181143 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.181110    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-s2cf4"]
Sep 17 10:54:10.217031 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.217009    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s2cf4"]
Sep 17 10:54:10.217159 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.217102    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:10.223917 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.223896    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 10:54:10.224211 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.224195    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8sqhr\""
Sep 17 10:54:10.225237 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.225215    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 10:54:10.225309 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.225248    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 10:54:10.225309 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.225284    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 10:54:10.378384 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.378351    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-crio-socket\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:10.378547 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.378411    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:10.378547 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.378479    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pchwn\" (UniqueName: \"kubernetes.io/projected/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-kube-api-access-pchwn\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:10.378547 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.378532    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-data-volume\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:10.378696 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.378571    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:10.479479 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.479404    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pchwn\" (UniqueName: \"kubernetes.io/projected/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-kube-api-access-pchwn\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:10.479479 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.479453    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-data-volume\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:10.479666 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.479499    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:10.479666 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.479580    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-crio-socket\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:10.479666 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.479605    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:10.479806 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:10.479663    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 10:54:10.479806 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:10.479724    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-kube-rbac-proxy-cm podName:69728ca8-7dbb-4982-9fd5-4a16ebbacf01 nodeName:}" failed. No retries permitted until 2026-09-17 10:54:10.97971007 +0000 UTC m=+40.775044487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s2cf4" (UID: "69728ca8-7dbb-4982-9fd5-4a16ebbacf01") : configmap "kube-rbac-proxy" not found
Sep 17 10:54:10.479806 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:10.479737    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 10:54:10.482579 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.480057    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-crio-socket\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:10.482579 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.480102    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-data-volume\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:10.482579 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:10.480274    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-insights-runtime-extractor-tls podName:69728ca8-7dbb-4982-9fd5-4a16ebbacf01 nodeName:}" failed. No retries permitted until 2026-09-17 10:54:10.980253098 +0000 UTC m=+40.775587529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s2cf4" (UID: "69728ca8-7dbb-4982-9fd5-4a16ebbacf01") : secret "insights-runtime-extractor-tls" not found
Sep 17 10:54:10.497946 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.497917    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pchwn\" (UniqueName: \"kubernetes.io/projected/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-kube-api-access-pchwn\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:10.855485 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.855454    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-vkvmv"]
Sep 17 10:54:10.874276 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.874251    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vkvmv"
Sep 17 10:54:10.876528 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.876492    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-vkvmv"]
Sep 17 10:54:10.877413 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.877396    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dzmf6\""
Sep 17 10:54:10.878701 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.878681    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 17 10:54:10.878701 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.878695    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 17 10:54:10.983772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.983739    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:10.983925 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.983808    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w468g\" (UniqueName: \"kubernetes.io/projected/21002dd1-e323-4135-b552-97c4593bf420-kube-api-access-w468g\") pod \"migrator-8b4d697c5-vkvmv\" (UID: \"21002dd1-e323-4135-b552-97c4593bf420\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vkvmv"
Sep 17 10:54:10.983925 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:10.983830    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:10.983925 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:10.983878    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 10:54:10.983925 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:10.983895    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 10:54:10.984069 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:10.983948    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-kube-rbac-proxy-cm podName:69728ca8-7dbb-4982-9fd5-4a16ebbacf01 nodeName:}" failed. No retries permitted until 2026-09-17 10:54:11.983933895 +0000 UTC m=+41.779268313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s2cf4" (UID: "69728ca8-7dbb-4982-9fd5-4a16ebbacf01") : configmap "kube-rbac-proxy" not found
Sep 17 10:54:10.984069 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:10.983960    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-insights-runtime-extractor-tls podName:69728ca8-7dbb-4982-9fd5-4a16ebbacf01 nodeName:}" failed. No retries permitted until 2026-09-17 10:54:11.983954872 +0000 UTC m=+41.779289289 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s2cf4" (UID: "69728ca8-7dbb-4982-9fd5-4a16ebbacf01") : secret "insights-runtime-extractor-tls" not found
Sep 17 10:54:11.084731 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:11.084703    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w468g\" (UniqueName: \"kubernetes.io/projected/21002dd1-e323-4135-b552-97c4593bf420-kube-api-access-w468g\") pod \"migrator-8b4d697c5-vkvmv\" (UID: \"21002dd1-e323-4135-b552-97c4593bf420\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vkvmv"
Sep 17 10:54:11.093276 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:11.093254    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w468g\" (UniqueName: \"kubernetes.io/projected/21002dd1-e323-4135-b552-97c4593bf420-kube-api-access-w468g\") pod \"migrator-8b4d697c5-vkvmv\" (UID: \"21002dd1-e323-4135-b552-97c4593bf420\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vkvmv"
Sep 17 10:54:11.183894 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:11.183838    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vkvmv"
Sep 17 10:54:11.463370 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:11.463303    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-vkvmv"]
Sep 17 10:54:11.466439 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:54:11.466410    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21002dd1_e323_4135_b552_97c4593bf420.slice/crio-7c4d652475f55ad7e8a9d81e260f2c956744019ada3023f4124a10bf982082dd WatchSource:0}: Error finding container 7c4d652475f55ad7e8a9d81e260f2c956744019ada3023f4124a10bf982082dd: Status 404 returned error can't find the container with id 7c4d652475f55ad7e8a9d81e260f2c956744019ada3023f4124a10bf982082dd
Sep 17 10:54:11.866926 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:11.866905    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nwlxk_afe38f2b-75ab-4150-87dc-a948eba57e44/dns-node-resolver/0.log"
Sep 17 10:54:11.928578 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:11.928531    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vkvmv" event={"ID":"21002dd1-e323-4135-b552-97c4593bf420","Type":"ContainerStarted","Data":"7c4d652475f55ad7e8a9d81e260f2c956744019ada3023f4124a10bf982082dd"}
Sep 17 10:54:11.991487 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:11.991453    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:11.991665 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:11.991540    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:11.991665 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:11.991574    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 10:54:11.991665 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:11.991634    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-kube-rbac-proxy-cm podName:69728ca8-7dbb-4982-9fd5-4a16ebbacf01 nodeName:}" failed. No retries permitted until 2026-09-17 10:54:13.991618156 +0000 UTC m=+43.786952574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s2cf4" (UID: "69728ca8-7dbb-4982-9fd5-4a16ebbacf01") : configmap "kube-rbac-proxy" not found
Sep 17 10:54:11.991665 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:11.991646    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 10:54:11.991823 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:11.991695    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-insights-runtime-extractor-tls podName:69728ca8-7dbb-4982-9fd5-4a16ebbacf01 nodeName:}" failed. No retries permitted until 2026-09-17 10:54:13.991679916 +0000 UTC m=+43.787014336 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s2cf4" (UID: "69728ca8-7dbb-4982-9fd5-4a16ebbacf01") : secret "insights-runtime-extractor-tls" not found
Sep 17 10:54:12.293729 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:12.293697    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2062301-9298-4b90-b0b2-9cbbac41130a-metrics-tls\") pod \"dns-default-hmpqk\" (UID: \"a2062301-9298-4b90-b0b2-9cbbac41130a\") " pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:12.294113 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:12.293826    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 10:54:12.294113 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:12.293883    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2062301-9298-4b90-b0b2-9cbbac41130a-metrics-tls podName:a2062301-9298-4b90-b0b2-9cbbac41130a nodeName:}" failed. No retries permitted until 2026-09-17 10:54:20.29386813 +0000 UTC m=+50.089202550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a2062301-9298-4b90-b0b2-9cbbac41130a-metrics-tls") pod "dns-default-hmpqk" (UID: "a2062301-9298-4b90-b0b2-9cbbac41130a") : secret "dns-default-metrics-tls" not found
Sep 17 10:54:12.538058 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:12.538027    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-qg84j"]
Sep 17 10:54:12.551686 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:12.551642    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-qg84j"
Sep 17 10:54:12.554998 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:12.554974    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 17 10:54:12.555104 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:12.554997    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 17 10:54:12.555104 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:12.554997    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 17 10:54:12.556074 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:12.556058    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 17 10:54:12.556169 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:12.556078    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-z4t9b\""
Sep 17 10:54:12.563709 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:12.563688    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-qg84j"]
Sep 17 10:54:12.697667 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:12.697627    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq96s\" (UniqueName: \"kubernetes.io/projected/725eee4b-6d01-4f36-b2b4-3b3224186afd-kube-api-access-dq96s\") pod \"service-ca-568869fdc5-qg84j\" (UID: \"725eee4b-6d01-4f36-b2b4-3b3224186afd\") " pod="openshift-service-ca/service-ca-568869fdc5-qg84j"
Sep 17 10:54:12.697827 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:12.697679    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/725eee4b-6d01-4f36-b2b4-3b3224186afd-signing-cabundle\") pod \"service-ca-568869fdc5-qg84j\" (UID: \"725eee4b-6d01-4f36-b2b4-3b3224186afd\") " pod="openshift-service-ca/service-ca-568869fdc5-qg84j"
Sep 17 10:54:12.697879 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:12.697820    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/725eee4b-6d01-4f36-b2b4-3b3224186afd-signing-key\") pod \"service-ca-568869fdc5-qg84j\" (UID: \"725eee4b-6d01-4f36-b2b4-3b3224186afd\") " pod="openshift-service-ca/service-ca-568869fdc5-qg84j"
Sep 17 10:54:12.799042 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:12.799007    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/725eee4b-6d01-4f36-b2b4-3b3224186afd-signing-cabundle\") pod \"service-ca-568869fdc5-qg84j\" (UID: \"725eee4b-6d01-4f36-b2b4-3b3224186afd\") " pod="openshift-service-ca/service-ca-568869fdc5-qg84j"
Sep 17 10:54:12.799199 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:12.799068    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/725eee4b-6d01-4f36-b2b4-3b3224186afd-signing-key\") pod \"service-ca-568869fdc5-qg84j\" (UID: \"725eee4b-6d01-4f36-b2b4-3b3224186afd\") " pod="openshift-service-ca/service-ca-568869fdc5-qg84j"
Sep 17 10:54:12.799199 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:12.799118    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq96s\" (UniqueName: \"kubernetes.io/projected/725eee4b-6d01-4f36-b2b4-3b3224186afd-kube-api-access-dq96s\") pod \"service-ca-568869fdc5-qg84j\" (UID: \"725eee4b-6d01-4f36-b2b4-3b3224186afd\") " pod="openshift-service-ca/service-ca-568869fdc5-qg84j"
Sep 17 10:54:12.799732 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:12.799705    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/725eee4b-6d01-4f36-b2b4-3b3224186afd-signing-cabundle\") pod \"service-ca-568869fdc5-qg84j\" (UID: \"725eee4b-6d01-4f36-b2b4-3b3224186afd\") " pod="openshift-service-ca/service-ca-568869fdc5-qg84j"
Sep 17 10:54:12.801323 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:12.801302    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/725eee4b-6d01-4f36-b2b4-3b3224186afd-signing-key\") pod \"service-ca-568869fdc5-qg84j\" (UID: \"725eee4b-6d01-4f36-b2b4-3b3224186afd\") " pod="openshift-service-ca/service-ca-568869fdc5-qg84j"
Sep 17 10:54:12.810060 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:12.810006    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq96s\" (UniqueName: \"kubernetes.io/projected/725eee4b-6d01-4f36-b2b4-3b3224186afd-kube-api-access-dq96s\") pod \"service-ca-568869fdc5-qg84j\" (UID: \"725eee4b-6d01-4f36-b2b4-3b3224186afd\") " pod="openshift-service-ca/service-ca-568869fdc5-qg84j"
Sep 17 10:54:12.860825 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:12.860802    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-qg84j"
Sep 17 10:54:13.073742 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:13.073683    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jv7wk_89b9f0b0-986a-461c-bb56-8c747c1e21bd/node-ca/0.log"
Sep 17 10:54:13.165037 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:13.165011    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-qg84j"]
Sep 17 10:54:13.175013 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:54:13.174949    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod725eee4b_6d01_4f36_b2b4_3b3224186afd.slice/crio-8892b60ff710ab8a49b46955cbad4c2c1c9476c47a623791da03f44f9e5cff6c WatchSource:0}: Error finding container 8892b60ff710ab8a49b46955cbad4c2c1c9476c47a623791da03f44f9e5cff6c: Status 404 returned error can't find the container with id 8892b60ff710ab8a49b46955cbad4c2c1c9476c47a623791da03f44f9e5cff6c
Sep 17 10:54:13.868263 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:13.868221    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k5q5b_a9591f62-675e-42af-8cdc-7a201faa92da/serve-healthcheck-canary/0.log"
Sep 17 10:54:13.936581 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:13.936549    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vkvmv" event={"ID":"21002dd1-e323-4135-b552-97c4593bf420","Type":"ContainerStarted","Data":"4434ffedd5f4f0b46d6b9fe5d1fe0785ba32515bd791660ea98f6094413b7470"}
Sep 17 10:54:13.936732 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:13.936616    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vkvmv" event={"ID":"21002dd1-e323-4135-b552-97c4593bf420","Type":"ContainerStarted","Data":"afd11d94bd0db658e5f6aa732d2a5fc9f56a54e3b84493967ece537038849658"}
Sep 17 10:54:13.937997 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:13.937975    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-qg84j" event={"ID":"725eee4b-6d01-4f36-b2b4-3b3224186afd","Type":"ContainerStarted","Data":"8892b60ff710ab8a49b46955cbad4c2c1c9476c47a623791da03f44f9e5cff6c"}
Sep 17 10:54:14.009393 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:14.009366    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:14.009559 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:14.009425    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:14.009559 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:14.009431    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 10:54:14.009559 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:14.009530    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-kube-rbac-proxy-cm podName:69728ca8-7dbb-4982-9fd5-4a16ebbacf01 nodeName:}" failed. No retries permitted until 2026-09-17 10:54:18.009494834 +0000 UTC m=+47.804829267 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s2cf4" (UID: "69728ca8-7dbb-4982-9fd5-4a16ebbacf01") : configmap "kube-rbac-proxy" not found
Sep 17 10:54:14.009734 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:14.009572    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 10:54:14.009734 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:14.009618    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-insights-runtime-extractor-tls podName:69728ca8-7dbb-4982-9fd5-4a16ebbacf01 nodeName:}" failed. No retries permitted until 2026-09-17 10:54:18.009605343 +0000 UTC m=+47.804939775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s2cf4" (UID: "69728ca8-7dbb-4982-9fd5-4a16ebbacf01") : secret "insights-runtime-extractor-tls" not found
Sep 17 10:54:15.944986 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:15.944952    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-qg84j" event={"ID":"725eee4b-6d01-4f36-b2b4-3b3224186afd","Type":"ContainerStarted","Data":"22052add5626671850d6a020cbf7c4da67bf7096b4357f45db66ec4ef9b76e8c"}
Sep 17 10:54:15.966982 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:15.966935    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-vkvmv" podStartSLOduration=4.23676962 podStartE2EDuration="5.966921538s" totalImagesPullingTime="1.730151918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 10:54:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:54:13.963367845 +0000 UTC m=+43.758702285" watchObservedRunningTime="2026-09-17 10:54:15.966921538 +0000 UTC m=+45.762256002"
Sep 17 10:54:15.967127 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:15.967013    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-qg84j" podStartSLOduration=1.711185899 podStartE2EDuration="3.96700875s" totalImagesPullingTime="2.255822851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 10:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:54:15.966579497 +0000 UTC m=+45.761913935" watchObservedRunningTime="2026-09-17 10:54:15.96700875 +0000 UTC m=+45.762343188"
Sep 17 10:54:18.038021 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:18.037966    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:18.038399 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:18.038063    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:18.038399 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:18.038169    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 10:54:18.038399 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:54:18.038221    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-insights-runtime-extractor-tls podName:69728ca8-7dbb-4982-9fd5-4a16ebbacf01 nodeName:}" failed. No retries permitted until 2026-09-17 10:54:26.038207545 +0000 UTC m=+55.833541962 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s2cf4" (UID: "69728ca8-7dbb-4982-9fd5-4a16ebbacf01") : secret "insights-runtime-extractor-tls" not found
Sep 17 10:54:18.038556 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:18.038434    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:20.355128 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:20.355090    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2062301-9298-4b90-b0b2-9cbbac41130a-metrics-tls\") pod \"dns-default-hmpqk\" (UID: \"a2062301-9298-4b90-b0b2-9cbbac41130a\") " pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:20.357377 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:20.357355    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a2062301-9298-4b90-b0b2-9cbbac41130a-metrics-tls\") pod \"dns-default-hmpqk\" (UID: \"a2062301-9298-4b90-b0b2-9cbbac41130a\") " pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:20.408335 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:20.408309    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:20.711760 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:20.711681    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hmpqk"]
Sep 17 10:54:20.715041 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:54:20.715016    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2062301_9298_4b90_b0b2_9cbbac41130a.slice/crio-35e4a050c5f02beeca66677eed94e1f361da2d61eeca4b7ba486e483df05f275 WatchSource:0}: Error finding container 35e4a050c5f02beeca66677eed94e1f361da2d61eeca4b7ba486e483df05f275: Status 404 returned error can't find the container with id 35e4a050c5f02beeca66677eed94e1f361da2d61eeca4b7ba486e483df05f275
Sep 17 10:54:20.957870 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:20.957834    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmpqk" event={"ID":"a2062301-9298-4b90-b0b2-9cbbac41130a","Type":"ContainerStarted","Data":"35e4a050c5f02beeca66677eed94e1f361da2d61eeca4b7ba486e483df05f275"}
Sep 17 10:54:23.967380 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:23.967345    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmpqk" event={"ID":"a2062301-9298-4b90-b0b2-9cbbac41130a","Type":"ContainerStarted","Data":"03d1a08c0b375ef40537409df92902687d6bbd5e246ed3ea7f46de3ee6976b4c"}
Sep 17 10:54:23.967803 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:23.967394    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmpqk" event={"ID":"a2062301-9298-4b90-b0b2-9cbbac41130a","Type":"ContainerStarted","Data":"9e84cc29592d41d02daecd3faaa799221e529ffe3c4f280becc8a5a967fffee3"}
Sep 17 10:54:23.967803 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:23.967486    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:23.992904 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:23.992857    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hmpqk" podStartSLOduration=17.744522364 podStartE2EDuration="19.992843112s" totalImagesPullingTime="2.248320748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 10:54:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:54:23.992598176 +0000 UTC m=+53.787932616" watchObservedRunningTime="2026-09-17 10:54:23.992843112 +0000 UTC m=+53.788177548"
Sep 17 10:54:26.094549 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:26.094500    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:26.096811 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:26.096792    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69728ca8-7dbb-4982-9fd5-4a16ebbacf01-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s2cf4\" (UID: \"69728ca8-7dbb-4982-9fd5-4a16ebbacf01\") " pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:26.125325 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:26.125302    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s2cf4"
Sep 17 10:54:26.423832 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:26.422501    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s2cf4"]
Sep 17 10:54:26.424936 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:54:26.424840    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69728ca8_7dbb_4982_9fd5_4a16ebbacf01.slice/crio-7c7ec97882f97e95a911d3f438d625e9151cd8d99a7cba74a092e33011c4b72d WatchSource:0}: Error finding container 7c7ec97882f97e95a911d3f438d625e9151cd8d99a7cba74a092e33011c4b72d: Status 404 returned error can't find the container with id 7c7ec97882f97e95a911d3f438d625e9151cd8d99a7cba74a092e33011c4b72d
Sep 17 10:54:26.978453 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:26.978420    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s2cf4" event={"ID":"69728ca8-7dbb-4982-9fd5-4a16ebbacf01","Type":"ContainerStarted","Data":"9604c758d69f28cdab2259092c29da67eb05e1ae1ec03aadc536f63519a55872"}
Sep 17 10:54:26.978619 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:26.978472    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s2cf4" event={"ID":"69728ca8-7dbb-4982-9fd5-4a16ebbacf01","Type":"ContainerStarted","Data":"7c7ec97882f97e95a911d3f438d625e9151cd8d99a7cba74a092e33011c4b72d"}
Sep 17 10:54:27.984325 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:27.984291    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s2cf4" event={"ID":"69728ca8-7dbb-4982-9fd5-4a16ebbacf01","Type":"ContainerStarted","Data":"7c67d0661a319f043b1d9ccc4c49a893b78c267175aab4139b674ca1670af706"}
Sep 17 10:54:29.896395 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:29.896371    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lv7s5"
Sep 17 10:54:29.994499 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:29.994471    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s2cf4" event={"ID":"69728ca8-7dbb-4982-9fd5-4a16ebbacf01","Type":"ContainerStarted","Data":"eab0f78578a5bba2f144c95231a25cca813b779c80dd39eaadbafeede7e3ebab"}
Sep 17 10:54:30.018828 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:30.018778    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-s2cf4" podStartSLOduration=17.505832913 podStartE2EDuration="20.018765138s" totalImagesPullingTime="2.512932225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 10:54:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:54:30.018350491 +0000 UTC m=+59.813684931" watchObservedRunningTime="2026-09-17 10:54:30.018765138 +0000 UTC m=+59.814099576"
Sep 17 10:54:33.972926 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:33.972900    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hmpqk"
Sep 17 10:54:34.804834 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.804806    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z"]
Sep 17 10:54:34.807321 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.807303    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z"
Sep 17 10:54:34.809860 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.809840    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 17 10:54:34.815191 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.815161    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-h7mcq\""
Sep 17 10:54:34.815296 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.815203    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 17 10:54:34.815296 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.815254    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 17 10:54:34.815592 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.815576    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 17 10:54:34.833202 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.833181    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"]
Sep 17 10:54:34.835639 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.835619    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z"]
Sep 17 10:54:34.835761 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.835724    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:34.838400 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.838383    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 17 10:54:34.845865 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.845849    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 17 10:54:34.846015 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.845851    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 17 10:54:34.846321 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.846308    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 17 10:54:34.858346 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.858322    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9821e314-6140-45b8-a4bb-91e0c5ca23de-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b6b5cff6f-cpnld\" (UID: \"9821e314-6140-45b8-a4bb-91e0c5ca23de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:34.858482 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.858357    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9821e314-6140-45b8-a4bb-91e0c5ca23de-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b6b5cff6f-cpnld\" (UID: \"9821e314-6140-45b8-a4bb-91e0c5ca23de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:34.858482 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.858397    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w9h2\" (UniqueName: \"kubernetes.io/projected/be85db37-a70d-4124-b212-0d5852107057-kube-api-access-7w9h2\") pod \"managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z\" (UID: \"be85db37-a70d-4124-b212-0d5852107057\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z"
Sep 17 10:54:34.858482 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.858458    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9821e314-6140-45b8-a4bb-91e0c5ca23de-hub\") pod \"cluster-proxy-proxy-agent-6b6b5cff6f-cpnld\" (UID: \"9821e314-6140-45b8-a4bb-91e0c5ca23de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:34.858707 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.858497    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9821e314-6140-45b8-a4bb-91e0c5ca23de-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b6b5cff6f-cpnld\" (UID: \"9821e314-6140-45b8-a4bb-91e0c5ca23de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:34.858707 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.858558    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/be85db37-a70d-4124-b212-0d5852107057-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z\" (UID: \"be85db37-a70d-4124-b212-0d5852107057\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z"
Sep 17 10:54:34.858707 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.858573    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9821e314-6140-45b8-a4bb-91e0c5ca23de-ca\") pod \"cluster-proxy-proxy-agent-6b6b5cff6f-cpnld\" (UID: \"9821e314-6140-45b8-a4bb-91e0c5ca23de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:34.858707 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.858594    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq2wq\" (UniqueName: \"kubernetes.io/projected/9821e314-6140-45b8-a4bb-91e0c5ca23de-kube-api-access-cq2wq\") pod \"cluster-proxy-proxy-agent-6b6b5cff6f-cpnld\" (UID: \"9821e314-6140-45b8-a4bb-91e0c5ca23de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:34.874636 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.874614    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"]
Sep 17 10:54:34.958985 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.958964    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9821e314-6140-45b8-a4bb-91e0c5ca23de-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b6b5cff6f-cpnld\" (UID: \"9821e314-6140-45b8-a4bb-91e0c5ca23de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:34.959103 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.959015    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9h2\" (UniqueName: \"kubernetes.io/projected/be85db37-a70d-4124-b212-0d5852107057-kube-api-access-7w9h2\") pod \"managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z\" (UID: \"be85db37-a70d-4124-b212-0d5852107057\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z"
Sep 17 10:54:34.959298 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.959275    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9821e314-6140-45b8-a4bb-91e0c5ca23de-hub\") pod \"cluster-proxy-proxy-agent-6b6b5cff6f-cpnld\" (UID: \"9821e314-6140-45b8-a4bb-91e0c5ca23de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:34.959368 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.959314    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9821e314-6140-45b8-a4bb-91e0c5ca23de-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b6b5cff6f-cpnld\" (UID: \"9821e314-6140-45b8-a4bb-91e0c5ca23de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:34.959427 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.959394    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/be85db37-a70d-4124-b212-0d5852107057-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z\" (UID: \"be85db37-a70d-4124-b212-0d5852107057\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z"
Sep 17 10:54:34.959480 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.959426    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9821e314-6140-45b8-a4bb-91e0c5ca23de-ca\") pod \"cluster-proxy-proxy-agent-6b6b5cff6f-cpnld\" (UID: \"9821e314-6140-45b8-a4bb-91e0c5ca23de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:34.959480 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.959455    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq2wq\" (UniqueName: \"kubernetes.io/projected/9821e314-6140-45b8-a4bb-91e0c5ca23de-kube-api-access-cq2wq\") pod \"cluster-proxy-proxy-agent-6b6b5cff6f-cpnld\" (UID: \"9821e314-6140-45b8-a4bb-91e0c5ca23de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:34.959603 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.959485    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9821e314-6140-45b8-a4bb-91e0c5ca23de-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b6b5cff6f-cpnld\" (UID: \"9821e314-6140-45b8-a4bb-91e0c5ca23de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:34.960231 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.960205    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9821e314-6140-45b8-a4bb-91e0c5ca23de-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b6b5cff6f-cpnld\" (UID: \"9821e314-6140-45b8-a4bb-91e0c5ca23de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:34.961756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.961733    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9821e314-6140-45b8-a4bb-91e0c5ca23de-hub\") pod \"cluster-proxy-proxy-agent-6b6b5cff6f-cpnld\" (UID: \"9821e314-6140-45b8-a4bb-91e0c5ca23de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:34.961846 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.961783    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/be85db37-a70d-4124-b212-0d5852107057-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z\" (UID: \"be85db37-a70d-4124-b212-0d5852107057\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z"
Sep 17 10:54:34.961846 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.961788    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9821e314-6140-45b8-a4bb-91e0c5ca23de-ca\") pod \"cluster-proxy-proxy-agent-6b6b5cff6f-cpnld\" (UID: \"9821e314-6140-45b8-a4bb-91e0c5ca23de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:34.961919 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.961871    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9821e314-6140-45b8-a4bb-91e0c5ca23de-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b6b5cff6f-cpnld\" (UID: \"9821e314-6140-45b8-a4bb-91e0c5ca23de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:34.962312 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.962293    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9821e314-6140-45b8-a4bb-91e0c5ca23de-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b6b5cff6f-cpnld\" (UID: \"9821e314-6140-45b8-a4bb-91e0c5ca23de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:34.978087 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.978067    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq2wq\" (UniqueName: \"kubernetes.io/projected/9821e314-6140-45b8-a4bb-91e0c5ca23de-kube-api-access-cq2wq\") pod \"cluster-proxy-proxy-agent-6b6b5cff6f-cpnld\" (UID: \"9821e314-6140-45b8-a4bb-91e0c5ca23de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:34.987154 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:34.987131    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w9h2\" (UniqueName: \"kubernetes.io/projected/be85db37-a70d-4124-b212-0d5852107057-kube-api-access-7w9h2\") pod \"managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z\" (UID: \"be85db37-a70d-4124-b212-0d5852107057\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z"
Sep 17 10:54:35.133365 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:35.133283    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z"
Sep 17 10:54:35.145706 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:35.145682    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"
Sep 17 10:54:35.409226 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:35.409162    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z"]
Sep 17 10:54:35.412205 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:54:35.412184    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe85db37_a70d_4124_b212_0d5852107057.slice/crio-1d09e4a6db8951003a68c1f4eb6629703bb905e19d1b897924e50771696de022 WatchSource:0}: Error finding container 1d09e4a6db8951003a68c1f4eb6629703bb905e19d1b897924e50771696de022: Status 404 returned error can't find the container with id 1d09e4a6db8951003a68c1f4eb6629703bb905e19d1b897924e50771696de022
Sep 17 10:54:35.443686 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:35.443666    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld"]
Sep 17 10:54:35.446130 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:54:35.446108    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9821e314_6140_45b8_a4bb_91e0c5ca23de.slice/crio-e7004b25c3c73f96b45486dc0d9c147d60ce059ec2b3241ca41e916a45d9eba9 WatchSource:0}: Error finding container e7004b25c3c73f96b45486dc0d9c147d60ce059ec2b3241ca41e916a45d9eba9: Status 404 returned error can't find the container with id e7004b25c3c73f96b45486dc0d9c147d60ce059ec2b3241ca41e916a45d9eba9
Sep 17 10:54:36.013243 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:36.013209    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z" event={"ID":"be85db37-a70d-4124-b212-0d5852107057","Type":"ContainerStarted","Data":"1d09e4a6db8951003a68c1f4eb6629703bb905e19d1b897924e50771696de022"}
Sep 17 10:54:36.014264 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:36.014241    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld" event={"ID":"9821e314-6140-45b8-a4bb-91e0c5ca23de","Type":"ContainerStarted","Data":"e7004b25c3c73f96b45486dc0d9c147d60ce059ec2b3241ca41e916a45d9eba9"}
Sep 17 10:54:36.371064 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:36.370849    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs\") pod \"network-metrics-daemon-9vjl6\" (UID: \"ac33a910-7eec-4397-8b78-0ebce51a572d\") " pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:54:36.373782 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:36.373745    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 10:54:36.384564 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:36.384539    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ac33a910-7eec-4397-8b78-0ebce51a572d-metrics-certs\") pod \"network-metrics-daemon-9vjl6\" (UID: \"ac33a910-7eec-4397-8b78-0ebce51a572d\") " pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:54:36.471839 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:36.471802    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret\") pod \"global-pull-secret-syncer-v56d8\" (UID: \"ef38bd1a-72d9-451f-b754-72d2fd579687\") " pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:54:36.472007 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:36.471876    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvz8g\" (UniqueName: \"kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g\") pod \"network-check-target-l9f4s\" (UID: \"2e6652dd-cd64-4562-9340-bba6e831af73\") " pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:54:36.475675 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:36.475650    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 10:54:36.475928 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:36.475911    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 10:54:36.485859 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:36.485678    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 10:54:36.489326 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:36.489280    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef38bd1a-72d9-451f-b754-72d2fd579687-original-pull-secret\") pod \"global-pull-secret-syncer-v56d8\" (UID: \"ef38bd1a-72d9-451f-b754-72d2fd579687\") " pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:54:36.496465 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:36.496273    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v56d8"
Sep 17 10:54:36.505354 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:36.505330    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvz8g\" (UniqueName: \"kubernetes.io/projected/2e6652dd-cd64-4562-9340-bba6e831af73-kube-api-access-xvz8g\") pod \"network-check-target-l9f4s\" (UID: \"2e6652dd-cd64-4562-9340-bba6e831af73\") " pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:54:36.512705 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:36.512685    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4chbd\""
Sep 17 10:54:36.520317 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:36.520265    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vjl6"
Sep 17 10:54:36.806645 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:36.806418    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gx69l\""
Sep 17 10:54:36.813951 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:36.813925    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:54:36.819611 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:36.819499    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v56d8"]
Sep 17 10:54:36.824838 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:54:36.824802    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef38bd1a_72d9_451f_b754_72d2fd579687.slice/crio-29a5a241ed80908dffa162f211918351fa1f903f8f390113428bd9880e82c9a8 WatchSource:0}: Error finding container 29a5a241ed80908dffa162f211918351fa1f903f8f390113428bd9880e82c9a8: Status 404 returned error can't find the container with id 29a5a241ed80908dffa162f211918351fa1f903f8f390113428bd9880e82c9a8
Sep 17 10:54:36.852935 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:36.852908    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9vjl6"]
Sep 17 10:54:36.858979 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:54:36.858931    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac33a910_7eec_4397_8b78_0ebce51a572d.slice/crio-45e8afb0d9b491be76c1f1ec6592222881670f666face9615a69ebc71849c314 WatchSource:0}: Error finding container 45e8afb0d9b491be76c1f1ec6592222881670f666face9615a69ebc71849c314: Status 404 returned error can't find the container with id 45e8afb0d9b491be76c1f1ec6592222881670f666face9615a69ebc71849c314
Sep 17 10:54:37.021011 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:37.020970    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9vjl6" event={"ID":"ac33a910-7eec-4397-8b78-0ebce51a572d","Type":"ContainerStarted","Data":"45e8afb0d9b491be76c1f1ec6592222881670f666face9615a69ebc71849c314"}
Sep 17 10:54:37.022905 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:37.022847    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v56d8" event={"ID":"ef38bd1a-72d9-451f-b754-72d2fd579687","Type":"ContainerStarted","Data":"29a5a241ed80908dffa162f211918351fa1f903f8f390113428bd9880e82c9a8"}
Sep 17 10:54:37.150471 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:37.150256    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-l9f4s"]
Sep 17 10:54:37.155678 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:54:37.155646    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e6652dd_cd64_4562_9340_bba6e831af73.slice/crio-672c3d2b59570a1a5713449373b6695e6639e63f4df7c977e11ef01ef9f9af46 WatchSource:0}: Error finding container 672c3d2b59570a1a5713449373b6695e6639e63f4df7c977e11ef01ef9f9af46: Status 404 returned error can't find the container with id 672c3d2b59570a1a5713449373b6695e6639e63f4df7c977e11ef01ef9f9af46
Sep 17 10:54:38.028046 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:38.028003    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l9f4s" event={"ID":"2e6652dd-cd64-4562-9340-bba6e831af73","Type":"ContainerStarted","Data":"672c3d2b59570a1a5713449373b6695e6639e63f4df7c977e11ef01ef9f9af46"}
Sep 17 10:54:41.043492 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:41.043219    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9vjl6" event={"ID":"ac33a910-7eec-4397-8b78-0ebce51a572d","Type":"ContainerStarted","Data":"131da3cb313805d36ef960fe3add1bc25bc0b14bae6bc847c2534e437c7b6f73"}
Sep 17 10:54:41.045848 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:41.045803    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z" event={"ID":"be85db37-a70d-4124-b212-0d5852107057","Type":"ContainerStarted","Data":"f38d70d7b30345c3c2bef0fb5eb6efd0bd7191b4f50825f403b722fdfaf1012e"}
Sep 17 10:54:41.047822 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:41.047795    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld" event={"ID":"9821e314-6140-45b8-a4bb-91e0c5ca23de","Type":"ContainerStarted","Data":"861e4daa81b2676fe912dc93074f1633859b7da8cd923058070402d1945e1ffc"}
Sep 17 10:54:41.066496 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:41.066444    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b7b66d7fb-wbv2z" podStartSLOduration=1.9848930569999998 podStartE2EDuration="7.066424018s" totalImagesPullingTime="5.081530961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 10:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:54:41.065730028 +0000 UTC m=+70.861064470" watchObservedRunningTime="2026-09-17 10:54:41.066424018 +0000 UTC m=+70.861758482"
Sep 17 10:54:44.059778 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:44.059743    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-l9f4s" event={"ID":"2e6652dd-cd64-4562-9340-bba6e831af73","Type":"ContainerStarted","Data":"4aa7c38551072e46762af2f8ab24a52c990c2b1c2c24745644a86aa5ff8b4a18"}
Sep 17 10:54:44.060207 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:44.059831    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:54:44.061876 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:44.061854    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld" event={"ID":"9821e314-6140-45b8-a4bb-91e0c5ca23de","Type":"ContainerStarted","Data":"819199fc3a0570b67f1a9b760ed1a1591ae0250c896dd0acd96455625238f9a5"}
Sep 17 10:54:44.061876 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:44.061885    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld" event={"ID":"9821e314-6140-45b8-a4bb-91e0c5ca23de","Type":"ContainerStarted","Data":"18250f1cb6c50f3a8497c1f5110e6d6117c9f0cbec4ad01b9d8bee59d267d6a1"}
Sep 17 10:54:44.063314 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:44.063295    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v56d8" event={"ID":"ef38bd1a-72d9-451f-b754-72d2fd579687","Type":"ContainerStarted","Data":"e64c4a0fddb446ee389b08be1eec0dfaa4e0e11ca4e52a4f77c772bd43e5df08"}
Sep 17 10:54:44.064950 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:44.064930    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9vjl6" event={"ID":"ac33a910-7eec-4397-8b78-0ebce51a572d","Type":"ContainerStarted","Data":"fb0b225c15c53ac4062e4bc2121386408954baa19cf7e9a2c2df2f811e8781d6"}
Sep 17 10:54:44.084982 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:44.084944    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-l9f4s" podStartSLOduration=68.211714571 podStartE2EDuration="1m14.084930231s" totalImagesPullingTime="5.87321566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 10:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:54:44.084006124 +0000 UTC m=+73.879340563" watchObservedRunningTime="2026-09-17 10:54:44.084930231 +0000 UTC m=+73.880264666"
Sep 17 10:54:44.101777 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:44.101741    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v56d8" podStartSLOduration=66.89193926 podStartE2EDuration="1m13.101730301s" totalImagesPullingTime="6.209791041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 10:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:54:44.101128501 +0000 UTC m=+73.896462939" watchObservedRunningTime="2026-09-17 10:54:44.101730301 +0000 UTC m=+73.897064740"
Sep 17 10:54:44.124755 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:44.124721    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b6b5cff6f-cpnld" podStartSLOduration=5.050983452 podStartE2EDuration="10.124708974s" totalImagesPullingTime="5.073725522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 10:54:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:54:44.123299293 +0000 UTC m=+73.918633732" watchObservedRunningTime="2026-09-17 10:54:44.124708974 +0000 UTC m=+73.920043433"
Sep 17 10:54:44.149078 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:44.149038    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9vjl6" podStartSLOduration=70.512117977 podStartE2EDuration="1m14.149027022s" totalImagesPullingTime="3.636909045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 10:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:54:44.147368104 +0000 UTC m=+73.942702542" watchObservedRunningTime="2026-09-17 10:54:44.149027022 +0000 UTC m=+73.944361452"
Sep 17 10:54:46.136983 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.136949    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pj2l2"]
Sep 17 10:54:46.139703 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.139683    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.142428 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.142409    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 10:54:46.143931 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.143910    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 10:54:46.144154 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.144132    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kt2bx\""
Sep 17 10:54:46.144239 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.144172    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 10:54:46.144309 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.144244    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 10:54:46.145360 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.145343    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 10:54:46.145453 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.145343    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 10:54:46.243064 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.243043    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc13021c-972c-4534-a81c-5954ad4e5bf6-root\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.243184 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.243071    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc13021c-972c-4534-a81c-5954ad4e5bf6-node-exporter-tls\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.243184 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.243089    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc13021c-972c-4534-a81c-5954ad4e5bf6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.243184 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.243113    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfx8b\" (UniqueName: \"kubernetes.io/projected/dc13021c-972c-4534-a81c-5954ad4e5bf6-kube-api-access-zfx8b\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.243279 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.243189    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc13021c-972c-4534-a81c-5954ad4e5bf6-node-exporter-textfile\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.243279 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.243241    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc13021c-972c-4534-a81c-5954ad4e5bf6-node-exporter-wtmp\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.243279 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.243265    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc13021c-972c-4534-a81c-5954ad4e5bf6-sys\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.243367 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.243291    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc13021c-972c-4534-a81c-5954ad4e5bf6-metrics-client-ca\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.243367 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.243317    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc13021c-972c-4534-a81c-5954ad4e5bf6-node-exporter-accelerators-collector-config\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.344171 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.344149    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc13021c-972c-4534-a81c-5954ad4e5bf6-node-exporter-wtmp\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.344267 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.344176    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc13021c-972c-4534-a81c-5954ad4e5bf6-sys\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.344267 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.344193    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc13021c-972c-4534-a81c-5954ad4e5bf6-metrics-client-ca\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.344267 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.344209    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc13021c-972c-4534-a81c-5954ad4e5bf6-node-exporter-accelerators-collector-config\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.344267 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.344241    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc13021c-972c-4534-a81c-5954ad4e5bf6-root\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.344407 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.344261    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc13021c-972c-4534-a81c-5954ad4e5bf6-sys\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.344407 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.344290    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dc13021c-972c-4534-a81c-5954ad4e5bf6-root\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.344407 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.344307    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc13021c-972c-4534-a81c-5954ad4e5bf6-node-exporter-tls\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.344407 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.344336    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc13021c-972c-4534-a81c-5954ad4e5bf6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.344407 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.344349    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dc13021c-972c-4534-a81c-5954ad4e5bf6-node-exporter-wtmp\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.344407 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.344373    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfx8b\" (UniqueName: \"kubernetes.io/projected/dc13021c-972c-4534-a81c-5954ad4e5bf6-kube-api-access-zfx8b\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.344646 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.344414    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc13021c-972c-4534-a81c-5954ad4e5bf6-node-exporter-textfile\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.344740 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.344721    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dc13021c-972c-4534-a81c-5954ad4e5bf6-node-exporter-textfile\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.344914 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.344888    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc13021c-972c-4534-a81c-5954ad4e5bf6-metrics-client-ca\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.345011 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.344939    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dc13021c-972c-4534-a81c-5954ad4e5bf6-node-exporter-accelerators-collector-config\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.346669 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.346654    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dc13021c-972c-4534-a81c-5954ad4e5bf6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.346772 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.346753    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dc13021c-972c-4534-a81c-5954ad4e5bf6-node-exporter-tls\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.356114 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.356090    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfx8b\" (UniqueName: \"kubernetes.io/projected/dc13021c-972c-4534-a81c-5954ad4e5bf6-kube-api-access-zfx8b\") pod \"node-exporter-pj2l2\" (UID: \"dc13021c-972c-4534-a81c-5954ad4e5bf6\") " pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.451494 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:46.451445    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pj2l2"
Sep 17 10:54:46.460778 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:54:46.460754    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc13021c_972c_4534_a81c_5954ad4e5bf6.slice/crio-2ff0f11e21c2ace17d92d78f2f03ecab2aa614a639627c62a876ae06bf169090 WatchSource:0}: Error finding container 2ff0f11e21c2ace17d92d78f2f03ecab2aa614a639627c62a876ae06bf169090: Status 404 returned error can't find the container with id 2ff0f11e21c2ace17d92d78f2f03ecab2aa614a639627c62a876ae06bf169090
Sep 17 10:54:47.076978 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:47.076947    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pj2l2" event={"ID":"dc13021c-972c-4534-a81c-5954ad4e5bf6","Type":"ContainerStarted","Data":"2ff0f11e21c2ace17d92d78f2f03ecab2aa614a639627c62a876ae06bf169090"}
Sep 17 10:54:48.082580 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:48.082546    2570 generic.go:356] "Generic (PLEG): container finished" podID="dc13021c-972c-4534-a81c-5954ad4e5bf6" containerID="92019f7540c8ba9807d3f2deec79565c1dff8e516a788aa4e80f689a56bc6682" exitCode=0
Sep 17 10:54:48.082957 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:48.082589    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pj2l2" event={"ID":"dc13021c-972c-4534-a81c-5954ad4e5bf6","Type":"ContainerDied","Data":"92019f7540c8ba9807d3f2deec79565c1dff8e516a788aa4e80f689a56bc6682"}
Sep 17 10:54:49.088493 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:49.088462    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pj2l2" event={"ID":"dc13021c-972c-4534-a81c-5954ad4e5bf6","Type":"ContainerStarted","Data":"d28c233d351a8127251f2ed96b8625468e8128e1bcb18e6857b57ad167a84c47"}
Sep 17 10:54:49.088879 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:49.088524    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pj2l2" event={"ID":"dc13021c-972c-4534-a81c-5954ad4e5bf6","Type":"ContainerStarted","Data":"9b79846d2fbb15f0042494d7e4adb08f54f2bd1cf4ed12d671cf8250a88eca6d"}
Sep 17 10:54:52.559478 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.559419    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pj2l2" podStartSLOduration=5.353390458 podStartE2EDuration="6.559403458s" totalImagesPullingTime="1.14593472s" totalInitContainerRuntime="60.07828ms" isStatefulPod=true podCreationTimestamp="2026-09-17 10:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:54:49.117547562 +0000 UTC m=+78.912882002" watchObservedRunningTime="2026-09-17 10:54:52.559403458 +0000 UTC m=+82.354737930"
Sep 17 10:54:52.560397 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.560376    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 10:54:52.564955 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.564940    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.569971 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.569946    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 17 10:54:52.570177 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.570149    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 17 10:54:52.570177 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.570158    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-km80r7onje1p\""
Sep 17 10:54:52.570288 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.570243    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 17 10:54:52.570288 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.570255    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 17 10:54:52.570381 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.570282    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 17 10:54:52.570381 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.570376    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 17 10:54:52.570560 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.570547    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 17 10:54:52.570633 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.570553    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 17 10:54:52.570801 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.570782    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 17 10:54:52.570901 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.570806    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 17 10:54:52.570960 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.570815    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 17 10:54:52.571007 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.570825    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 17 10:54:52.571592 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.571573    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 17 10:54:52.571754 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.571737    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tpwm7\""
Sep 17 10:54:52.571892 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.571872    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 17 10:54:52.576490 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.576467    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 17 10:54:52.588878 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.588855    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 10:54:52.681997 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.681976    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.682116 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.682013    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.682116 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.682033    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.682116 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.682054    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.682116 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.682071    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7zg9\" (UniqueName: \"kubernetes.io/projected/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-kube-api-access-p7zg9\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.682371 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.682137    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.682371 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.682180    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.682371 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.682206    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.682371 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.682233    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-config\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.682371 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.682256    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.682371 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.682303    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.682371 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.682331    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.682371 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.682355    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.682721 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.682381    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.682721 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.682414    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.682721 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.682439    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.682721 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.682463    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.682721 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.682486    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.682721 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.682539    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.682721 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.682565    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.783451 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783424    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.783563 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783454    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.783563 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783470    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7zg9\" (UniqueName: \"kubernetes.io/projected/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-kube-api-access-p7zg9\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.783563 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783496    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.783695 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783573    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.783695 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783599    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.783695 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783624    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-config\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.783695 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783643    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.783695 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783689    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.783924 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783712    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.783924 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783735    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.783924 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783761    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.783924 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783792    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.783924 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783818    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.783924 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783841    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.783924 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783866    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.783924 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783895    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.783924 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783921    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.784357 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783951    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.784357 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.783983    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.784357 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.784001    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.784357 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.784269    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.784357 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.784278    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.785034 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.784734    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.785174 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.785149    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.786340 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.785927    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.786340 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.786319    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.787184 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.787161    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.787498 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.787477    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-config\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.788144 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.787618    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.788144 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.787640    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.788144 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.788075    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.788144 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.788104    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.788927 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.788888    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.789035 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.788950    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.789251 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.789229    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.789502 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.789484    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.789598 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.789552    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.789862 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.789841    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.802528 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.802494    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7zg9\" (UniqueName: \"kubernetes.io/projected/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-kube-api-access-p7zg9\") pod \"prometheus-k8s-0\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:52.874452 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:52.874407    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:54:53.159617 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:53.159590    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 10:54:53.160806 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:54:53.160782    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5addfd6_7b18_4b7b_b1ca_5f883f8096a5.slice/crio-de2b92153fcc853f437f39d94699e1212404e9fca569a66fdd80b56acad85d67 WatchSource:0}: Error finding container de2b92153fcc853f437f39d94699e1212404e9fca569a66fdd80b56acad85d67: Status 404 returned error can't find the container with id de2b92153fcc853f437f39d94699e1212404e9fca569a66fdd80b56acad85d67
Sep 17 10:54:54.106033 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:54.105995    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5","Type":"ContainerStarted","Data":"de2b92153fcc853f437f39d94699e1212404e9fca569a66fdd80b56acad85d67"}
Sep 17 10:54:55.111060 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:55.111029    2570 generic.go:356] "Generic (PLEG): container finished" podID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerID="28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81" exitCode=0
Sep 17 10:54:55.111535 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:55.111118    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5","Type":"ContainerDied","Data":"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81"}
Sep 17 10:54:59.127803 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:59.127765    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5","Type":"ContainerStarted","Data":"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d"}
Sep 17 10:54:59.128235 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:54:59.127847    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5","Type":"ContainerStarted","Data":"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b"}
Sep 17 10:55:01.139051 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:55:01.139013    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5","Type":"ContainerStarted","Data":"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62"}
Sep 17 10:55:01.139451 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:55:01.139079    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5","Type":"ContainerStarted","Data":"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f"}
Sep 17 10:55:01.139451 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:55:01.139110    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5","Type":"ContainerStarted","Data":"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683"}
Sep 17 10:55:01.139451 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:55:01.139141    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5","Type":"ContainerStarted","Data":"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b"}
Sep 17 10:55:01.172687 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:55:01.172615    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.018722681 podStartE2EDuration="9.17259824s" totalImagesPullingTime="6.135052648s" totalInitContainerRuntime="18.822911ms" isStatefulPod=false podCreationTimestamp="2026-09-17 10:54:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:55:01.170217928 +0000 UTC m=+90.965552372" watchObservedRunningTime="2026-09-17 10:55:01.17259824 +0000 UTC m=+90.967932678"
Sep 17 10:55:02.874769 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:55:02.874739    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:55:15.071740 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:55:15.071709    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-l9f4s"
Sep 17 10:55:52.875346 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:55:52.875315    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:55:52.893756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:55:52.893728    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:55:53.326957 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:55:53.326923    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.061904 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.061873    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 10:56:11.062289 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.062137    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="prometheus" containerID="cri-o://f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b" gracePeriod=600
Sep 17 10:56:11.062289 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.062162    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="thanos-sidecar" containerID="cri-o://1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b" gracePeriod=600
Sep 17 10:56:11.062289 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.062180    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="config-reloader" containerID="cri-o://1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d" gracePeriod=600
Sep 17 10:56:11.062289 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.062222    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="kube-rbac-proxy-web" containerID="cri-o://c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683" gracePeriod=600
Sep 17 10:56:11.062289 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.062242    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="kube-rbac-proxy-thanos" containerID="cri-o://281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62" gracePeriod=600
Sep 17 10:56:11.062547 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.062147    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="kube-rbac-proxy" containerID="cri-o://080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f" gracePeriod=600
Sep 17 10:56:11.288568 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.288543    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.374628 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.374554    2570 generic.go:356] "Generic (PLEG): container finished" podID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerID="281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62" exitCode=0
Sep 17 10:56:11.374628 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.374579    2570 generic.go:356] "Generic (PLEG): container finished" podID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerID="080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f" exitCode=0
Sep 17 10:56:11.374628 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.374586    2570 generic.go:356] "Generic (PLEG): container finished" podID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerID="c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683" exitCode=0
Sep 17 10:56:11.374628 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.374592    2570 generic.go:356] "Generic (PLEG): container finished" podID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerID="1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b" exitCode=0
Sep 17 10:56:11.374628 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.374598    2570 generic.go:356] "Generic (PLEG): container finished" podID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerID="1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d" exitCode=0
Sep 17 10:56:11.374628 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.374606    2570 generic.go:356] "Generic (PLEG): container finished" podID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerID="f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b" exitCode=0
Sep 17 10:56:11.374628 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.374605    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5","Type":"ContainerDied","Data":"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62"}
Sep 17 10:56:11.375043 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.374660    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.375043 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.374691    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5","Type":"ContainerDied","Data":"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f"}
Sep 17 10:56:11.375043 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.374733    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5","Type":"ContainerDied","Data":"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683"}
Sep 17 10:56:11.375043 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.374753    2570 scope.go:117] "RemoveContainer" containerID="281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62"
Sep 17 10:56:11.375043 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.374771    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5","Type":"ContainerDied","Data":"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b"}
Sep 17 10:56:11.375043 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.374813    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5","Type":"ContainerDied","Data":"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d"}
Sep 17 10:56:11.375043 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.374856    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5","Type":"ContainerDied","Data":"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b"}
Sep 17 10:56:11.375043 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.374897    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5","Type":"ContainerDied","Data":"de2b92153fcc853f437f39d94699e1212404e9fca569a66fdd80b56acad85d67"}
Sep 17 10:56:11.382158 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.382139    2570 scope.go:117] "RemoveContainer" containerID="080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f"
Sep 17 10:56:11.388689 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.388670    2570 scope.go:117] "RemoveContainer" containerID="c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683"
Sep 17 10:56:11.395712 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.395690    2570 scope.go:117] "RemoveContainer" containerID="1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b"
Sep 17 10:56:11.401878 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.401862    2570 scope.go:117] "RemoveContainer" containerID="1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d"
Sep 17 10:56:11.408310 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.408286    2570 scope.go:117] "RemoveContainer" containerID="f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b"
Sep 17 10:56:11.414605 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.414586    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-configmap-kubelet-serving-ca-bundle\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.414686 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.414622    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.414686 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.414651    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7zg9\" (UniqueName: \"kubernetes.io/projected/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-kube-api-access-p7zg9\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.414686 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.414681    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-config\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.414957 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.414706    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-kube-rbac-proxy\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.414957 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.414733    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-thanos-prometheus-http-client-file\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.414957 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.414763    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-tls-assets\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.414957 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.414788    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-prometheus-k8s-tls\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.414957 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.414818    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-configmap-serving-certs-ca-bundle\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.414957 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.414853    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-rulefiles-0\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.414957 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.414877    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.414957 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.414910    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-trusted-ca-bundle\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.414957 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.414940    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-metrics-client-certs\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.415392 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.414965    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-grpc-tls\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.415392 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.414992    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 10:56:11.415392 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.415000    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-rulefiles-2\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.415392 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.415040    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-configmap-metrics-client-ca\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.415392 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.415078    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-config-out\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.415392 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.415113    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-db\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.415392 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.415153    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-rulefiles-1\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.415392 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.415183    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-web-config\") pod \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\" (UID: \"f5addfd6-7b18-4b7b-b1ca-5f883f8096a5\") "
Sep 17 10:56:11.415392 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.415385    2570 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.415874 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.415401    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 10:56:11.415874 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.415700    2570 scope.go:117] "RemoveContainer" containerID="28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81"
Sep 17 10:56:11.416726 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.416695    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 10:56:11.417167 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.417138    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 10:56:11.417426 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.417401    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 10:56:11.417497 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.417448    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 10:56:11.417752 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.417722    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 10:56:11.417905 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.417842    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 10:56:11.418106 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.418073    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 10:56:11.419073 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.419028    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 10:56:11.419309 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.419216    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 10:56:11.419309 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.419226    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 10:56:11.419309 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.419280    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-config" (OuterVolumeSpecName: "config") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 10:56:11.419309 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.419289    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 10:56:11.419641 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.419365    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-kube-api-access-p7zg9" (OuterVolumeSpecName: "kube-api-access-p7zg9") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "kube-api-access-p7zg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 10:56:11.419957 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.419925    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-config-out" (OuterVolumeSpecName: "config-out") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 10:56:11.420111 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.420077    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 10:56:11.420175 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.420077    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 10:56:11.420442 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.420422    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 10:56:11.424287 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.424269    2570 scope.go:117] "RemoveContainer" containerID="281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62"
Sep 17 10:56:11.424587 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:56:11.424568    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62\": container with ID starting with 281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62 not found: ID does not exist" containerID="281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62"
Sep 17 10:56:11.424638 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.424596    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62"} err="failed to get container status \"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62\": rpc error: code = NotFound desc = could not find container \"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62\": container with ID starting with 281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62 not found: ID does not exist"
Sep 17 10:56:11.424638 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.424628    2570 scope.go:117] "RemoveContainer" containerID="080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f"
Sep 17 10:56:11.424886 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:56:11.424869    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f\": container with ID starting with 080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f not found: ID does not exist" containerID="080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f"
Sep 17 10:56:11.424934 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.424892    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f"} err="failed to get container status \"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f\": rpc error: code = NotFound desc = could not find container \"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f\": container with ID starting with 080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f not found: ID does not exist"
Sep 17 10:56:11.424934 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.424907    2570 scope.go:117] "RemoveContainer" containerID="c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683"
Sep 17 10:56:11.425171 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:56:11.425150    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683\": container with ID starting with c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683 not found: ID does not exist" containerID="c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683"
Sep 17 10:56:11.425219 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.425179    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683"} err="failed to get container status \"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683\": rpc error: code = NotFound desc = could not find container \"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683\": container with ID starting with c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683 not found: ID does not exist"
Sep 17 10:56:11.425219 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.425201    2570 scope.go:117] "RemoveContainer" containerID="1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b"
Sep 17 10:56:11.425430 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:56:11.425413    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b\": container with ID starting with 1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b not found: ID does not exist" containerID="1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b"
Sep 17 10:56:11.425477 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.425434    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b"} err="failed to get container status \"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b\": rpc error: code = NotFound desc = could not find container \"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b\": container with ID starting with 1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b not found: ID does not exist"
Sep 17 10:56:11.425477 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.425448    2570 scope.go:117] "RemoveContainer" containerID="1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d"
Sep 17 10:56:11.425718 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:56:11.425701    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d\": container with ID starting with 1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d not found: ID does not exist" containerID="1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d"
Sep 17 10:56:11.425760 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.425722    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d"} err="failed to get container status \"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d\": rpc error: code = NotFound desc = could not find container \"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d\": container with ID starting with 1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d not found: ID does not exist"
Sep 17 10:56:11.425760 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.425735    2570 scope.go:117] "RemoveContainer" containerID="f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b"
Sep 17 10:56:11.426012 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:56:11.425995    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b\": container with ID starting with f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b not found: ID does not exist" containerID="f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b"
Sep 17 10:56:11.426061 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.426014    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b"} err="failed to get container status \"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b\": rpc error: code = NotFound desc = could not find container \"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b\": container with ID starting with f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b not found: ID does not exist"
Sep 17 10:56:11.426061 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.426029    2570 scope.go:117] "RemoveContainer" containerID="28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81"
Sep 17 10:56:11.426276 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:56:11.426260    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81\": container with ID starting with 28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81 not found: ID does not exist" containerID="28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81"
Sep 17 10:56:11.426314 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.426279    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81"} err="failed to get container status \"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81\": rpc error: code = NotFound desc = could not find container \"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81\": container with ID starting with 28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81 not found: ID does not exist"
Sep 17 10:56:11.426314 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.426291    2570 scope.go:117] "RemoveContainer" containerID="281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62"
Sep 17 10:56:11.426608 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.426505    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62"} err="failed to get container status \"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62\": rpc error: code = NotFound desc = could not find container \"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62\": container with ID starting with 281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62 not found: ID does not exist"
Sep 17 10:56:11.426669 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.426610    2570 scope.go:117] "RemoveContainer" containerID="080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f"
Sep 17 10:56:11.426874 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.426856    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f"} err="failed to get container status \"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f\": rpc error: code = NotFound desc = could not find container \"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f\": container with ID starting with 080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f not found: ID does not exist"
Sep 17 10:56:11.426932 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.426875    2570 scope.go:117] "RemoveContainer" containerID="c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683"
Sep 17 10:56:11.427104 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.427089    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683"} err="failed to get container status \"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683\": rpc error: code = NotFound desc = could not find container \"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683\": container with ID starting with c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683 not found: ID does not exist"
Sep 17 10:56:11.427104 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.427103    2570 scope.go:117] "RemoveContainer" containerID="1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b"
Sep 17 10:56:11.427341 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.427322    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b"} err="failed to get container status \"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b\": rpc error: code = NotFound desc = could not find container \"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b\": container with ID starting with 1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b not found: ID does not exist"
Sep 17 10:56:11.427382 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.427343    2570 scope.go:117] "RemoveContainer" containerID="1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d"
Sep 17 10:56:11.427603 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.427579    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d"} err="failed to get container status \"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d\": rpc error: code = NotFound desc = could not find container \"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d\": container with ID starting with 1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d not found: ID does not exist"
Sep 17 10:56:11.427652 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.427606    2570 scope.go:117] "RemoveContainer" containerID="f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b"
Sep 17 10:56:11.427854 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.427838    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b"} err="failed to get container status \"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b\": rpc error: code = NotFound desc = could not find container \"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b\": container with ID starting with f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b not found: ID does not exist"
Sep 17 10:56:11.427894 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.427855    2570 scope.go:117] "RemoveContainer" containerID="28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81"
Sep 17 10:56:11.428084 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.428067    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81"} err="failed to get container status \"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81\": rpc error: code = NotFound desc = could not find container \"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81\": container with ID starting with 28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81 not found: ID does not exist"
Sep 17 10:56:11.428136 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.428084    2570 scope.go:117] "RemoveContainer" containerID="281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62"
Sep 17 10:56:11.428279 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.428261    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62"} err="failed to get container status \"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62\": rpc error: code = NotFound desc = could not find container \"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62\": container with ID starting with 281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62 not found: ID does not exist"
Sep 17 10:56:11.428322 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.428278    2570 scope.go:117] "RemoveContainer" containerID="080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f"
Sep 17 10:56:11.428485 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.428464    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f"} err="failed to get container status \"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f\": rpc error: code = NotFound desc = could not find container \"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f\": container with ID starting with 080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f not found: ID does not exist"
Sep 17 10:56:11.428602 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.428487    2570 scope.go:117] "RemoveContainer" containerID="c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683"
Sep 17 10:56:11.428823 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.428805    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683"} err="failed to get container status \"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683\": rpc error: code = NotFound desc = could not find container \"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683\": container with ID starting with c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683 not found: ID does not exist"
Sep 17 10:56:11.428823 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.428824    2570 scope.go:117] "RemoveContainer" containerID="1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b"
Sep 17 10:56:11.429042 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.429022    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b"} err="failed to get container status \"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b\": rpc error: code = NotFound desc = could not find container \"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b\": container with ID starting with 1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b not found: ID does not exist"
Sep 17 10:56:11.429042 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.429041    2570 scope.go:117] "RemoveContainer" containerID="1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d"
Sep 17 10:56:11.429308 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.429289    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d"} err="failed to get container status \"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d\": rpc error: code = NotFound desc = could not find container \"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d\": container with ID starting with 1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d not found: ID does not exist"
Sep 17 10:56:11.429308 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.429307    2570 scope.go:117] "RemoveContainer" containerID="f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b"
Sep 17 10:56:11.429626 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.429607    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b"} err="failed to get container status \"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b\": rpc error: code = NotFound desc = could not find container \"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b\": container with ID starting with f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b not found: ID does not exist"
Sep 17 10:56:11.429700 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.429627    2570 scope.go:117] "RemoveContainer" containerID="28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81"
Sep 17 10:56:11.429871 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.429855    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81"} err="failed to get container status \"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81\": rpc error: code = NotFound desc = could not find container \"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81\": container with ID starting with 28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81 not found: ID does not exist"
Sep 17 10:56:11.429924 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.429872    2570 scope.go:117] "RemoveContainer" containerID="281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62"
Sep 17 10:56:11.430103 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.430084    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62"} err="failed to get container status \"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62\": rpc error: code = NotFound desc = could not find container \"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62\": container with ID starting with 281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62 not found: ID does not exist"
Sep 17 10:56:11.430145 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.430103    2570 scope.go:117] "RemoveContainer" containerID="080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f"
Sep 17 10:56:11.430318 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.430299    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f"} err="failed to get container status \"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f\": rpc error: code = NotFound desc = could not find container \"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f\": container with ID starting with 080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f not found: ID does not exist"
Sep 17 10:56:11.430365 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.430319    2570 scope.go:117] "RemoveContainer" containerID="c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683"
Sep 17 10:56:11.430580 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.430553    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683"} err="failed to get container status \"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683\": rpc error: code = NotFound desc = could not find container \"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683\": container with ID starting with c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683 not found: ID does not exist"
Sep 17 10:56:11.430666 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.430582    2570 scope.go:117] "RemoveContainer" containerID="1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b"
Sep 17 10:56:11.430666 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.430566    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-web-config" (OuterVolumeSpecName: "web-config") pod "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" (UID: "f5addfd6-7b18-4b7b-b1ca-5f883f8096a5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 10:56:11.430843 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.430824    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b"} err="failed to get container status \"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b\": rpc error: code = NotFound desc = could not find container \"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b\": container with ID starting with 1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b not found: ID does not exist"
Sep 17 10:56:11.430909 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.430847    2570 scope.go:117] "RemoveContainer" containerID="1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d"
Sep 17 10:56:11.431082 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.431063    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d"} err="failed to get container status \"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d\": rpc error: code = NotFound desc = could not find container \"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d\": container with ID starting with 1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d not found: ID does not exist"
Sep 17 10:56:11.431082 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.431081    2570 scope.go:117] "RemoveContainer" containerID="f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b"
Sep 17 10:56:11.431307 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.431291    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b"} err="failed to get container status \"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b\": rpc error: code = NotFound desc = could not find container \"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b\": container with ID starting with f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b not found: ID does not exist"
Sep 17 10:56:11.431307 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.431307    2570 scope.go:117] "RemoveContainer" containerID="28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81"
Sep 17 10:56:11.431501 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.431485    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81"} err="failed to get container status \"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81\": rpc error: code = NotFound desc = could not find container \"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81\": container with ID starting with 28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81 not found: ID does not exist"
Sep 17 10:56:11.431565 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.431501    2570 scope.go:117] "RemoveContainer" containerID="281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62"
Sep 17 10:56:11.431742 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.431727    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62"} err="failed to get container status \"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62\": rpc error: code = NotFound desc = could not find container \"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62\": container with ID starting with 281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62 not found: ID does not exist"
Sep 17 10:56:11.431742 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.431741    2570 scope.go:117] "RemoveContainer" containerID="080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f"
Sep 17 10:56:11.431947 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.431934    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f"} err="failed to get container status \"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f\": rpc error: code = NotFound desc = could not find container \"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f\": container with ID starting with 080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f not found: ID does not exist"
Sep 17 10:56:11.431947 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.431946    2570 scope.go:117] "RemoveContainer" containerID="c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683"
Sep 17 10:56:11.432133 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.432117    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683"} err="failed to get container status \"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683\": rpc error: code = NotFound desc = could not find container \"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683\": container with ID starting with c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683 not found: ID does not exist"
Sep 17 10:56:11.432133 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.432131    2570 scope.go:117] "RemoveContainer" containerID="1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b"
Sep 17 10:56:11.432312 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.432299    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b"} err="failed to get container status \"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b\": rpc error: code = NotFound desc = could not find container \"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b\": container with ID starting with 1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b not found: ID does not exist"
Sep 17 10:56:11.432312 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.432311    2570 scope.go:117] "RemoveContainer" containerID="1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d"
Sep 17 10:56:11.432602 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.432584    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d"} err="failed to get container status \"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d\": rpc error: code = NotFound desc = could not find container \"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d\": container with ID starting with 1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d not found: ID does not exist"
Sep 17 10:56:11.432655 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.432603    2570 scope.go:117] "RemoveContainer" containerID="f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b"
Sep 17 10:56:11.432823 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.432808    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b"} err="failed to get container status \"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b\": rpc error: code = NotFound desc = could not find container \"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b\": container with ID starting with f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b not found: ID does not exist"
Sep 17 10:56:11.432823 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.432823    2570 scope.go:117] "RemoveContainer" containerID="28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81"
Sep 17 10:56:11.433043 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.433025    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81"} err="failed to get container status \"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81\": rpc error: code = NotFound desc = could not find container \"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81\": container with ID starting with 28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81 not found: ID does not exist"
Sep 17 10:56:11.433083 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.433043    2570 scope.go:117] "RemoveContainer" containerID="281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62"
Sep 17 10:56:11.433235 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.433221    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62"} err="failed to get container status \"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62\": rpc error: code = NotFound desc = could not find container \"281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62\": container with ID starting with 281570c51cf7eb938fb47214bdfdc8e16705c83e2e150336430c6d280741ea62 not found: ID does not exist"
Sep 17 10:56:11.433281 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.433234    2570 scope.go:117] "RemoveContainer" containerID="080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f"
Sep 17 10:56:11.433446 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.433424    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f"} err="failed to get container status \"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f\": rpc error: code = NotFound desc = could not find container \"080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f\": container with ID starting with 080b1a390127b7b7a95d1ec91904701f38fee5c7537364a443a1ed0405d6146f not found: ID does not exist"
Sep 17 10:56:11.433497 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.433446    2570 scope.go:117] "RemoveContainer" containerID="c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683"
Sep 17 10:56:11.433656 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.433642    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683"} err="failed to get container status \"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683\": rpc error: code = NotFound desc = could not find container \"c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683\": container with ID starting with c24c840808551f90543a93639798fdc7854da1a6e7ac26634f85a014b8cfd683 not found: ID does not exist"
Sep 17 10:56:11.433656 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.433655    2570 scope.go:117] "RemoveContainer" containerID="1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b"
Sep 17 10:56:11.433840 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.433825    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b"} err="failed to get container status \"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b\": rpc error: code = NotFound desc = could not find container \"1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b\": container with ID starting with 1d0e4984627dc7e9121783c6e7d4514c82037d2733bf137f5f0c92cba2c4f12b not found: ID does not exist"
Sep 17 10:56:11.433881 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.433841    2570 scope.go:117] "RemoveContainer" containerID="1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d"
Sep 17 10:56:11.434032 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.434017    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d"} err="failed to get container status \"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d\": rpc error: code = NotFound desc = could not find container \"1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d\": container with ID starting with 1cd2cdcde1e21935d393b6028bef70ea4481ec974038677438ea7ff9add6227d not found: ID does not exist"
Sep 17 10:56:11.434032 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.434030    2570 scope.go:117] "RemoveContainer" containerID="f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b"
Sep 17 10:56:11.434202 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.434188    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b"} err="failed to get container status \"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b\": rpc error: code = NotFound desc = could not find container \"f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b\": container with ID starting with f4c7317742693733a96597152a14f3b8b33979379024125afef83db9c012cb0b not found: ID does not exist"
Sep 17 10:56:11.434202 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.434201    2570 scope.go:117] "RemoveContainer" containerID="28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81"
Sep 17 10:56:11.434400 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.434380    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81"} err="failed to get container status \"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81\": rpc error: code = NotFound desc = could not find container \"28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81\": container with ID starting with 28a76f5eb06b97a9df27980935597bcd6497c130a2b7466c040cbeb2e94eef81 not found: ID does not exist"
Sep 17 10:56:11.516287 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.516265    2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-config-out\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.516287 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.516287    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-db\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.516416 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.516296    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.516416 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.516306    2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-web-config\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.516416 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.516316    2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.516416 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.516325    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7zg9\" (UniqueName: \"kubernetes.io/projected/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-kube-api-access-p7zg9\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.516416 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.516333    2570 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-config\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.516416 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.516340    2570 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-kube-rbac-proxy\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.516416 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.516350    2570 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.516416 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.516359    2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-tls-assets\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.516416 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.516367    2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.516416 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.516377    2570 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.516416 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.516385    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.516416 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.516394    2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.516416 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.516402    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.516416 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.516409    2570 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-metrics-client-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.516416 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.516417    2570 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-secret-grpc-tls\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.516862 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.516426    2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.516862 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.516434    2570 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5-configmap-metrics-client-ca\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:56:11.703873 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.703845    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 10:56:11.707160 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.707138    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 10:56:11.758523 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.758476    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 10:56:11.758984 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.758965    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="config-reloader"
Sep 17 10:56:11.759048 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.758988    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="config-reloader"
Sep 17 10:56:11.759048 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.759002    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="kube-rbac-proxy"
Sep 17 10:56:11.759048 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.759011    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="kube-rbac-proxy"
Sep 17 10:56:11.759048 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.759031    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="init-config-reloader"
Sep 17 10:56:11.759048 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.759041    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="init-config-reloader"
Sep 17 10:56:11.759275 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.759062    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="thanos-sidecar"
Sep 17 10:56:11.759275 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.759071    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="thanos-sidecar"
Sep 17 10:56:11.759275 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.759084    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="prometheus"
Sep 17 10:56:11.759275 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.759092    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="prometheus"
Sep 17 10:56:11.759275 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.759120    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="kube-rbac-proxy-thanos"
Sep 17 10:56:11.759275 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.759128    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="kube-rbac-proxy-thanos"
Sep 17 10:56:11.759275 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.759146    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="kube-rbac-proxy-web"
Sep 17 10:56:11.759275 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.759155    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="kube-rbac-proxy-web"
Sep 17 10:56:11.759275 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.759256    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="config-reloader"
Sep 17 10:56:11.759275 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.759265    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="prometheus"
Sep 17 10:56:11.759275 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.759278    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="kube-rbac-proxy-web"
Sep 17 10:56:11.759740 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.759287    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="kube-rbac-proxy"
Sep 17 10:56:11.759740 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.759297    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="kube-rbac-proxy-thanos"
Sep 17 10:56:11.759740 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.759313    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" containerName="thanos-sidecar"
Sep 17 10:56:11.764088 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.764063    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.767341 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.767318    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 17 10:56:11.767453 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.767434    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 17 10:56:11.767564 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.767468    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 17 10:56:11.767564 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.767481    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 17 10:56:11.767564 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.767531    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 17 10:56:11.767564 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.767555    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 17 10:56:11.767564 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.767472    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tpwm7\""
Sep 17 10:56:11.767748 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.767650    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-km80r7onje1p\""
Sep 17 10:56:11.768089 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.767938    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 17 10:56:11.768089 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.767950    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 17 10:56:11.768089 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.767940    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 17 10:56:11.768089 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.767997    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 17 10:56:11.768089 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.768057    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 17 10:56:11.768358 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.768325    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 17 10:56:11.768428 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.768411    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 17 10:56:11.771997 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.771970    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 17 10:56:11.780547 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.780503    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 17 10:56:11.789244 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.789223    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 10:56:11.920577 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.920557    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.920690 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.920583    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.920690 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.920603    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.920690 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.920624    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.920794 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.920702    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.920794 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.920728    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.920794 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.920744    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/825da161-2a61-47f9-b825-a431b38cfa69-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.920794 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.920772    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dtgx\" (UniqueName: \"kubernetes.io/projected/825da161-2a61-47f9-b825-a431b38cfa69-kube-api-access-6dtgx\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.920794 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.920793    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.920977 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.920810    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.920977 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.920833    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.920977 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.920856    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/825da161-2a61-47f9-b825-a431b38cfa69-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.920977 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.920873    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.920977 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.920886    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.920977 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.920919    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/825da161-2a61-47f9-b825-a431b38cfa69-config-out\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.920977 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.920955    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-web-config\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.920977 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.920977    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-config\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.921200 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.920993    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.921200 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.921010    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:11.921200 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:11.921024    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.021764 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.021743    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.021853 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.021770    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.021853 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.021787    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.021853 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.021802    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/825da161-2a61-47f9-b825-a431b38cfa69-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.021853 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.021816    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dtgx\" (UniqueName: \"kubernetes.io/projected/825da161-2a61-47f9-b825-a431b38cfa69-kube-api-access-6dtgx\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.021853 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.021835    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.022082 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.021859    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.022082 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.021888    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.022082 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.021914    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/825da161-2a61-47f9-b825-a431b38cfa69-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.022082 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.021934    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.022082 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.021955    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.022082 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.021979    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/825da161-2a61-47f9-b825-a431b38cfa69-config-out\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.022082 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.022002    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-web-config\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.022082 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.022026    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-config\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.022082 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.022051    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.022082 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.022080    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.022582 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.022102    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.022582 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.022145    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.022582 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.022173    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.022582 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.022205    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.022582 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.022239    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/825da161-2a61-47f9-b825-a431b38cfa69-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.022582 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.022435    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.022876 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.022838    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.023475 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.023448    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.024132 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.024100    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.025423 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.024501    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.025423 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.024880    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/825da161-2a61-47f9-b825-a431b38cfa69-config-out\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.025423 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.024915    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.025423 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.025111    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.025423 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.025116    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/825da161-2a61-47f9-b825-a431b38cfa69-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.025423 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.025271    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.025423 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.025394    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.025906 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.025857    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.026372 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.026338    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.026580 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.026562    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-web-config\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.026949 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.026929    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-config\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.027343 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.027324    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.027692 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.027673    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/825da161-2a61-47f9-b825-a431b38cfa69-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.028454 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.028438    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/825da161-2a61-47f9-b825-a431b38cfa69-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.029986 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.029967    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dtgx\" (UniqueName: \"kubernetes.io/projected/825da161-2a61-47f9-b825-a431b38cfa69-kube-api-access-6dtgx\") pod \"prometheus-k8s-0\" (UID: \"825da161-2a61-47f9-b825-a431b38cfa69\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.074151 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.074129    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:56:12.358252 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.357998    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 10:56:12.360772 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:56:12.360725    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod825da161_2a61_47f9_b825_a431b38cfa69.slice/crio-bd7d77ec011907ff27258db1013980b09ea1a7475ba5e985e8782f3937869ac8 WatchSource:0}: Error finding container bd7d77ec011907ff27258db1013980b09ea1a7475ba5e985e8782f3937869ac8: Status 404 returned error can't find the container with id bd7d77ec011907ff27258db1013980b09ea1a7475ba5e985e8782f3937869ac8
Sep 17 10:56:12.382407 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.382376    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"825da161-2a61-47f9-b825-a431b38cfa69","Type":"ContainerStarted","Data":"bd7d77ec011907ff27258db1013980b09ea1a7475ba5e985e8782f3937869ac8"}
Sep 17 10:56:12.689458 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:12.689380    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5addfd6-7b18-4b7b-b1ca-5f883f8096a5" path="/var/lib/kubelet/pods/f5addfd6-7b18-4b7b-b1ca-5f883f8096a5/volumes"
Sep 17 10:56:13.388004 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:13.387971    2570 generic.go:356] "Generic (PLEG): container finished" podID="825da161-2a61-47f9-b825-a431b38cfa69" containerID="fa9052c10aabb42f3eacad0d7c87274ff7c3fc9fc0c246425e750248fb840cf6" exitCode=0
Sep 17 10:56:13.388449 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:13.388034    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"825da161-2a61-47f9-b825-a431b38cfa69","Type":"ContainerDied","Data":"fa9052c10aabb42f3eacad0d7c87274ff7c3fc9fc0c246425e750248fb840cf6"}
Sep 17 10:56:14.394559 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:14.394496    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"825da161-2a61-47f9-b825-a431b38cfa69","Type":"ContainerStarted","Data":"2e57fa8bc66de110de232ca8bbd93a862e65b7fdc5836497178c2a2e28bb1dbf"}
Sep 17 10:56:14.395056 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:14.394635    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"825da161-2a61-47f9-b825-a431b38cfa69","Type":"ContainerStarted","Data":"97cdce6de72e67b2f74b7a936f8b3730dc872c9d2d42df912fbe5a296e2e0d1f"}
Sep 17 10:56:14.395056 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:14.394679    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"825da161-2a61-47f9-b825-a431b38cfa69","Type":"ContainerStarted","Data":"962fb52e00338731d1e91601fabde9e1f3e1a25dfa91901fc2c00190099e9525"}
Sep 17 10:56:14.395056 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:14.394714    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"825da161-2a61-47f9-b825-a431b38cfa69","Type":"ContainerStarted","Data":"1afd53f32104e6c58317fe78f9d3a18ad4c87909238efd8093cceb3fbe83f6c1"}
Sep 17 10:56:14.395056 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:14.394750    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"825da161-2a61-47f9-b825-a431b38cfa69","Type":"ContainerStarted","Data":"c769803aedcf865db345ec46214be722aacb434a52547bdd30d9bfd68c4da7a6"}
Sep 17 10:56:14.395056 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:14.394790    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"825da161-2a61-47f9-b825-a431b38cfa69","Type":"ContainerStarted","Data":"25fab3a59bb91799cb17dbf74e0c688795c4d28899b274478a804a49c923234b"}
Sep 17 10:56:14.452057 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:14.452007    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.435268417 podStartE2EDuration="3.451991174s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.722757ms" isStatefulPod=false podCreationTimestamp="2026-09-17 10:56:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:56:14.450965288 +0000 UTC m=+164.246299751" watchObservedRunningTime="2026-09-17 10:56:14.451991174 +0000 UTC m=+164.247325642"
Sep 17 10:56:17.074893 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:56:17.074853    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:57:12.074659 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:12.074626    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:57:12.089520 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:12.089481    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:57:12.603292 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:12.603262    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 10:57:49.235482 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.235451    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"]
Sep 17 10:57:49.238564 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.238544    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"
Sep 17 10:57:49.245134 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.245115    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 17 10:57:49.245233 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.245134    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 17 10:57:49.245233 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.245157    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 17 10:57:49.251240 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.246650    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ff97h\""
Sep 17 10:57:49.251240 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.249366    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 17 10:57:49.272869 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.272841    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"]
Sep 17 10:57:49.377015 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.376992    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a-manifests\") pod \"opendatahub-operator-controller-manager-c54c4bd97-965xp\" (UID: \"fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a\") " pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"
Sep 17 10:57:49.377155 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.377024    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a-tmp\") pod \"opendatahub-operator-controller-manager-c54c4bd97-965xp\" (UID: \"fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a\") " pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"
Sep 17 10:57:49.377155 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.377075    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a-webhook-cert\") pod \"opendatahub-operator-controller-manager-c54c4bd97-965xp\" (UID: \"fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a\") " pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"
Sep 17 10:57:49.377155 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.377101    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c54c4bd97-965xp\" (UID: \"fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a\") " pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"
Sep 17 10:57:49.377155 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.377126    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44c4f\" (UniqueName: \"kubernetes.io/projected/fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a-kube-api-access-44c4f\") pod \"opendatahub-operator-controller-manager-c54c4bd97-965xp\" (UID: \"fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a\") " pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"
Sep 17 10:57:49.478296 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.478263    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a-webhook-cert\") pod \"opendatahub-operator-controller-manager-c54c4bd97-965xp\" (UID: \"fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a\") " pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"
Sep 17 10:57:49.478296 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.478299    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c54c4bd97-965xp\" (UID: \"fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a\") " pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"
Sep 17 10:57:49.478499 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.478319    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44c4f\" (UniqueName: \"kubernetes.io/projected/fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a-kube-api-access-44c4f\") pod \"opendatahub-operator-controller-manager-c54c4bd97-965xp\" (UID: \"fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a\") " pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"
Sep 17 10:57:49.478499 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.478359    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a-manifests\") pod \"opendatahub-operator-controller-manager-c54c4bd97-965xp\" (UID: \"fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a\") " pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"
Sep 17 10:57:49.478499 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.478389    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a-tmp\") pod \"opendatahub-operator-controller-manager-c54c4bd97-965xp\" (UID: \"fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a\") " pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"
Sep 17 10:57:49.478865 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.478844    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a-manifests\") pod \"opendatahub-operator-controller-manager-c54c4bd97-965xp\" (UID: \"fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a\") " pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"
Sep 17 10:57:49.480808 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.480786    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a-tmp\") pod \"opendatahub-operator-controller-manager-c54c4bd97-965xp\" (UID: \"fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a\") " pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"
Sep 17 10:57:49.480921 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.480878    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a-webhook-cert\") pod \"opendatahub-operator-controller-manager-c54c4bd97-965xp\" (UID: \"fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a\") " pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"
Sep 17 10:57:49.481036 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.481018    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c54c4bd97-965xp\" (UID: \"fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a\") " pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"
Sep 17 10:57:49.492996 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.492938    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44c4f\" (UniqueName: \"kubernetes.io/projected/fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a-kube-api-access-44c4f\") pod \"opendatahub-operator-controller-manager-c54c4bd97-965xp\" (UID: \"fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a\") " pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"
Sep 17 10:57:49.548075 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.548045    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"
Sep 17 10:57:49.845046 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:49.845018    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"]
Sep 17 10:57:49.848346 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:57:49.848321    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfecfaf3e_043f_4a99_9793_cbfd9cbe6a4a.slice/crio-d0a59b53526f9081a6b0f56cb32779f83de2a800359f00da5787e37d47a43fb2 WatchSource:0}: Error finding container d0a59b53526f9081a6b0f56cb32779f83de2a800359f00da5787e37d47a43fb2: Status 404 returned error can't find the container with id d0a59b53526f9081a6b0f56cb32779f83de2a800359f00da5787e37d47a43fb2
Sep 17 10:57:50.717157 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:50.717118    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp" event={"ID":"fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a","Type":"ContainerStarted","Data":"d0a59b53526f9081a6b0f56cb32779f83de2a800359f00da5787e37d47a43fb2"}
Sep 17 10:57:53.730391 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:53.730315    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp" event={"ID":"fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a","Type":"ContainerStarted","Data":"c44441619b8a118c1432f3947e086f7185b7278a8d10872e42fe30161018c768"}
Sep 17 10:57:54.734817 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:54.734785    2570 generic.go:356] "Generic (PLEG): container finished" podID="fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a" containerID="c44441619b8a118c1432f3947e086f7185b7278a8d10872e42fe30161018c768" exitCode=0
Sep 17 10:57:54.735189 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:54.734858    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp" event={"ID":"fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a","Type":"ContainerDied","Data":"c44441619b8a118c1432f3947e086f7185b7278a8d10872e42fe30161018c768"}
Sep 17 10:57:55.740010 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:55.739977    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp" event={"ID":"fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a","Type":"ContainerStarted","Data":"d54395238f151ec09300858300a2cca89c371ad1e26bc75503cbd1dfb82567c4"}
Sep 17 10:57:55.740386 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:57:55.740104    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"
Sep 17 10:58:06.745618 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:06.745585    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp"
Sep 17 10:58:06.776205 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:06.776139    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c54c4bd97-965xp" podStartSLOduration=13.386854692 podStartE2EDuration="17.776113869s" totalImagesPullingTime="3.334795288s" totalInitContainerRuntime="1.054463889s" isStatefulPod=false podCreationTimestamp="2026-09-17 10:57:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:57:55.77204203 +0000 UTC m=+265.567376469" watchObservedRunningTime="2026-09-17 10:58:06.776113869 +0000 UTC m=+276.571448310"
Sep 17 10:58:12.225487 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:12.225449    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8665f874d8-5fz7h"]
Sep 17 10:58:12.235272 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:12.235249    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8665f874d8-5fz7h"
Sep 17 10:58:12.239033 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:12.239011    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 17 10:58:12.239033 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:12.239028    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 17 10:58:12.239033 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:12.239009    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 17 10:58:12.239270 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:12.239011    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 17 10:58:12.251662 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:12.251641    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8665f874d8-5fz7h"]
Sep 17 10:58:12.334440 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:12.334418    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg92t\" (UniqueName: \"kubernetes.io/projected/6e8ff76e-8565-420d-b9fd-d3a0decfc8a9-kube-api-access-pg92t\") pod \"kube-auth-proxy-8665f874d8-5fz7h\" (UID: \"6e8ff76e-8565-420d-b9fd-d3a0decfc8a9\") " pod="openshift-ingress/kube-auth-proxy-8665f874d8-5fz7h"
Sep 17 10:58:12.334575 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:12.334449    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e8ff76e-8565-420d-b9fd-d3a0decfc8a9-tls-certs\") pod \"kube-auth-proxy-8665f874d8-5fz7h\" (UID: \"6e8ff76e-8565-420d-b9fd-d3a0decfc8a9\") " pod="openshift-ingress/kube-auth-proxy-8665f874d8-5fz7h"
Sep 17 10:58:12.334575 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:12.334482    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e8ff76e-8565-420d-b9fd-d3a0decfc8a9-tmp\") pod \"kube-auth-proxy-8665f874d8-5fz7h\" (UID: \"6e8ff76e-8565-420d-b9fd-d3a0decfc8a9\") " pod="openshift-ingress/kube-auth-proxy-8665f874d8-5fz7h"
Sep 17 10:58:12.435673 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:12.435649    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg92t\" (UniqueName: \"kubernetes.io/projected/6e8ff76e-8565-420d-b9fd-d3a0decfc8a9-kube-api-access-pg92t\") pod \"kube-auth-proxy-8665f874d8-5fz7h\" (UID: \"6e8ff76e-8565-420d-b9fd-d3a0decfc8a9\") " pod="openshift-ingress/kube-auth-proxy-8665f874d8-5fz7h"
Sep 17 10:58:12.435768 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:12.435678    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e8ff76e-8565-420d-b9fd-d3a0decfc8a9-tls-certs\") pod \"kube-auth-proxy-8665f874d8-5fz7h\" (UID: \"6e8ff76e-8565-420d-b9fd-d3a0decfc8a9\") " pod="openshift-ingress/kube-auth-proxy-8665f874d8-5fz7h"
Sep 17 10:58:12.435768 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:12.435707    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e8ff76e-8565-420d-b9fd-d3a0decfc8a9-tmp\") pod \"kube-auth-proxy-8665f874d8-5fz7h\" (UID: \"6e8ff76e-8565-420d-b9fd-d3a0decfc8a9\") " pod="openshift-ingress/kube-auth-proxy-8665f874d8-5fz7h"
Sep 17 10:58:12.435833 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:58:12.435805    2570 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 17 10:58:12.435880 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:58:12.435869    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e8ff76e-8565-420d-b9fd-d3a0decfc8a9-tls-certs podName:6e8ff76e-8565-420d-b9fd-d3a0decfc8a9 nodeName:}" failed. No retries permitted until 2026-09-17 10:58:12.935849439 +0000 UTC m=+282.731183861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6e8ff76e-8565-420d-b9fd-d3a0decfc8a9-tls-certs") pod "kube-auth-proxy-8665f874d8-5fz7h" (UID: "6e8ff76e-8565-420d-b9fd-d3a0decfc8a9") : secret "kube-auth-proxy-tls" not found
Sep 17 10:58:12.437793 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:12.437777    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e8ff76e-8565-420d-b9fd-d3a0decfc8a9-tmp\") pod \"kube-auth-proxy-8665f874d8-5fz7h\" (UID: \"6e8ff76e-8565-420d-b9fd-d3a0decfc8a9\") " pod="openshift-ingress/kube-auth-proxy-8665f874d8-5fz7h"
Sep 17 10:58:12.445565 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:12.445544    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg92t\" (UniqueName: \"kubernetes.io/projected/6e8ff76e-8565-420d-b9fd-d3a0decfc8a9-kube-api-access-pg92t\") pod \"kube-auth-proxy-8665f874d8-5fz7h\" (UID: \"6e8ff76e-8565-420d-b9fd-d3a0decfc8a9\") " pod="openshift-ingress/kube-auth-proxy-8665f874d8-5fz7h"
Sep 17 10:58:12.939756 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:12.939727    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e8ff76e-8565-420d-b9fd-d3a0decfc8a9-tls-certs\") pod \"kube-auth-proxy-8665f874d8-5fz7h\" (UID: \"6e8ff76e-8565-420d-b9fd-d3a0decfc8a9\") " pod="openshift-ingress/kube-auth-proxy-8665f874d8-5fz7h"
Sep 17 10:58:12.942045 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:12.942015    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e8ff76e-8565-420d-b9fd-d3a0decfc8a9-tls-certs\") pod \"kube-auth-proxy-8665f874d8-5fz7h\" (UID: \"6e8ff76e-8565-420d-b9fd-d3a0decfc8a9\") " pod="openshift-ingress/kube-auth-proxy-8665f874d8-5fz7h"
Sep 17 10:58:13.144598 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.144573    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8665f874d8-5fz7h"
Sep 17 10:58:13.419712 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.419697    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8665f874d8-5fz7h"]
Sep 17 10:58:13.421748 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:58:13.421721    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e8ff76e_8565_420d_b9fd_d3a0decfc8a9.slice/crio-8efd6a3c4bbc491018980e553b70fe24b725d22cb48ee3b68a2af9f1ea1f33af WatchSource:0}: Error finding container 8efd6a3c4bbc491018980e553b70fe24b725d22cb48ee3b68a2af9f1ea1f33af: Status 404 returned error can't find the container with id 8efd6a3c4bbc491018980e553b70fe24b725d22cb48ee3b68a2af9f1ea1f33af
Sep 17 10:58:13.778711 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.778675    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"]
Sep 17 10:58:13.781627 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.781610    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.784389 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.784371    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 17 10:58:13.785245 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.785227    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 17 10:58:13.785595 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.785582    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 17 10:58:13.786325 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.786306    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 17 10:58:13.786548 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.786535    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4wmdh\""
Sep 17 10:58:13.798754 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.798731    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"]
Sep 17 10:58:13.806600 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.806573    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8665f874d8-5fz7h" event={"ID":"6e8ff76e-8565-420d-b9fd-d3a0decfc8a9","Type":"ContainerStarted","Data":"8efd6a3c4bbc491018980e553b70fe24b725d22cb48ee3b68a2af9f1ea1f33af"}
Sep 17 10:58:13.845990 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.845964    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6fl7\" (UniqueName: \"kubernetes.io/projected/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-kube-api-access-s6fl7\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.846080 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.845997    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.846080 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.846015    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.846080 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.846039    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.846195 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.846106    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.846195 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.846167    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.846195 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.846185    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.946879 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.946849    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.946965 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.946884    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.946965 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.946907    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.946965 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.946928    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.947111 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.946968    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.947111 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.946991    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.947111 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.947033    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6fl7\" (UniqueName: \"kubernetes.io/projected/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-kube-api-access-s6fl7\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.947693 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.947669    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.949139 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.949118    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.949282 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.949261    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.949653 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.949635    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.949740 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.949675    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.956454 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.956433    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:13.956693 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:13.956676    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6fl7\" (UniqueName: \"kubernetes.io/projected/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-kube-api-access-s6fl7\") pod \"istiod-openshift-gateway-7b7995d5cd-fx69x\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:14.091411 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:14.091362    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:14.375653 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:14.375487    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"]
Sep 17 10:58:14.377919 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:58:14.377892    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeef4a4d2_595c_43e0_87d6_51ab8f7120aa.slice/crio-b3c7d47facfb126904b7f46d2a74b98f66f2a74a44b9824b16f28d5f09107c96 WatchSource:0}: Error finding container b3c7d47facfb126904b7f46d2a74b98f66f2a74a44b9824b16f28d5f09107c96: Status 404 returned error can't find the container with id b3c7d47facfb126904b7f46d2a74b98f66f2a74a44b9824b16f28d5f09107c96
Sep 17 10:58:14.813505 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:14.813468    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x" event={"ID":"eef4a4d2-595c-43e0-87d6-51ab8f7120aa","Type":"ContainerStarted","Data":"b3c7d47facfb126904b7f46d2a74b98f66f2a74a44b9824b16f28d5f09107c96"}
Sep 17 10:58:17.699467 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:17.699435    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 10:58:17.699721 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:17.699530    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 10:58:17.827575 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:17.827542    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8665f874d8-5fz7h" event={"ID":"6e8ff76e-8565-420d-b9fd-d3a0decfc8a9","Type":"ContainerStarted","Data":"fa05edc1c990992c2e33ff1611b9b08cc91b804bc390b2efcc57e8a489e5b04f"}
Sep 17 10:58:17.829124 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:17.829100    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x" event={"ID":"eef4a4d2-595c-43e0-87d6-51ab8f7120aa","Type":"ContainerStarted","Data":"4c293e5846dbaffc168cf9d9c29c3dbc517ad7af8a680b370ca01f1ea9ef18fa"}
Sep 17 10:58:17.829238 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:17.829215    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:17.853207 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:17.853162    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8665f874d8-5fz7h" podStartSLOduration=1.582839287 podStartE2EDuration="5.853147174s" totalImagesPullingTime="4.270307887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 10:58:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:58:17.851019021 +0000 UTC m=+287.646353459" watchObservedRunningTime="2026-09-17 10:58:17.853147174 +0000 UTC m=+287.648481640"
Sep 17 10:58:17.875769 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:17.875723    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x" podStartSLOduration=1.556374046 podStartE2EDuration="4.875706997s" totalImagesPullingTime="3.319332951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 10:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:58:17.874544409 +0000 UTC m=+287.669878846" watchObservedRunningTime="2026-09-17 10:58:17.875706997 +0000 UTC m=+287.671041436"
Sep 17 10:58:18.834765 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:18.834736    2570 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-fx69x container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 10:58:18.835103 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:18.834784    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x" podUID="eef4a4d2-595c-43e0-87d6-51ab8f7120aa" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 10:58:21.834660 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:21.834631    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:30.596718 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:30.596688    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 10:58:30.597889 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:30.597866    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 10:58:30.608716 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:30.608696    2570 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 10:58:31.014601 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.014570    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bdtc5"]
Sep 17 10:58:31.016634 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.016619    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bdtc5"
Sep 17 10:58:31.023340 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.023214    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 17 10:58:31.023340 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.023279    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4ddxc"]
Sep 17 10:58:31.023471 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.023453    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gsstq\""
Sep 17 10:58:31.025258 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.025242    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4ddxc"
Sep 17 10:58:31.032931 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.032909    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 17 10:58:31.033250 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.033233    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xqb9f\""
Sep 17 10:58:31.057240 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.057216    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bdtc5"]
Sep 17 10:58:31.067946 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.067920    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4ddxc"]
Sep 17 10:58:31.174129 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.174100    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nct2v\" (UniqueName: \"kubernetes.io/projected/12c5f420-1616-4886-8e0b-9696a1b9b190-kube-api-access-nct2v\") pod \"kserve-controller-manager-d6f4b65b8-bdtc5\" (UID: \"12c5f420-1616-4886-8e0b-9696a1b9b190\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bdtc5"
Sep 17 10:58:31.174264 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.174165    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12c5f420-1616-4886-8e0b-9696a1b9b190-cert\") pod \"kserve-controller-manager-d6f4b65b8-bdtc5\" (UID: \"12c5f420-1616-4886-8e0b-9696a1b9b190\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bdtc5"
Sep 17 10:58:31.174264 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.174220    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed831471-85be-4249-9097-2799dbd87b2c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4ddxc\" (UID: \"ed831471-85be-4249-9097-2799dbd87b2c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4ddxc"
Sep 17 10:58:31.174264 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.174253    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsvlf\" (UniqueName: \"kubernetes.io/projected/ed831471-85be-4249-9097-2799dbd87b2c-kube-api-access-qsvlf\") pod \"llmisvc-controller-manager-777c6bd7d5-4ddxc\" (UID: \"ed831471-85be-4249-9097-2799dbd87b2c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4ddxc"
Sep 17 10:58:31.275365 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.275298    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsvlf\" (UniqueName: \"kubernetes.io/projected/ed831471-85be-4249-9097-2799dbd87b2c-kube-api-access-qsvlf\") pod \"llmisvc-controller-manager-777c6bd7d5-4ddxc\" (UID: \"ed831471-85be-4249-9097-2799dbd87b2c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4ddxc"
Sep 17 10:58:31.275365 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.275340    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nct2v\" (UniqueName: \"kubernetes.io/projected/12c5f420-1616-4886-8e0b-9696a1b9b190-kube-api-access-nct2v\") pod \"kserve-controller-manager-d6f4b65b8-bdtc5\" (UID: \"12c5f420-1616-4886-8e0b-9696a1b9b190\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bdtc5"
Sep 17 10:58:31.275564 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.275412    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12c5f420-1616-4886-8e0b-9696a1b9b190-cert\") pod \"kserve-controller-manager-d6f4b65b8-bdtc5\" (UID: \"12c5f420-1616-4886-8e0b-9696a1b9b190\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bdtc5"
Sep 17 10:58:31.275564 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.275438    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed831471-85be-4249-9097-2799dbd87b2c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4ddxc\" (UID: \"ed831471-85be-4249-9097-2799dbd87b2c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4ddxc"
Sep 17 10:58:31.275707 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:58:31.275596    2570 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 17 10:58:31.275707 ip-10-0-138-123 kubenswrapper[2570]: E0917 10:58:31.275665    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed831471-85be-4249-9097-2799dbd87b2c-cert podName:ed831471-85be-4249-9097-2799dbd87b2c nodeName:}" failed. No retries permitted until 2026-09-17 10:58:31.775644789 +0000 UTC m=+301.570979220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ed831471-85be-4249-9097-2799dbd87b2c-cert") pod "llmisvc-controller-manager-777c6bd7d5-4ddxc" (UID: "ed831471-85be-4249-9097-2799dbd87b2c") : secret "llmisvc-webhook-server-cert" not found
Sep 17 10:58:31.277760 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.277740    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/12c5f420-1616-4886-8e0b-9696a1b9b190-cert\") pod \"kserve-controller-manager-d6f4b65b8-bdtc5\" (UID: \"12c5f420-1616-4886-8e0b-9696a1b9b190\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bdtc5"
Sep 17 10:58:31.294861 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.294841    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsvlf\" (UniqueName: \"kubernetes.io/projected/ed831471-85be-4249-9097-2799dbd87b2c-kube-api-access-qsvlf\") pod \"llmisvc-controller-manager-777c6bd7d5-4ddxc\" (UID: \"ed831471-85be-4249-9097-2799dbd87b2c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4ddxc"
Sep 17 10:58:31.296260 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.296238    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nct2v\" (UniqueName: \"kubernetes.io/projected/12c5f420-1616-4886-8e0b-9696a1b9b190-kube-api-access-nct2v\") pod \"kserve-controller-manager-d6f4b65b8-bdtc5\" (UID: \"12c5f420-1616-4886-8e0b-9696a1b9b190\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bdtc5"
Sep 17 10:58:31.327214 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.327196    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bdtc5"
Sep 17 10:58:31.627629 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.627551    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bdtc5"]
Sep 17 10:58:31.630275 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:58:31.630248    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c5f420_1616_4886_8e0b_9696a1b9b190.slice/crio-479d5460563d1c3edc1965af89fb74433a836be7fb784374701935cb00762daf WatchSource:0}: Error finding container 479d5460563d1c3edc1965af89fb74433a836be7fb784374701935cb00762daf: Status 404 returned error can't find the container with id 479d5460563d1c3edc1965af89fb74433a836be7fb784374701935cb00762daf
Sep 17 10:58:31.680992 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.680965    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"]
Sep 17 10:58:31.681175 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.681137    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x" podUID="eef4a4d2-595c-43e0-87d6-51ab8f7120aa" containerName="discovery" containerID="cri-o://4c293e5846dbaffc168cf9d9c29c3dbc517ad7af8a680b370ca01f1ea9ef18fa" gracePeriod=30
Sep 17 10:58:31.780495 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.780456    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed831471-85be-4249-9097-2799dbd87b2c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4ddxc\" (UID: \"ed831471-85be-4249-9097-2799dbd87b2c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4ddxc"
Sep 17 10:58:31.782749 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.782731    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ed831471-85be-4249-9097-2799dbd87b2c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-4ddxc\" (UID: \"ed831471-85be-4249-9097-2799dbd87b2c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4ddxc"
Sep 17 10:58:31.881194 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.881111    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bdtc5" event={"ID":"12c5f420-1616-4886-8e0b-9696a1b9b190","Type":"ContainerStarted","Data":"479d5460563d1c3edc1965af89fb74433a836be7fb784374701935cb00762daf"}
Sep 17 10:58:31.882673 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.882646    2570 generic.go:356] "Generic (PLEG): container finished" podID="eef4a4d2-595c-43e0-87d6-51ab8f7120aa" containerID="4c293e5846dbaffc168cf9d9c29c3dbc517ad7af8a680b370ca01f1ea9ef18fa" exitCode=0
Sep 17 10:58:31.882791 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.882714    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x" event={"ID":"eef4a4d2-595c-43e0-87d6-51ab8f7120aa","Type":"ContainerDied","Data":"4c293e5846dbaffc168cf9d9c29c3dbc517ad7af8a680b370ca01f1ea9ef18fa"}
Sep 17 10:58:31.898122 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.898101    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:31.934048 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.934022    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4ddxc"
Sep 17 10:58:31.981836 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.981355    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-csr-dns-cert\") pod \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") "
Sep 17 10:58:31.981836 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.981402    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-kubeconfig\") pod \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") "
Sep 17 10:58:31.981836 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.981430    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-cacerts\") pod \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") "
Sep 17 10:58:31.981836 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.981474    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-csr-ca-configmap\") pod \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") "
Sep 17 10:58:31.981836 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.981803    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-local-certs\") pod \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") "
Sep 17 10:58:31.981836 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.981841    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-token\") pod \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") "
Sep 17 10:58:31.982272 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.981877    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6fl7\" (UniqueName: \"kubernetes.io/projected/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-kube-api-access-s6fl7\") pod \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\" (UID: \"eef4a4d2-595c-43e0-87d6-51ab8f7120aa\") "
Sep 17 10:58:31.982679 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.982467    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "eef4a4d2-595c-43e0-87d6-51ab8f7120aa" (UID: "eef4a4d2-595c-43e0-87d6-51ab8f7120aa"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 10:58:31.984636 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.984494    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "eef4a4d2-595c-43e0-87d6-51ab8f7120aa" (UID: "eef4a4d2-595c-43e0-87d6-51ab8f7120aa"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 10:58:31.984951 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.984922    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-token" (OuterVolumeSpecName: "istio-token") pod "eef4a4d2-595c-43e0-87d6-51ab8f7120aa" (UID: "eef4a4d2-595c-43e0-87d6-51ab8f7120aa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 10:58:31.985028 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.984961    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-kube-api-access-s6fl7" (OuterVolumeSpecName: "kube-api-access-s6fl7") pod "eef4a4d2-595c-43e0-87d6-51ab8f7120aa" (UID: "eef4a4d2-595c-43e0-87d6-51ab8f7120aa"). InnerVolumeSpecName "kube-api-access-s6fl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 10:58:31.985274 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.985248    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-local-certs" (OuterVolumeSpecName: "local-certs") pod "eef4a4d2-595c-43e0-87d6-51ab8f7120aa" (UID: "eef4a4d2-595c-43e0-87d6-51ab8f7120aa"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 10:58:31.986231 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.985888    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "eef4a4d2-595c-43e0-87d6-51ab8f7120aa" (UID: "eef4a4d2-595c-43e0-87d6-51ab8f7120aa"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 10:58:31.986231 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:31.986185    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-cacerts" (OuterVolumeSpecName: "cacerts") pod "eef4a4d2-595c-43e0-87d6-51ab8f7120aa" (UID: "eef4a4d2-595c-43e0-87d6-51ab8f7120aa"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 10:58:32.082995 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:32.082972    2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-csr-dns-cert\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:58:32.082995 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:32.082995    2570 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-kubeconfig\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:58:32.083156 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:32.083004    2570 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-cacerts\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:58:32.083156 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:32.083015    2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-csr-ca-configmap\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:58:32.083156 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:32.083023    2570 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-local-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:58:32.083156 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:32.083032    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-istio-token\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:58:32.083156 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:32.083039    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6fl7\" (UniqueName: \"kubernetes.io/projected/eef4a4d2-595c-43e0-87d6-51ab8f7120aa-kube-api-access-s6fl7\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 10:58:32.207787 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:32.207764    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-4ddxc"]
Sep 17 10:58:32.209748 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:58:32.209722    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poded831471_85be_4249_9097_2799dbd87b2c.slice/crio-b85c98e464020bb48bd8a4430a5e3b4a86590c33dd6d631047336b3e113e308a WatchSource:0}: Error finding container b85c98e464020bb48bd8a4430a5e3b4a86590c33dd6d631047336b3e113e308a: Status 404 returned error can't find the container with id b85c98e464020bb48bd8a4430a5e3b4a86590c33dd6d631047336b3e113e308a
Sep 17 10:58:32.210998 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:32.210980    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 10:58:32.889475 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:32.889401    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4ddxc" event={"ID":"ed831471-85be-4249-9097-2799dbd87b2c","Type":"ContainerStarted","Data":"b85c98e464020bb48bd8a4430a5e3b4a86590c33dd6d631047336b3e113e308a"}
Sep 17 10:58:32.891050 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:32.891021    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x" event={"ID":"eef4a4d2-595c-43e0-87d6-51ab8f7120aa","Type":"ContainerDied","Data":"b3c7d47facfb126904b7f46d2a74b98f66f2a74a44b9824b16f28d5f09107c96"}
Sep 17 10:58:32.891187 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:32.891081    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"
Sep 17 10:58:32.891187 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:32.891088    2570 scope.go:117] "RemoveContainer" containerID="4c293e5846dbaffc168cf9d9c29c3dbc517ad7af8a680b370ca01f1ea9ef18fa"
Sep 17 10:58:32.918128 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:32.918103    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"]
Sep 17 10:58:32.927426 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:32.927404    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fx69x"]
Sep 17 10:58:34.690823 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:34.690783    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eef4a4d2-595c-43e0-87d6-51ab8f7120aa" path="/var/lib/kubelet/pods/eef4a4d2-595c-43e0-87d6-51ab8f7120aa/volumes"
Sep 17 10:58:34.902084 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:34.902058    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bdtc5" event={"ID":"12c5f420-1616-4886-8e0b-9696a1b9b190","Type":"ContainerStarted","Data":"216a27dcc1eb7a13abd574a7146dac413396c8bd28800a2fccb60a5808579c37"}
Sep 17 10:58:34.902182 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:34.902118    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bdtc5"
Sep 17 10:58:34.903535 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:34.903500    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4ddxc" event={"ID":"ed831471-85be-4249-9097-2799dbd87b2c","Type":"ContainerStarted","Data":"13d17da818e42fba6d70f7468b77141a3db7c9625ce4b15bfa7c469d93065389"}
Sep 17 10:58:34.903639 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:34.903630    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4ddxc"
Sep 17 10:58:34.997683 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:34.997603    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bdtc5" podStartSLOduration=2.525651226 podStartE2EDuration="4.9975879s" totalImagesPullingTime="2.471936674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 10:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:58:34.943974778 +0000 UTC m=+304.739309217" watchObservedRunningTime="2026-09-17 10:58:34.9975879 +0000 UTC m=+304.792922340"
Sep 17 10:58:34.998602 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:58:34.998572    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4ddxc" podStartSLOduration=2.376746385 podStartE2EDuration="4.998563288s" totalImagesPullingTime="2.621816903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 10:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:58:34.997722425 +0000 UTC m=+304.793056894" watchObservedRunningTime="2026-09-17 10:58:34.998563288 +0000 UTC m=+304.793897726"
Sep 17 10:59:05.909426 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:05.909393    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-4ddxc"
Sep 17 10:59:05.912612 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:05.912590    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bdtc5"
Sep 17 10:59:41.379095 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:41.379062    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-q2cwm"]
Sep 17 10:59:41.379537 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:41.379325    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eef4a4d2-595c-43e0-87d6-51ab8f7120aa" containerName="discovery"
Sep 17 10:59:41.379537 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:41.379335    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="eef4a4d2-595c-43e0-87d6-51ab8f7120aa" containerName="discovery"
Sep 17 10:59:41.379537 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:41.379380    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="eef4a4d2-595c-43e0-87d6-51ab8f7120aa" containerName="discovery"
Sep 17 10:59:41.383347 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:41.383331    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-q2cwm"
Sep 17 10:59:41.386315 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:41.386287    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 17 10:59:41.386315 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:41.386304    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 17 10:59:41.387365 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:41.387348    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-qf9hx\""
Sep 17 10:59:41.398163 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:41.398142    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-q2cwm"]
Sep 17 10:59:41.445246 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:41.445221    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsvnp\" (UniqueName: \"kubernetes.io/projected/9e5a482b-a9df-40ae-9882-9fe42103ccb4-kube-api-access-zsvnp\") pod \"authorino-operator-76b478bd78-q2cwm\" (UID: \"9e5a482b-a9df-40ae-9882-9fe42103ccb4\") " pod="kuadrant-system/authorino-operator-76b478bd78-q2cwm"
Sep 17 10:59:41.545567 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:41.545525    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsvnp\" (UniqueName: \"kubernetes.io/projected/9e5a482b-a9df-40ae-9882-9fe42103ccb4-kube-api-access-zsvnp\") pod \"authorino-operator-76b478bd78-q2cwm\" (UID: \"9e5a482b-a9df-40ae-9882-9fe42103ccb4\") " pod="kuadrant-system/authorino-operator-76b478bd78-q2cwm"
Sep 17 10:59:41.556734 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:41.556701    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsvnp\" (UniqueName: \"kubernetes.io/projected/9e5a482b-a9df-40ae-9882-9fe42103ccb4-kube-api-access-zsvnp\") pod \"authorino-operator-76b478bd78-q2cwm\" (UID: \"9e5a482b-a9df-40ae-9882-9fe42103ccb4\") " pod="kuadrant-system/authorino-operator-76b478bd78-q2cwm"
Sep 17 10:59:41.693491 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:41.693415    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-q2cwm"
Sep 17 10:59:41.972473 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:41.972401    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-q2cwm"]
Sep 17 10:59:41.975408 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:59:41.975379    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e5a482b_a9df_40ae_9882_9fe42103ccb4.slice/crio-38d6c3501aa32edccb9a84e44af463ce0ba92b30b8f8fee37a5b401b2f4f1847 WatchSource:0}: Error finding container 38d6c3501aa32edccb9a84e44af463ce0ba92b30b8f8fee37a5b401b2f4f1847: Status 404 returned error can't find the container with id 38d6c3501aa32edccb9a84e44af463ce0ba92b30b8f8fee37a5b401b2f4f1847
Sep 17 10:59:42.143993 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:42.143958    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-q2cwm" event={"ID":"9e5a482b-a9df-40ae-9882-9fe42103ccb4","Type":"ContainerStarted","Data":"38d6c3501aa32edccb9a84e44af463ce0ba92b30b8f8fee37a5b401b2f4f1847"}
Sep 17 10:59:45.159057 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:45.159018    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-q2cwm" event={"ID":"9e5a482b-a9df-40ae-9882-9fe42103ccb4","Type":"ContainerStarted","Data":"d2b60591576317b1c117cea9a9528a25cf013987c95079f8e2bec7af9a814482"}
Sep 17 10:59:45.159422 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:45.159148    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-q2cwm"
Sep 17 10:59:46.005351 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:46.005300    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-q2cwm" podStartSLOduration=2.606430383 podStartE2EDuration="5.005285544s" totalImagesPullingTime="2.398855161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 10:59:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:59:45.206766755 +0000 UTC m=+375.002101194" watchObservedRunningTime="2026-09-17 10:59:46.005285544 +0000 UTC m=+375.800619983"
Sep 17 10:59:46.005690 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:46.005663    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"]
Sep 17 10:59:46.008853 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:46.008837    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 10:59:46.013712 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:46.013692    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m8gtb\""
Sep 17 10:59:46.025058 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:46.025040    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"]
Sep 17 10:59:46.084493 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:46.084471    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4vf6\" (UniqueName: \"kubernetes.io/projected/ab6578ae-48c4-460a-aeca-135ac02dd4ae-kube-api-access-r4vf6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zftzs\" (UID: \"ab6578ae-48c4-460a-aeca-135ac02dd4ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 10:59:46.084625 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:46.084529    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab6578ae-48c4-460a-aeca-135ac02dd4ae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zftzs\" (UID: \"ab6578ae-48c4-460a-aeca-135ac02dd4ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 10:59:46.185497 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:46.185477    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4vf6\" (UniqueName: \"kubernetes.io/projected/ab6578ae-48c4-460a-aeca-135ac02dd4ae-kube-api-access-r4vf6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zftzs\" (UID: \"ab6578ae-48c4-460a-aeca-135ac02dd4ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 10:59:46.185810 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:46.185533    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab6578ae-48c4-460a-aeca-135ac02dd4ae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zftzs\" (UID: \"ab6578ae-48c4-460a-aeca-135ac02dd4ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 10:59:46.185927 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:46.185911    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab6578ae-48c4-460a-aeca-135ac02dd4ae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zftzs\" (UID: \"ab6578ae-48c4-460a-aeca-135ac02dd4ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 10:59:46.195442 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:46.195418    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4vf6\" (UniqueName: \"kubernetes.io/projected/ab6578ae-48c4-460a-aeca-135ac02dd4ae-kube-api-access-r4vf6\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zftzs\" (UID: \"ab6578ae-48c4-460a-aeca-135ac02dd4ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 10:59:46.318470 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:46.318450    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 10:59:46.601831 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:46.601802    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"]
Sep 17 10:59:46.604157 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:59:46.604135    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6578ae_48c4_460a_aeca_135ac02dd4ae.slice/crio-4a292cc049c36b0f11d695762ed61c140cae3926d460fff2307d939170e666c5 WatchSource:0}: Error finding container 4a292cc049c36b0f11d695762ed61c140cae3926d460fff2307d939170e666c5: Status 404 returned error can't find the container with id 4a292cc049c36b0f11d695762ed61c140cae3926d460fff2307d939170e666c5
Sep 17 10:59:47.168155 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:47.168123    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs" event={"ID":"ab6578ae-48c4-460a-aeca-135ac02dd4ae","Type":"ContainerStarted","Data":"4a292cc049c36b0f11d695762ed61c140cae3926d460fff2307d939170e666c5"}
Sep 17 10:59:48.053294 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:48.053261    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vzxwb"]
Sep 17 10:59:48.057319 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:48.057281    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vzxwb"
Sep 17 10:59:48.062550 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:48.062501    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-4hd54\""
Sep 17 10:59:48.062651 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:48.062616    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 17 10:59:48.072705 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:48.072678    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vzxwb"]
Sep 17 10:59:48.098478 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:48.098452    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvzqn\" (UniqueName: \"kubernetes.io/projected/fc2c2655-44e9-4da2-bbf2-4596ad57a678-kube-api-access-kvzqn\") pod \"dns-operator-controller-manager-7b84cd7c9c-vzxwb\" (UID: \"fc2c2655-44e9-4da2-bbf2-4596ad57a678\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vzxwb"
Sep 17 10:59:48.199252 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:48.199218    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvzqn\" (UniqueName: \"kubernetes.io/projected/fc2c2655-44e9-4da2-bbf2-4596ad57a678-kube-api-access-kvzqn\") pod \"dns-operator-controller-manager-7b84cd7c9c-vzxwb\" (UID: \"fc2c2655-44e9-4da2-bbf2-4596ad57a678\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vzxwb"
Sep 17 10:59:48.213338 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:48.213303    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvzqn\" (UniqueName: \"kubernetes.io/projected/fc2c2655-44e9-4da2-bbf2-4596ad57a678-kube-api-access-kvzqn\") pod \"dns-operator-controller-manager-7b84cd7c9c-vzxwb\" (UID: \"fc2c2655-44e9-4da2-bbf2-4596ad57a678\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vzxwb"
Sep 17 10:59:48.367988 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:48.367906    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vzxwb"
Sep 17 10:59:48.706679 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:48.706650    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vzxwb"]
Sep 17 10:59:48.706819 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:59:48.706798    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc2c2655_44e9_4da2_bbf2_4596ad57a678.slice/crio-c526aa21c3e878ca5f540c0a87203298dc5995315f2611aa810d374bbbfc30bb WatchSource:0}: Error finding container c526aa21c3e878ca5f540c0a87203298dc5995315f2611aa810d374bbbfc30bb: Status 404 returned error can't find the container with id c526aa21c3e878ca5f540c0a87203298dc5995315f2611aa810d374bbbfc30bb
Sep 17 10:59:49.180260 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:49.180221    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vzxwb" event={"ID":"fc2c2655-44e9-4da2-bbf2-4596ad57a678","Type":"ContainerStarted","Data":"c526aa21c3e878ca5f540c0a87203298dc5995315f2611aa810d374bbbfc30bb"}
Sep 17 10:59:50.463903 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:50.463865    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"]
Sep 17 10:59:50.467198 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:50.467178    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"
Sep 17 10:59:50.472001 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:50.471977    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-bf485\""
Sep 17 10:59:50.486178 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:50.486153    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"]
Sep 17 10:59:50.519233 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:50.519201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j29g\" (UniqueName: \"kubernetes.io/projected/8e5d135f-5221-4b31-9dda-80fae8ed832f-kube-api-access-4j29g\") pod \"limitador-operator-controller-manager-74495c69f8-ddvnr\" (UID: \"8e5d135f-5221-4b31-9dda-80fae8ed832f\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"
Sep 17 10:59:50.620404 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:50.620363    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j29g\" (UniqueName: \"kubernetes.io/projected/8e5d135f-5221-4b31-9dda-80fae8ed832f-kube-api-access-4j29g\") pod \"limitador-operator-controller-manager-74495c69f8-ddvnr\" (UID: \"8e5d135f-5221-4b31-9dda-80fae8ed832f\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"
Sep 17 10:59:50.639683 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:50.639653    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j29g\" (UniqueName: \"kubernetes.io/projected/8e5d135f-5221-4b31-9dda-80fae8ed832f-kube-api-access-4j29g\") pod \"limitador-operator-controller-manager-74495c69f8-ddvnr\" (UID: \"8e5d135f-5221-4b31-9dda-80fae8ed832f\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"
Sep 17 10:59:50.779795 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:50.779762    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"
Sep 17 10:59:51.996711 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:51.996632    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"]
Sep 17 10:59:52.000271 ip-10-0-138-123 kubenswrapper[2570]: W0917 10:59:52.000240    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5d135f_5221_4b31_9dda_80fae8ed832f.slice/crio-00fb73df7125ae59a3cd32ae1cbef8f03ba4d019dbd28e5c08cd5c2cba155431 WatchSource:0}: Error finding container 00fb73df7125ae59a3cd32ae1cbef8f03ba4d019dbd28e5c08cd5c2cba155431: Status 404 returned error can't find the container with id 00fb73df7125ae59a3cd32ae1cbef8f03ba4d019dbd28e5c08cd5c2cba155431
Sep 17 10:59:52.198427 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:52.198382    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs" event={"ID":"ab6578ae-48c4-460a-aeca-135ac02dd4ae","Type":"ContainerStarted","Data":"29ccc40ba81a743025176a00144a7f3003e258b648b146feb9321a108aafd7f8"}
Sep 17 10:59:52.198609 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:52.198467    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 10:59:52.199917 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:52.199881    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr" event={"ID":"8e5d135f-5221-4b31-9dda-80fae8ed832f","Type":"ContainerStarted","Data":"00fb73df7125ae59a3cd32ae1cbef8f03ba4d019dbd28e5c08cd5c2cba155431"}
Sep 17 10:59:52.257024 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:52.256921    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs" podStartSLOduration=2.070223034 podStartE2EDuration="7.256904437s" totalImagesPullingTime="5.186681403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 10:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:59:52.256476803 +0000 UTC m=+382.051811265" watchObservedRunningTime="2026-09-17 10:59:52.256904437 +0000 UTC m=+382.052238875"
Sep 17 10:59:53.206291 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:53.206259    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vzxwb" event={"ID":"fc2c2655-44e9-4da2-bbf2-4596ad57a678","Type":"ContainerStarted","Data":"beb602f115a8c2b94169fefb5b150792ce59d4179d5c1be81fca59dbc911a2cb"}
Sep 17 10:59:53.233444 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:53.233394    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vzxwb" podStartSLOduration=1.242925158 podStartE2EDuration="5.233377403s" totalImagesPullingTime="3.990452245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 10:59:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:59:53.231884867 +0000 UTC m=+383.027219307" watchObservedRunningTime="2026-09-17 10:59:53.233377403 +0000 UTC m=+383.028711853"
Sep 17 10:59:54.212027 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:54.211986    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr" event={"ID":"8e5d135f-5221-4b31-9dda-80fae8ed832f","Type":"ContainerStarted","Data":"df311ed5ec0ba35b22cba24554c171e3d22db057dc71a02831e5097a9471795b"}
Sep 17 10:59:54.212408 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:54.212072    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"
Sep 17 10:59:54.212408 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:54.212189    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vzxwb"
Sep 17 10:59:54.231373 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:54.231331    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr" podStartSLOduration=2.690166754 podStartE2EDuration="4.231317902s" totalImagesPullingTime="1.541151148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 10:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 10:59:54.230139074 +0000 UTC m=+384.025473526" watchObservedRunningTime="2026-09-17 10:59:54.231317902 +0000 UTC m=+384.026652341"
Sep 17 10:59:56.165627 ip-10-0-138-123 kubenswrapper[2570]: I0917 10:59:56.165599    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-q2cwm"
Sep 17 11:00:03.208553 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:03.208488    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 11:00:05.218092 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.218060    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-vzxwb"
Sep 17 11:00:05.218440 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.218144    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"
Sep 17 11:00:05.764834 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.764800    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"]
Sep 17 11:00:05.764992 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.764962    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs" podUID="ab6578ae-48c4-460a-aeca-135ac02dd4ae" containerName="manager" containerID="cri-o://29ccc40ba81a743025176a00144a7f3003e258b648b146feb9321a108aafd7f8" gracePeriod=2
Sep 17 11:00:05.791390 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.791365    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"]
Sep 17 11:00:05.803340 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:05.803309    2570 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ab6578ae-48c4-460a-aeca-135ac02dd4ae\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-zftzs\": pods \"kuadrant-operator-controller-manager-76f8f686bf-zftzs\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 11:00:05.814343 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.814321    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"]
Sep 17 11:00:05.814505 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.814484    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr" podUID="8e5d135f-5221-4b31-9dda-80fae8ed832f" containerName="manager" containerID="cri-o://df311ed5ec0ba35b22cba24554c171e3d22db057dc71a02831e5097a9471795b" gracePeriod=2
Sep 17 11:00:05.829938 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.829837    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"]
Sep 17 11:00:05.849641 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:05.849610    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zftzs\" is forbidden: User \"system:node:ip-10-0-138-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-123.ec2.internal' and this object" podUID="ab6578ae-48c4-460a-aeca-135ac02dd4ae" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 11:00:05.865861 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.865838    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm"]
Sep 17 11:00:05.866150 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.866137    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e5d135f-5221-4b31-9dda-80fae8ed832f" containerName="manager"
Sep 17 11:00:05.866310 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.866152    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e5d135f-5221-4b31-9dda-80fae8ed832f" containerName="manager"
Sep 17 11:00:05.866310 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.866170    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab6578ae-48c4-460a-aeca-135ac02dd4ae" containerName="manager"
Sep 17 11:00:05.866310 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.866176    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab6578ae-48c4-460a-aeca-135ac02dd4ae" containerName="manager"
Sep 17 11:00:05.866310 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.866230    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab6578ae-48c4-460a-aeca-135ac02dd4ae" containerName="manager"
Sep 17 11:00:05.866310 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.866237    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e5d135f-5221-4b31-9dda-80fae8ed832f" containerName="manager"
Sep 17 11:00:05.869232 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.869216    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm"
Sep 17 11:00:05.879162 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:05.879129    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ddvnr\" is forbidden: User \"system:node:ip-10-0-138-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-123.ec2.internal' and this object" podUID="8e5d135f-5221-4b31-9dda-80fae8ed832f" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"
Sep 17 11:00:05.922600 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.922568    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mgdwr"]
Sep 17 11:00:05.925723 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.925701    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mgdwr"
Sep 17 11:00:05.930881 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.930859    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm"]
Sep 17 11:00:05.939985 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.939887    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxlvk\" (UniqueName: \"kubernetes.io/projected/556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39-kube-api-access-dxlvk\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jmpjm\" (UID: \"556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm"
Sep 17 11:00:05.940100 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.939979    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jmpjm\" (UID: \"556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm"
Sep 17 11:00:05.940100 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:05.939987    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mgdwr"]
Sep 17 11:00:06.007500 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:06.007462    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zftzs\" is forbidden: User \"system:node:ip-10-0-138-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-123.ec2.internal' and this object" podUID="ab6578ae-48c4-460a-aeca-135ac02dd4ae" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 11:00:06.009862 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:06.009830    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zftzs\" is forbidden: User \"system:node:ip-10-0-138-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-123.ec2.internal' and this object" podUID="ab6578ae-48c4-460a-aeca-135ac02dd4ae" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 11:00:06.012036 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:06.012009    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ddvnr\" is forbidden: User \"system:node:ip-10-0-138-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-123.ec2.internal' and this object" podUID="8e5d135f-5221-4b31-9dda-80fae8ed832f" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"
Sep 17 11:00:06.040921 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.040891    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxlvk\" (UniqueName: \"kubernetes.io/projected/556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39-kube-api-access-dxlvk\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jmpjm\" (UID: \"556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm"
Sep 17 11:00:06.041033 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.040976    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jmpjm\" (UID: \"556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm"
Sep 17 11:00:06.041033 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.041007    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5t6v\" (UniqueName: \"kubernetes.io/projected/0befb76e-4334-4b49-94fd-0debe22e1538-kube-api-access-d5t6v\") pod \"limitador-operator-controller-manager-74495c69f8-mgdwr\" (UID: \"0befb76e-4334-4b49-94fd-0debe22e1538\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mgdwr"
Sep 17 11:00:06.041346 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.041324    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jmpjm\" (UID: \"556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm"
Sep 17 11:00:06.046465 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.046440    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 11:00:06.073532 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.073490    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxlvk\" (UniqueName: \"kubernetes.io/projected/556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39-kube-api-access-dxlvk\") pod \"kuadrant-operator-controller-manager-76f8f686bf-jmpjm\" (UID: \"556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm"
Sep 17 11:00:06.074206 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:06.074181    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ddvnr\" is forbidden: User \"system:node:ip-10-0-138-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-123.ec2.internal' and this object" podUID="8e5d135f-5221-4b31-9dda-80fae8ed832f" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"
Sep 17 11:00:06.077037 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:06.077012    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zftzs\" is forbidden: User \"system:node:ip-10-0-138-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-123.ec2.internal' and this object" podUID="ab6578ae-48c4-460a-aeca-135ac02dd4ae" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 11:00:06.080572 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.080553    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"
Sep 17 11:00:06.086424 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:06.086403    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zftzs\" is forbidden: User \"system:node:ip-10-0-138-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-123.ec2.internal' and this object" podUID="ab6578ae-48c4-460a-aeca-135ac02dd4ae" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 11:00:06.089777 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:06.089758    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ddvnr\" is forbidden: User \"system:node:ip-10-0-138-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-123.ec2.internal' and this object" podUID="8e5d135f-5221-4b31-9dda-80fae8ed832f" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"
Sep 17 11:00:06.142057 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.142036    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab6578ae-48c4-460a-aeca-135ac02dd4ae-extensions-socket-volume\") pod \"ab6578ae-48c4-460a-aeca-135ac02dd4ae\" (UID: \"ab6578ae-48c4-460a-aeca-135ac02dd4ae\") "
Sep 17 11:00:06.142140 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.142076    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4vf6\" (UniqueName: \"kubernetes.io/projected/ab6578ae-48c4-460a-aeca-135ac02dd4ae-kube-api-access-r4vf6\") pod \"ab6578ae-48c4-460a-aeca-135ac02dd4ae\" (UID: \"ab6578ae-48c4-460a-aeca-135ac02dd4ae\") "
Sep 17 11:00:06.142197 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.142184    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5t6v\" (UniqueName: \"kubernetes.io/projected/0befb76e-4334-4b49-94fd-0debe22e1538-kube-api-access-d5t6v\") pod \"limitador-operator-controller-manager-74495c69f8-mgdwr\" (UID: \"0befb76e-4334-4b49-94fd-0debe22e1538\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mgdwr"
Sep 17 11:00:06.142575 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.142550    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab6578ae-48c4-460a-aeca-135ac02dd4ae-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ab6578ae-48c4-460a-aeca-135ac02dd4ae" (UID: "ab6578ae-48c4-460a-aeca-135ac02dd4ae"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:00:06.143988 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.143971    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab6578ae-48c4-460a-aeca-135ac02dd4ae-kube-api-access-r4vf6" (OuterVolumeSpecName: "kube-api-access-r4vf6") pod "ab6578ae-48c4-460a-aeca-135ac02dd4ae" (UID: "ab6578ae-48c4-460a-aeca-135ac02dd4ae"). InnerVolumeSpecName "kube-api-access-r4vf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:00:06.185238 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.185217    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5t6v\" (UniqueName: \"kubernetes.io/projected/0befb76e-4334-4b49-94fd-0debe22e1538-kube-api-access-d5t6v\") pod \"limitador-operator-controller-manager-74495c69f8-mgdwr\" (UID: \"0befb76e-4334-4b49-94fd-0debe22e1538\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mgdwr"
Sep 17 11:00:06.202047 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.202025    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm"
Sep 17 11:00:06.237964 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.237931    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mgdwr"
Sep 17 11:00:06.243297 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.243275    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4j29g\" (UniqueName: \"kubernetes.io/projected/8e5d135f-5221-4b31-9dda-80fae8ed832f-kube-api-access-4j29g\") pod \"8e5d135f-5221-4b31-9dda-80fae8ed832f\" (UID: \"8e5d135f-5221-4b31-9dda-80fae8ed832f\") "
Sep 17 11:00:06.243403 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.243378    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ab6578ae-48c4-460a-aeca-135ac02dd4ae-extensions-socket-volume\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:00:06.243403 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.243389    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4vf6\" (UniqueName: \"kubernetes.io/projected/ab6578ae-48c4-460a-aeca-135ac02dd4ae-kube-api-access-r4vf6\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:00:06.245097 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.245072    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e5d135f-5221-4b31-9dda-80fae8ed832f-kube-api-access-4j29g" (OuterVolumeSpecName: "kube-api-access-4j29g") pod "8e5d135f-5221-4b31-9dda-80fae8ed832f" (UID: "8e5d135f-5221-4b31-9dda-80fae8ed832f"). InnerVolumeSpecName "kube-api-access-4j29g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:00:06.271764 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.271729    2570 generic.go:356] "Generic (PLEG): container finished" podID="8e5d135f-5221-4b31-9dda-80fae8ed832f" containerID="df311ed5ec0ba35b22cba24554c171e3d22db057dc71a02831e5097a9471795b" exitCode=0
Sep 17 11:00:06.271929 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.271890    2570 scope.go:117] "RemoveContainer" containerID="df311ed5ec0ba35b22cba24554c171e3d22db057dc71a02831e5097a9471795b"
Sep 17 11:00:06.272048 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.272031    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"
Sep 17 11:00:06.273968 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.273945    2570 generic.go:356] "Generic (PLEG): container finished" podID="ab6578ae-48c4-460a-aeca-135ac02dd4ae" containerID="29ccc40ba81a743025176a00144a7f3003e258b648b146feb9321a108aafd7f8" exitCode=0
Sep 17 11:00:06.274043 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.274034    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 11:00:06.275725 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:06.275683    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zftzs\" is forbidden: User \"system:node:ip-10-0-138-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-123.ec2.internal' and this object" podUID="ab6578ae-48c4-460a-aeca-135ac02dd4ae" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 11:00:06.278121 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:06.278089    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ddvnr\" is forbidden: User \"system:node:ip-10-0-138-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-123.ec2.internal' and this object" podUID="8e5d135f-5221-4b31-9dda-80fae8ed832f" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"
Sep 17 11:00:06.283024 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.282922    2570 scope.go:117] "RemoveContainer" containerID="df311ed5ec0ba35b22cba24554c171e3d22db057dc71a02831e5097a9471795b"
Sep 17 11:00:06.283704 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:06.283250    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df311ed5ec0ba35b22cba24554c171e3d22db057dc71a02831e5097a9471795b\": container with ID starting with df311ed5ec0ba35b22cba24554c171e3d22db057dc71a02831e5097a9471795b not found: ID does not exist" containerID="df311ed5ec0ba35b22cba24554c171e3d22db057dc71a02831e5097a9471795b"
Sep 17 11:00:06.283704 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.283287    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df311ed5ec0ba35b22cba24554c171e3d22db057dc71a02831e5097a9471795b"} err="failed to get container status \"df311ed5ec0ba35b22cba24554c171e3d22db057dc71a02831e5097a9471795b\": rpc error: code = NotFound desc = could not find container \"df311ed5ec0ba35b22cba24554c171e3d22db057dc71a02831e5097a9471795b\": container with ID starting with df311ed5ec0ba35b22cba24554c171e3d22db057dc71a02831e5097a9471795b not found: ID does not exist"
Sep 17 11:00:06.283704 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.283310    2570 scope.go:117] "RemoveContainer" containerID="29ccc40ba81a743025176a00144a7f3003e258b648b146feb9321a108aafd7f8"
Sep 17 11:00:06.283704 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:06.283464    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zftzs\" is forbidden: User \"system:node:ip-10-0-138-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-123.ec2.internal' and this object" podUID="ab6578ae-48c4-460a-aeca-135ac02dd4ae" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 11:00:06.286462 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:06.286432    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ddvnr\" is forbidden: User \"system:node:ip-10-0-138-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-123.ec2.internal' and this object" podUID="8e5d135f-5221-4b31-9dda-80fae8ed832f" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"
Sep 17 11:00:06.292174 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:06.292149    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zftzs\" is forbidden: User \"system:node:ip-10-0-138-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-123.ec2.internal' and this object" podUID="ab6578ae-48c4-460a-aeca-135ac02dd4ae" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 11:00:06.293025 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.293003    2570 scope.go:117] "RemoveContainer" containerID="29ccc40ba81a743025176a00144a7f3003e258b648b146feb9321a108aafd7f8"
Sep 17 11:00:06.293804 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:06.293752    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29ccc40ba81a743025176a00144a7f3003e258b648b146feb9321a108aafd7f8\": container with ID starting with 29ccc40ba81a743025176a00144a7f3003e258b648b146feb9321a108aafd7f8 not found: ID does not exist" containerID="29ccc40ba81a743025176a00144a7f3003e258b648b146feb9321a108aafd7f8"
Sep 17 11:00:06.293804 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.293778    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29ccc40ba81a743025176a00144a7f3003e258b648b146feb9321a108aafd7f8"} err="failed to get container status \"29ccc40ba81a743025176a00144a7f3003e258b648b146feb9321a108aafd7f8\": rpc error: code = NotFound desc = could not find container \"29ccc40ba81a743025176a00144a7f3003e258b648b146feb9321a108aafd7f8\": container with ID starting with 29ccc40ba81a743025176a00144a7f3003e258b648b146feb9321a108aafd7f8 not found: ID does not exist"
Sep 17 11:00:06.296707 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:06.296344    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ddvnr\" is forbidden: User \"system:node:ip-10-0-138-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-123.ec2.internal' and this object" podUID="8e5d135f-5221-4b31-9dda-80fae8ed832f" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"
Sep 17 11:00:06.299113 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:06.299087    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zftzs\" is forbidden: User \"system:node:ip-10-0-138-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-123.ec2.internal' and this object" podUID="ab6578ae-48c4-460a-aeca-135ac02dd4ae" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zftzs"
Sep 17 11:00:06.305406 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:06.305378    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ddvnr\" is forbidden: User \"system:node:ip-10-0-138-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-123.ec2.internal' and this object" podUID="8e5d135f-5221-4b31-9dda-80fae8ed832f" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ddvnr"
Sep 17 11:00:06.344761 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.344734    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4j29g\" (UniqueName: \"kubernetes.io/projected/8e5d135f-5221-4b31-9dda-80fae8ed832f-kube-api-access-4j29g\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:00:06.533480 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.533389    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm"]
Sep 17 11:00:06.535645 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:00:06.535616    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod556dfa8b_e2e2_4ab3_8e02_a7f5558b6f39.slice/crio-00ddffd26b9a3f2e9a51f0210bba31184a1df595f8214579d6c91eb159d2bd28 WatchSource:0}: Error finding container 00ddffd26b9a3f2e9a51f0210bba31184a1df595f8214579d6c91eb159d2bd28: Status 404 returned error can't find the container with id 00ddffd26b9a3f2e9a51f0210bba31184a1df595f8214579d6c91eb159d2bd28
Sep 17 11:00:06.542964 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.542941    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mgdwr"]
Sep 17 11:00:06.545317 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:00:06.545293    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0befb76e_4334_4b49_94fd_0debe22e1538.slice/crio-aa187f02a00cbe83958db524d7af0682d6590c29100dfa83704e0ea0e86dc5fe WatchSource:0}: Error finding container aa187f02a00cbe83958db524d7af0682d6590c29100dfa83704e0ea0e86dc5fe: Status 404 returned error can't find the container with id aa187f02a00cbe83958db524d7af0682d6590c29100dfa83704e0ea0e86dc5fe
Sep 17 11:00:06.689775 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.689745    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e5d135f-5221-4b31-9dda-80fae8ed832f" path="/var/lib/kubelet/pods/8e5d135f-5221-4b31-9dda-80fae8ed832f/volumes"
Sep 17 11:00:06.690072 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:06.690060    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab6578ae-48c4-460a-aeca-135ac02dd4ae" path="/var/lib/kubelet/pods/ab6578ae-48c4-460a-aeca-135ac02dd4ae/volumes"
Sep 17 11:00:07.280489 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:07.280457    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mgdwr" event={"ID":"0befb76e-4334-4b49-94fd-0debe22e1538","Type":"ContainerStarted","Data":"f925d00cada7d243cf645a69575a477df25edd6063c7e216a1439a30dcdcb80e"}
Sep 17 11:00:07.280872 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:07.280536    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mgdwr" event={"ID":"0befb76e-4334-4b49-94fd-0debe22e1538","Type":"ContainerStarted","Data":"aa187f02a00cbe83958db524d7af0682d6590c29100dfa83704e0ea0e86dc5fe"}
Sep 17 11:00:07.280872 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:07.280563    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mgdwr"
Sep 17 11:00:07.283117 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:07.283094    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm" event={"ID":"556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39","Type":"ContainerStarted","Data":"15a55dd6b205d86d7df74bd237b9a47c9cf11e7cc5104fbc843d7fe4d21e93ca"}
Sep 17 11:00:07.283245 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:07.283138    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm" event={"ID":"556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39","Type":"ContainerStarted","Data":"00ddffd26b9a3f2e9a51f0210bba31184a1df595f8214579d6c91eb159d2bd28"}
Sep 17 11:00:07.283245 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:07.283166    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm"
Sep 17 11:00:07.312382 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:07.312340    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mgdwr" podStartSLOduration=2.312328857 podStartE2EDuration="2.312328857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:00:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:00:07.31216712 +0000 UTC m=+397.107501558" watchObservedRunningTime="2026-09-17 11:00:07.312328857 +0000 UTC m=+397.107663295"
Sep 17 11:00:08.266391 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:08.266332    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm" podStartSLOduration=3.266316878 podStartE2EDuration="3.266316878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:00:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:00:07.386353422 +0000 UTC m=+397.181687861" watchObservedRunningTime="2026-09-17 11:00:08.266316878 +0000 UTC m=+398.061651318"
Sep 17 11:00:08.266647 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:08.266632    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8"]
Sep 17 11:00:08.269664 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:08.269649    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8"
Sep 17 11:00:08.282141 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:08.282116    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8"]
Sep 17 11:00:08.361579 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:08.361553    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr76p\" (UniqueName: \"kubernetes.io/projected/aafdab76-04d3-4d9f-83b0-f7b8e42c102e-kube-api-access-lr76p\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nckm8\" (UID: \"aafdab76-04d3-4d9f-83b0-f7b8e42c102e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8"
Sep 17 11:00:08.361696 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:08.361585    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aafdab76-04d3-4d9f-83b0-f7b8e42c102e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nckm8\" (UID: \"aafdab76-04d3-4d9f-83b0-f7b8e42c102e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8"
Sep 17 11:00:08.462071 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:08.462043    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr76p\" (UniqueName: \"kubernetes.io/projected/aafdab76-04d3-4d9f-83b0-f7b8e42c102e-kube-api-access-lr76p\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nckm8\" (UID: \"aafdab76-04d3-4d9f-83b0-f7b8e42c102e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8"
Sep 17 11:00:08.462188 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:08.462075    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aafdab76-04d3-4d9f-83b0-f7b8e42c102e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nckm8\" (UID: \"aafdab76-04d3-4d9f-83b0-f7b8e42c102e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8"
Sep 17 11:00:08.462476 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:08.462459    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aafdab76-04d3-4d9f-83b0-f7b8e42c102e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nckm8\" (UID: \"aafdab76-04d3-4d9f-83b0-f7b8e42c102e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8"
Sep 17 11:00:08.492186 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:08.492165    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr76p\" (UniqueName: \"kubernetes.io/projected/aafdab76-04d3-4d9f-83b0-f7b8e42c102e-kube-api-access-lr76p\") pod \"kuadrant-operator-controller-manager-5769f99d9f-nckm8\" (UID: \"aafdab76-04d3-4d9f-83b0-f7b8e42c102e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8"
Sep 17 11:00:08.579566 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:08.579486    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8"
Sep 17 11:00:08.859280 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:08.859205    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8"]
Sep 17 11:00:08.862538 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:00:08.862497    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaafdab76_04d3_4d9f_83b0_f7b8e42c102e.slice/crio-e6c818b8ead72154dd7e4ca0090d71a5ba00710f31f6f4da00dad8c810e443bd WatchSource:0}: Error finding container e6c818b8ead72154dd7e4ca0090d71a5ba00710f31f6f4da00dad8c810e443bd: Status 404 returned error can't find the container with id e6c818b8ead72154dd7e4ca0090d71a5ba00710f31f6f4da00dad8c810e443bd
Sep 17 11:00:09.295297 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:09.295267    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8" event={"ID":"aafdab76-04d3-4d9f-83b0-f7b8e42c102e","Type":"ContainerStarted","Data":"d00edf6e7eaf11cc1b08374941c4e83a77c1f14161cd4bc214dc4abadcfbdbf3"}
Sep 17 11:00:09.295772 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:09.295322    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8" event={"ID":"aafdab76-04d3-4d9f-83b0-f7b8e42c102e","Type":"ContainerStarted","Data":"e6c818b8ead72154dd7e4ca0090d71a5ba00710f31f6f4da00dad8c810e443bd"}
Sep 17 11:00:09.295772 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:09.295383    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8"
Sep 17 11:00:09.376321 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:09.376270    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8" podStartSLOduration=1.376256535 podStartE2EDuration="1.376256535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:00:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:00:09.373036696 +0000 UTC m=+399.168371135" watchObservedRunningTime="2026-09-17 11:00:09.376256535 +0000 UTC m=+399.171590973"
Sep 17 11:00:18.291084 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:18.291051    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm"
Sep 17 11:00:18.291596 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:18.291116    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mgdwr"
Sep 17 11:00:20.301752 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:20.301723    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8"
Sep 17 11:00:20.411885 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:20.411857    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm"]
Sep 17 11:00:20.412042 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:20.412019    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm" podUID="556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39" containerName="manager" containerID="cri-o://15a55dd6b205d86d7df74bd237b9a47c9cf11e7cc5104fbc843d7fe4d21e93ca" gracePeriod=10
Sep 17 11:00:20.644052 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:20.644029    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm"
Sep 17 11:00:20.757886 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:20.757862    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxlvk\" (UniqueName: \"kubernetes.io/projected/556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39-kube-api-access-dxlvk\") pod \"556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39\" (UID: \"556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39\") "
Sep 17 11:00:20.758016 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:20.757925    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39-extensions-socket-volume\") pod \"556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39\" (UID: \"556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39\") "
Sep 17 11:00:20.758284 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:20.758257    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39" (UID: "556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:00:20.759910 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:20.759887    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39-kube-api-access-dxlvk" (OuterVolumeSpecName: "kube-api-access-dxlvk") pod "556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39" (UID: "556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39"). InnerVolumeSpecName "kube-api-access-dxlvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:00:20.858984 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:20.858929    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39-extensions-socket-volume\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:00:20.858984 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:20.858949    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxlvk\" (UniqueName: \"kubernetes.io/projected/556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39-kube-api-access-dxlvk\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:00:21.348038 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:21.348001    2570 generic.go:356] "Generic (PLEG): container finished" podID="556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39" containerID="15a55dd6b205d86d7df74bd237b9a47c9cf11e7cc5104fbc843d7fe4d21e93ca" exitCode=0
Sep 17 11:00:21.348398 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:21.348061    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm"
Sep 17 11:00:21.348398 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:21.348072    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm" event={"ID":"556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39","Type":"ContainerDied","Data":"15a55dd6b205d86d7df74bd237b9a47c9cf11e7cc5104fbc843d7fe4d21e93ca"}
Sep 17 11:00:21.348398 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:21.348147    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm" event={"ID":"556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39","Type":"ContainerDied","Data":"00ddffd26b9a3f2e9a51f0210bba31184a1df595f8214579d6c91eb159d2bd28"}
Sep 17 11:00:21.348398 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:21.348175    2570 scope.go:117] "RemoveContainer" containerID="15a55dd6b205d86d7df74bd237b9a47c9cf11e7cc5104fbc843d7fe4d21e93ca"
Sep 17 11:00:21.356578 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:21.356563    2570 scope.go:117] "RemoveContainer" containerID="15a55dd6b205d86d7df74bd237b9a47c9cf11e7cc5104fbc843d7fe4d21e93ca"
Sep 17 11:00:21.356864 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:21.356846    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15a55dd6b205d86d7df74bd237b9a47c9cf11e7cc5104fbc843d7fe4d21e93ca\": container with ID starting with 15a55dd6b205d86d7df74bd237b9a47c9cf11e7cc5104fbc843d7fe4d21e93ca not found: ID does not exist" containerID="15a55dd6b205d86d7df74bd237b9a47c9cf11e7cc5104fbc843d7fe4d21e93ca"
Sep 17 11:00:21.356932 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:21.356871    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15a55dd6b205d86d7df74bd237b9a47c9cf11e7cc5104fbc843d7fe4d21e93ca"} err="failed to get container status \"15a55dd6b205d86d7df74bd237b9a47c9cf11e7cc5104fbc843d7fe4d21e93ca\": rpc error: code = NotFound desc = could not find container \"15a55dd6b205d86d7df74bd237b9a47c9cf11e7cc5104fbc843d7fe4d21e93ca\": container with ID starting with 15a55dd6b205d86d7df74bd237b9a47c9cf11e7cc5104fbc843d7fe4d21e93ca not found: ID does not exist"
Sep 17 11:00:21.380561 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:21.380534    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm"]
Sep 17 11:00:21.387437 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:21.387414    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-jmpjm"]
Sep 17 11:00:22.689774 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:22.689743    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39" path="/var/lib/kubelet/pods/556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39/volumes"
Sep 17 11:00:36.902705 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:36.902671    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"]
Sep 17 11:00:36.903077 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:36.903008    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39" containerName="manager"
Sep 17 11:00:36.903077 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:36.903019    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39" containerName="manager"
Sep 17 11:00:36.903155 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:36.903084    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="556dfa8b-e2e2-4ab3-8e02-a7f5558b6f39" containerName="manager"
Sep 17 11:00:36.905955 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:36.905934    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:36.911704 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:36.911680    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 17 11:00:36.911814 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:36.911736    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vrl64\""
Sep 17 11:00:36.924607 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:36.924585    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"]
Sep 17 11:00:36.982176 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:36.982146    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1616799-1ec0-4cf2-948a-12c8ffaba408-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:36.982176 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:36.982177    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1616799-1ec0-4cf2-948a-12c8ffaba408-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:36.982352 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:36.982208    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1616799-1ec0-4cf2-948a-12c8ffaba408-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:36.982352 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:36.982289    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1616799-1ec0-4cf2-948a-12c8ffaba408-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:36.982352 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:36.982335    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1616799-1ec0-4cf2-948a-12c8ffaba408-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:36.982491 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:36.982355    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1616799-1ec0-4cf2-948a-12c8ffaba408-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:36.982491 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:36.982372    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1616799-1ec0-4cf2-948a-12c8ffaba408-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:36.982491 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:36.982439    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1616799-1ec0-4cf2-948a-12c8ffaba408-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:36.982644 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:36.982497    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l92vl\" (UniqueName: \"kubernetes.io/projected/d1616799-1ec0-4cf2-948a-12c8ffaba408-kube-api-access-l92vl\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.083618 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.083589    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l92vl\" (UniqueName: \"kubernetes.io/projected/d1616799-1ec0-4cf2-948a-12c8ffaba408-kube-api-access-l92vl\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.083618 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.083625    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1616799-1ec0-4cf2-948a-12c8ffaba408-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.083850 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.083643    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1616799-1ec0-4cf2-948a-12c8ffaba408-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.083850 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.083675    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1616799-1ec0-4cf2-948a-12c8ffaba408-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.083850 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.083707    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1616799-1ec0-4cf2-948a-12c8ffaba408-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.083850 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.083738    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1616799-1ec0-4cf2-948a-12c8ffaba408-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.083850 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.083765    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1616799-1ec0-4cf2-948a-12c8ffaba408-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.084089 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.083871    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1616799-1ec0-4cf2-948a-12c8ffaba408-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.084089 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.083976    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1616799-1ec0-4cf2-948a-12c8ffaba408-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.084089 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.084026    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1616799-1ec0-4cf2-948a-12c8ffaba408-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.084836 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.084261    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1616799-1ec0-4cf2-948a-12c8ffaba408-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.084836 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.084342    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1616799-1ec0-4cf2-948a-12c8ffaba408-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.084836 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.084433    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1616799-1ec0-4cf2-948a-12c8ffaba408-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.084836 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.084616    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1616799-1ec0-4cf2-948a-12c8ffaba408-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.086043 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.086018    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1616799-1ec0-4cf2-948a-12c8ffaba408-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.086577 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.086560    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1616799-1ec0-4cf2-948a-12c8ffaba408-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.093391 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.093362    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1616799-1ec0-4cf2-948a-12c8ffaba408-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.093524 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.093446    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l92vl\" (UniqueName: \"kubernetes.io/projected/d1616799-1ec0-4cf2-948a-12c8ffaba408-kube-api-access-l92vl\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pgmjq\" (UID: \"d1616799-1ec0-4cf2-948a-12c8ffaba408\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.216439 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.216358    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:37.496066 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:37.496041    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"]
Sep 17 11:00:37.500751 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:00:37.500687    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1616799_1ec0_4cf2_948a_12c8ffaba408.slice/crio-158de09762609c867ef7bd2fa2df5c6f95866150854ccf6b4051d5577e9ed78c WatchSource:0}: Error finding container 158de09762609c867ef7bd2fa2df5c6f95866150854ccf6b4051d5577e9ed78c: Status 404 returned error can't find the container with id 158de09762609c867ef7bd2fa2df5c6f95866150854ccf6b4051d5577e9ed78c
Sep 17 11:00:38.422521 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:38.422473    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq" event={"ID":"d1616799-1ec0-4cf2-948a-12c8ffaba408","Type":"ContainerStarted","Data":"158de09762609c867ef7bd2fa2df5c6f95866150854ccf6b4051d5577e9ed78c"}
Sep 17 11:00:40.754120 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:40.754086    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:00:40.754371 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:40.754155    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:00:40.754371 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:40.754181    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:00:41.436860 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:41.436826    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq" event={"ID":"d1616799-1ec0-4cf2-948a-12c8ffaba408","Type":"ContainerStarted","Data":"12e9e21a046ea3fb0276683d93597047e35e459fd2c771a759daf658ff64eb6b"}
Sep 17 11:00:41.467724 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:41.467679    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq" podStartSLOduration=2.216977091 podStartE2EDuration="5.467662535s" totalImagesPullingTime="3.250685444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:00:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:00:41.467648341 +0000 UTC m=+431.262982791" watchObservedRunningTime="2026-09-17 11:00:41.467662535 +0000 UTC m=+431.262996974"
Sep 17 11:00:42.217018 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:42.216985    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:42.221814 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:42.221788    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:42.441366 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:42.441330    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:42.442323 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:42.442303    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:00:42.853055 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:42.853021    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lcj8d"]
Sep 17 11:00:42.855484 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:42.855464    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-lcj8d"
Sep 17 11:00:42.871258 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:42.871237    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 17 11:00:42.873117 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:42.873099    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-262zf\""
Sep 17 11:00:42.891925 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:42.891902    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lcj8d"]
Sep 17 11:00:42.933743 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:42.933711    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9-config-file\") pod \"limitador-limitador-8588749977-lcj8d\" (UID: \"e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9\") " pod="kuadrant-system/limitador-limitador-8588749977-lcj8d"
Sep 17 11:00:42.933743 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:42.933742    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwfkj\" (UniqueName: \"kubernetes.io/projected/e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9-kube-api-access-vwfkj\") pod \"limitador-limitador-8588749977-lcj8d\" (UID: \"e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9\") " pod="kuadrant-system/limitador-limitador-8588749977-lcj8d"
Sep 17 11:00:42.948478 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:42.948446    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lcj8d"]
Sep 17 11:00:43.035071 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:43.035043    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9-config-file\") pod \"limitador-limitador-8588749977-lcj8d\" (UID: \"e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9\") " pod="kuadrant-system/limitador-limitador-8588749977-lcj8d"
Sep 17 11:00:43.035212 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:43.035077    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwfkj\" (UniqueName: \"kubernetes.io/projected/e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9-kube-api-access-vwfkj\") pod \"limitador-limitador-8588749977-lcj8d\" (UID: \"e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9\") " pod="kuadrant-system/limitador-limitador-8588749977-lcj8d"
Sep 17 11:00:43.035666 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:43.035648    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9-config-file\") pod \"limitador-limitador-8588749977-lcj8d\" (UID: \"e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9\") " pod="kuadrant-system/limitador-limitador-8588749977-lcj8d"
Sep 17 11:00:43.052601 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:43.052556    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwfkj\" (UniqueName: \"kubernetes.io/projected/e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9-kube-api-access-vwfkj\") pod \"limitador-limitador-8588749977-lcj8d\" (UID: \"e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9\") " pod="kuadrant-system/limitador-limitador-8588749977-lcj8d"
Sep 17 11:00:43.166722 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:43.166647    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-lcj8d"
Sep 17 11:00:43.491118 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:43.491093    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lcj8d"]
Sep 17 11:00:43.493144 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:00:43.493119    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9374ab9_b6bc_49fb_acb5_e40b3a08e6f9.slice/crio-96320544720da888333274a566567924b79758d32f63a913d5ea52c26455ea27 WatchSource:0}: Error finding container 96320544720da888333274a566567924b79758d32f63a913d5ea52c26455ea27: Status 404 returned error can't find the container with id 96320544720da888333274a566567924b79758d32f63a913d5ea52c26455ea27
Sep 17 11:00:43.958059 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:43.958024    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-v9vvf"]
Sep 17 11:00:43.960920 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:43.960903    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-v9vvf"
Sep 17 11:00:43.964199 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:43.964179    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-f92d9\""
Sep 17 11:00:43.980329 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:43.980305    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-v9vvf"]
Sep 17 11:00:44.045282 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:44.045253    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zldsk\" (UniqueName: \"kubernetes.io/projected/bf2bcae0-b92e-4347-81fe-a82d95613a34-kube-api-access-zldsk\") pod \"authorino-7bcfd8f9cd-v9vvf\" (UID: \"bf2bcae0-b92e-4347-81fe-a82d95613a34\") " pod="kuadrant-system/authorino-7bcfd8f9cd-v9vvf"
Sep 17 11:00:44.146619 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:44.146576    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zldsk\" (UniqueName: \"kubernetes.io/projected/bf2bcae0-b92e-4347-81fe-a82d95613a34-kube-api-access-zldsk\") pod \"authorino-7bcfd8f9cd-v9vvf\" (UID: \"bf2bcae0-b92e-4347-81fe-a82d95613a34\") " pod="kuadrant-system/authorino-7bcfd8f9cd-v9vvf"
Sep 17 11:00:44.157158 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:44.157123    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zldsk\" (UniqueName: \"kubernetes.io/projected/bf2bcae0-b92e-4347-81fe-a82d95613a34-kube-api-access-zldsk\") pod \"authorino-7bcfd8f9cd-v9vvf\" (UID: \"bf2bcae0-b92e-4347-81fe-a82d95613a34\") " pod="kuadrant-system/authorino-7bcfd8f9cd-v9vvf"
Sep 17 11:00:44.269373 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:44.269340    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-v9vvf"
Sep 17 11:00:44.452158 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:44.452119    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-lcj8d" event={"ID":"e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9","Type":"ContainerStarted","Data":"96320544720da888333274a566567924b79758d32f63a913d5ea52c26455ea27"}
Sep 17 11:00:44.542584 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:44.542562    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-v9vvf"]
Sep 17 11:00:44.603640 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:00:44.603585    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf2bcae0_b92e_4347_81fe_a82d95613a34.slice/crio-a37f23a4e1b4f099d04371a95e005add149ccb472be8da4da59092d1705d2f15 WatchSource:0}: Error finding container a37f23a4e1b4f099d04371a95e005add149ccb472be8da4da59092d1705d2f15: Status 404 returned error can't find the container with id a37f23a4e1b4f099d04371a95e005add149ccb472be8da4da59092d1705d2f15
Sep 17 11:00:45.457403 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:45.457368    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-v9vvf" event={"ID":"bf2bcae0-b92e-4347-81fe-a82d95613a34","Type":"ContainerStarted","Data":"a37f23a4e1b4f099d04371a95e005add149ccb472be8da4da59092d1705d2f15"}
Sep 17 11:00:45.458930 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:45.458903    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-lcj8d" event={"ID":"e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9","Type":"ContainerStarted","Data":"7819548daec3820cd197c7e821105b3466ee6e40a35beeb8783e60b0ecfe18a8"}
Sep 17 11:00:45.459062 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:45.459051    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-lcj8d"
Sep 17 11:00:45.487195 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:45.487151    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-lcj8d" podStartSLOduration=2.344941024 podStartE2EDuration="3.487135075s" totalImagesPullingTime="1.142194051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:00:45.485763213 +0000 UTC m=+435.281097652" watchObservedRunningTime="2026-09-17 11:00:45.487135075 +0000 UTC m=+435.282469515"
Sep 17 11:00:47.470070 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:47.469973    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-v9vvf" event={"ID":"bf2bcae0-b92e-4347-81fe-a82d95613a34","Type":"ContainerStarted","Data":"c1397e6c10e2353bac4d9bb386600bb0ce9126d673033a62f2b5820796f0d7d1"}
Sep 17 11:00:47.487568 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:47.487494    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-v9vvf" podStartSLOduration=2.035153893 podStartE2EDuration="4.487477722s" totalImagesPullingTime="2.452323829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:00:47.486698684 +0000 UTC m=+437.282033123" watchObservedRunningTime="2026-09-17 11:00:47.487477722 +0000 UTC m=+437.282812161"
Sep 17 11:00:48.765448 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:48.765414    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-v9vvf"]
Sep 17 11:00:49.478583 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:49.478547    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-v9vvf" podUID="bf2bcae0-b92e-4347-81fe-a82d95613a34" containerName="authorino" containerID="cri-o://c1397e6c10e2353bac4d9bb386600bb0ce9126d673033a62f2b5820796f0d7d1" gracePeriod=30
Sep 17 11:00:49.713848 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:49.713825    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-v9vvf"
Sep 17 11:00:49.788255 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:49.788230    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zldsk\" (UniqueName: \"kubernetes.io/projected/bf2bcae0-b92e-4347-81fe-a82d95613a34-kube-api-access-zldsk\") pod \"bf2bcae0-b92e-4347-81fe-a82d95613a34\" (UID: \"bf2bcae0-b92e-4347-81fe-a82d95613a34\") "
Sep 17 11:00:49.790255 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:49.790234    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf2bcae0-b92e-4347-81fe-a82d95613a34-kube-api-access-zldsk" (OuterVolumeSpecName: "kube-api-access-zldsk") pod "bf2bcae0-b92e-4347-81fe-a82d95613a34" (UID: "bf2bcae0-b92e-4347-81fe-a82d95613a34"). InnerVolumeSpecName "kube-api-access-zldsk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:00:49.889386 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:49.889363    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zldsk\" (UniqueName: \"kubernetes.io/projected/bf2bcae0-b92e-4347-81fe-a82d95613a34-kube-api-access-zldsk\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:00:50.484387 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:50.484354    2570 generic.go:356] "Generic (PLEG): container finished" podID="bf2bcae0-b92e-4347-81fe-a82d95613a34" containerID="c1397e6c10e2353bac4d9bb386600bb0ce9126d673033a62f2b5820796f0d7d1" exitCode=0
Sep 17 11:00:50.484387 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:50.484390    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-v9vvf"
Sep 17 11:00:50.484667 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:50.484437    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-v9vvf" event={"ID":"bf2bcae0-b92e-4347-81fe-a82d95613a34","Type":"ContainerDied","Data":"c1397e6c10e2353bac4d9bb386600bb0ce9126d673033a62f2b5820796f0d7d1"}
Sep 17 11:00:50.484667 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:50.484482    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-v9vvf" event={"ID":"bf2bcae0-b92e-4347-81fe-a82d95613a34","Type":"ContainerDied","Data":"a37f23a4e1b4f099d04371a95e005add149ccb472be8da4da59092d1705d2f15"}
Sep 17 11:00:50.484667 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:50.484527    2570 scope.go:117] "RemoveContainer" containerID="c1397e6c10e2353bac4d9bb386600bb0ce9126d673033a62f2b5820796f0d7d1"
Sep 17 11:00:50.492749 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:50.492734    2570 scope.go:117] "RemoveContainer" containerID="c1397e6c10e2353bac4d9bb386600bb0ce9126d673033a62f2b5820796f0d7d1"
Sep 17 11:00:50.493044 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:50.493029    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1397e6c10e2353bac4d9bb386600bb0ce9126d673033a62f2b5820796f0d7d1\": container with ID starting with c1397e6c10e2353bac4d9bb386600bb0ce9126d673033a62f2b5820796f0d7d1 not found: ID does not exist" containerID="c1397e6c10e2353bac4d9bb386600bb0ce9126d673033a62f2b5820796f0d7d1"
Sep 17 11:00:50.493103 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:50.493055    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1397e6c10e2353bac4d9bb386600bb0ce9126d673033a62f2b5820796f0d7d1"} err="failed to get container status \"c1397e6c10e2353bac4d9bb386600bb0ce9126d673033a62f2b5820796f0d7d1\": rpc error: code = NotFound desc = could not find container \"c1397e6c10e2353bac4d9bb386600bb0ce9126d673033a62f2b5820796f0d7d1\": container with ID starting with c1397e6c10e2353bac4d9bb386600bb0ce9126d673033a62f2b5820796f0d7d1 not found: ID does not exist"
Sep 17 11:00:50.515354 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:50.515331    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-v9vvf"]
Sep 17 11:00:50.518367 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:50.518348    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-v9vvf"]
Sep 17 11:00:50.689167 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:50.689134    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf2bcae0-b92e-4347-81fe-a82d95613a34" path="/var/lib/kubelet/pods/bf2bcae0-b92e-4347-81fe-a82d95613a34/volumes"
Sep 17 11:00:56.464938 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:56.464853    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-lcj8d"
Sep 17 11:00:57.794229 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:57.794195    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lcj8d"]
Sep 17 11:00:57.794604 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:57.794345    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-lcj8d" podUID="e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9" containerName="limitador" containerID="cri-o://7819548daec3820cd197c7e821105b3466ee6e40a35beeb8783e60b0ecfe18a8" gracePeriod=30
Sep 17 11:00:58.333818 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:58.333797    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-lcj8d"
Sep 17 11:00:58.457170 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:58.457109    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwfkj\" (UniqueName: \"kubernetes.io/projected/e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9-kube-api-access-vwfkj\") pod \"e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9\" (UID: \"e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9\") "
Sep 17 11:00:58.457288 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:58.457176    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9-config-file\") pod \"e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9\" (UID: \"e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9\") "
Sep 17 11:00:58.457559 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:58.457500    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9-config-file" (OuterVolumeSpecName: "config-file") pod "e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9" (UID: "e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:00:58.459009 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:58.458987    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9-kube-api-access-vwfkj" (OuterVolumeSpecName: "kube-api-access-vwfkj") pod "e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9" (UID: "e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9"). InnerVolumeSpecName "kube-api-access-vwfkj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:00:58.522719 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:58.522691    2570 generic.go:356] "Generic (PLEG): container finished" podID="e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9" containerID="7819548daec3820cd197c7e821105b3466ee6e40a35beeb8783e60b0ecfe18a8" exitCode=0
Sep 17 11:00:58.522814 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:58.522735    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-lcj8d"
Sep 17 11:00:58.522814 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:58.522752    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-lcj8d" event={"ID":"e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9","Type":"ContainerDied","Data":"7819548daec3820cd197c7e821105b3466ee6e40a35beeb8783e60b0ecfe18a8"}
Sep 17 11:00:58.522814 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:58.522793    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-lcj8d" event={"ID":"e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9","Type":"ContainerDied","Data":"96320544720da888333274a566567924b79758d32f63a913d5ea52c26455ea27"}
Sep 17 11:00:58.522814 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:58.522812    2570 scope.go:117] "RemoveContainer" containerID="7819548daec3820cd197c7e821105b3466ee6e40a35beeb8783e60b0ecfe18a8"
Sep 17 11:00:58.532457 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:58.532443    2570 scope.go:117] "RemoveContainer" containerID="7819548daec3820cd197c7e821105b3466ee6e40a35beeb8783e60b0ecfe18a8"
Sep 17 11:00:58.532717 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:00:58.532702    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7819548daec3820cd197c7e821105b3466ee6e40a35beeb8783e60b0ecfe18a8\": container with ID starting with 7819548daec3820cd197c7e821105b3466ee6e40a35beeb8783e60b0ecfe18a8 not found: ID does not exist" containerID="7819548daec3820cd197c7e821105b3466ee6e40a35beeb8783e60b0ecfe18a8"
Sep 17 11:00:58.532774 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:58.532732    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7819548daec3820cd197c7e821105b3466ee6e40a35beeb8783e60b0ecfe18a8"} err="failed to get container status \"7819548daec3820cd197c7e821105b3466ee6e40a35beeb8783e60b0ecfe18a8\": rpc error: code = NotFound desc = could not find container \"7819548daec3820cd197c7e821105b3466ee6e40a35beeb8783e60b0ecfe18a8\": container with ID starting with 7819548daec3820cd197c7e821105b3466ee6e40a35beeb8783e60b0ecfe18a8 not found: ID does not exist"
Sep 17 11:00:58.551358 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:58.551337    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lcj8d"]
Sep 17 11:00:58.554928 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:58.554909    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-lcj8d"]
Sep 17 11:00:58.557906 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:58.557890    2570 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9-config-file\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:00:58.557969 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:58.557910    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwfkj\" (UniqueName: \"kubernetes.io/projected/e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9-kube-api-access-vwfkj\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:00:58.689355 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:00:58.689329    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9" path="/var/lib/kubelet/pods/e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9/volumes"
Sep 17 11:01:04.413057 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.413021    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zsl4j"]
Sep 17 11:01:04.413404 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.413344    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9" containerName="limitador"
Sep 17 11:01:04.413404 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.413355    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9" containerName="limitador"
Sep 17 11:01:04.413404 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.413374    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf2bcae0-b92e-4347-81fe-a82d95613a34" containerName="authorino"
Sep 17 11:01:04.413404 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.413380    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf2bcae0-b92e-4347-81fe-a82d95613a34" containerName="authorino"
Sep 17 11:01:04.413541 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.413432    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf2bcae0-b92e-4347-81fe-a82d95613a34" containerName="authorino"
Sep 17 11:01:04.413541 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.413444    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9374ab9-b6bc-49fb-acb5-e40b3a08e6f9" containerName="limitador"
Sep 17 11:01:04.417592 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.417575    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsl4j"
Sep 17 11:01:04.420625 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.420602    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 11:01:04.420768 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.420639    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 17 11:01:04.420768 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.420674    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 17 11:01:04.421838 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.421819    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-j2nnc\""
Sep 17 11:01:04.430152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.430133    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zsl4j"]
Sep 17 11:01:04.503567 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.503542    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh9dj\" (UniqueName: \"kubernetes.io/projected/67632eed-e05b-4fd3-a842-e31a4a7f8f14-kube-api-access-fh9dj\") pod \"postgres-69fb4594cf-zsl4j\" (UID: \"67632eed-e05b-4fd3-a842-e31a4a7f8f14\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsl4j"
Sep 17 11:01:04.503673 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.503651    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/67632eed-e05b-4fd3-a842-e31a4a7f8f14-data\") pod \"postgres-69fb4594cf-zsl4j\" (UID: \"67632eed-e05b-4fd3-a842-e31a4a7f8f14\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsl4j"
Sep 17 11:01:04.604387 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.604359    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh9dj\" (UniqueName: \"kubernetes.io/projected/67632eed-e05b-4fd3-a842-e31a4a7f8f14-kube-api-access-fh9dj\") pod \"postgres-69fb4594cf-zsl4j\" (UID: \"67632eed-e05b-4fd3-a842-e31a4a7f8f14\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsl4j"
Sep 17 11:01:04.604542 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.604412    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/67632eed-e05b-4fd3-a842-e31a4a7f8f14-data\") pod \"postgres-69fb4594cf-zsl4j\" (UID: \"67632eed-e05b-4fd3-a842-e31a4a7f8f14\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsl4j"
Sep 17 11:01:04.604805 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.604788    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/67632eed-e05b-4fd3-a842-e31a4a7f8f14-data\") pod \"postgres-69fb4594cf-zsl4j\" (UID: \"67632eed-e05b-4fd3-a842-e31a4a7f8f14\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsl4j"
Sep 17 11:01:04.613400 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.613381    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh9dj\" (UniqueName: \"kubernetes.io/projected/67632eed-e05b-4fd3-a842-e31a4a7f8f14-kube-api-access-fh9dj\") pod \"postgres-69fb4594cf-zsl4j\" (UID: \"67632eed-e05b-4fd3-a842-e31a4a7f8f14\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsl4j"
Sep 17 11:01:04.727986 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:04.727934    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsl4j"
Sep 17 11:01:05.004880 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:05.004838    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-zsl4j"]
Sep 17 11:01:05.007660 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:01:05.007635    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67632eed_e05b_4fd3_a842_e31a4a7f8f14.slice/crio-24ede65dd92428b62f40d9b414d82c9f13e7669cd56fe80c392a7db964f1ce84 WatchSource:0}: Error finding container 24ede65dd92428b62f40d9b414d82c9f13e7669cd56fe80c392a7db964f1ce84: Status 404 returned error can't find the container with id 24ede65dd92428b62f40d9b414d82c9f13e7669cd56fe80c392a7db964f1ce84
Sep 17 11:01:05.554485 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:05.554452    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsl4j" event={"ID":"67632eed-e05b-4fd3-a842-e31a4a7f8f14","Type":"ContainerStarted","Data":"24ede65dd92428b62f40d9b414d82c9f13e7669cd56fe80c392a7db964f1ce84"}
Sep 17 11:01:10.584566 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:10.584525    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsl4j" event={"ID":"67632eed-e05b-4fd3-a842-e31a4a7f8f14","Type":"ContainerStarted","Data":"2d83d3ed03da0452f598ba6cfb59e9c5ef4a6aa04acacf12be5e4610bdbaa702"}
Sep 17 11:01:10.585053 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:10.584638    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsl4j"
Sep 17 11:01:10.614480 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:10.614436    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsl4j" podStartSLOduration=1.5286383890000002 podStartE2EDuration="6.61442201s" totalImagesPullingTime="5.085783621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:01:10.613796656 +0000 UTC m=+460.409131095" watchObservedRunningTime="2026-09-17 11:01:10.61442201 +0000 UTC m=+460.409756449"
Sep 17 11:01:16.617828 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:16.617796    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-zsl4j"
Sep 17 11:01:17.366324 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.366292    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-6qtlf"]
Sep 17 11:01:17.368539 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.368502    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-6qtlf"
Sep 17 11:01:17.381858 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.381830    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-f92d9\""
Sep 17 11:01:17.400068 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.400043    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-6qtlf"]
Sep 17 11:01:17.501754 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.501723    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-6qtlf"]
Sep 17 11:01:17.501948 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:01:17.501930    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-56k92], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-6qtlf" podUID="27f31218-ad27-454b-a1b4-81d9c22466c9"
Sep 17 11:01:17.509599 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.509576    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56k92\" (UniqueName: \"kubernetes.io/projected/27f31218-ad27-454b-a1b4-81d9c22466c9-kube-api-access-56k92\") pod \"authorino-557f876f69-6qtlf\" (UID: \"27f31218-ad27-454b-a1b4-81d9c22466c9\") " pod="kuadrant-system/authorino-557f876f69-6qtlf"
Sep 17 11:01:17.599894 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.599863    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-k9l9m"]
Sep 17 11:01:17.602149 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.602133    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-k9l9m"
Sep 17 11:01:17.610131 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.610105    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56k92\" (UniqueName: \"kubernetes.io/projected/27f31218-ad27-454b-a1b4-81d9c22466c9-kube-api-access-56k92\") pod \"authorino-557f876f69-6qtlf\" (UID: \"27f31218-ad27-454b-a1b4-81d9c22466c9\") " pod="kuadrant-system/authorino-557f876f69-6qtlf"
Sep 17 11:01:17.612676 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.612660    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 17 11:01:17.616155 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.616135    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-6qtlf"
Sep 17 11:01:17.620958 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.620914    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-6qtlf"
Sep 17 11:01:17.631106 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.631081    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-k9l9m"]
Sep 17 11:01:17.640164 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.640145    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56k92\" (UniqueName: \"kubernetes.io/projected/27f31218-ad27-454b-a1b4-81d9c22466c9-kube-api-access-56k92\") pod \"authorino-557f876f69-6qtlf\" (UID: \"27f31218-ad27-454b-a1b4-81d9c22466c9\") " pod="kuadrant-system/authorino-557f876f69-6qtlf"
Sep 17 11:01:17.711119 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.711091    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjb6k\" (UniqueName: \"kubernetes.io/projected/6d817516-a272-477b-bc85-8f3122ba3430-kube-api-access-qjb6k\") pod \"authorino-6d4dfc649f-k9l9m\" (UID: \"6d817516-a272-477b-bc85-8f3122ba3430\") " pod="kuadrant-system/authorino-6d4dfc649f-k9l9m"
Sep 17 11:01:17.711252 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.711128    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6d817516-a272-477b-bc85-8f3122ba3430-tls-cert\") pod \"authorino-6d4dfc649f-k9l9m\" (UID: \"6d817516-a272-477b-bc85-8f3122ba3430\") " pod="kuadrant-system/authorino-6d4dfc649f-k9l9m"
Sep 17 11:01:17.775441 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.775410    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-k9l9m"]
Sep 17 11:01:17.775703 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:01:17.775682    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qjb6k tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-k9l9m" podUID="6d817516-a272-477b-bc85-8f3122ba3430"
Sep 17 11:01:17.812108 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.812078    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56k92\" (UniqueName: \"kubernetes.io/projected/27f31218-ad27-454b-a1b4-81d9c22466c9-kube-api-access-56k92\") pod \"27f31218-ad27-454b-a1b4-81d9c22466c9\" (UID: \"27f31218-ad27-454b-a1b4-81d9c22466c9\") "
Sep 17 11:01:17.812303 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.812287    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjb6k\" (UniqueName: \"kubernetes.io/projected/6d817516-a272-477b-bc85-8f3122ba3430-kube-api-access-qjb6k\") pod \"authorino-6d4dfc649f-k9l9m\" (UID: \"6d817516-a272-477b-bc85-8f3122ba3430\") " pod="kuadrant-system/authorino-6d4dfc649f-k9l9m"
Sep 17 11:01:17.812373 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.812320    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6d817516-a272-477b-bc85-8f3122ba3430-tls-cert\") pod \"authorino-6d4dfc649f-k9l9m\" (UID: \"6d817516-a272-477b-bc85-8f3122ba3430\") " pod="kuadrant-system/authorino-6d4dfc649f-k9l9m"
Sep 17 11:01:17.814560 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.814535    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27f31218-ad27-454b-a1b4-81d9c22466c9-kube-api-access-56k92" (OuterVolumeSpecName: "kube-api-access-56k92") pod "27f31218-ad27-454b-a1b4-81d9c22466c9" (UID: "27f31218-ad27-454b-a1b4-81d9c22466c9"). InnerVolumeSpecName "kube-api-access-56k92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:01:17.814732 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.814710    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6d817516-a272-477b-bc85-8f3122ba3430-tls-cert\") pod \"authorino-6d4dfc649f-k9l9m\" (UID: \"6d817516-a272-477b-bc85-8f3122ba3430\") " pod="kuadrant-system/authorino-6d4dfc649f-k9l9m"
Sep 17 11:01:17.824215 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.824194    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8475574dc4-wphjh"]
Sep 17 11:01:17.828421 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.828391    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjb6k\" (UniqueName: \"kubernetes.io/projected/6d817516-a272-477b-bc85-8f3122ba3430-kube-api-access-qjb6k\") pod \"authorino-6d4dfc649f-k9l9m\" (UID: \"6d817516-a272-477b-bc85-8f3122ba3430\") " pod="kuadrant-system/authorino-6d4dfc649f-k9l9m"
Sep 17 11:01:17.829487 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.829470    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8475574dc4-wphjh"
Sep 17 11:01:17.858266 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.858241    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8475574dc4-wphjh"]
Sep 17 11:01:17.913343 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.913282    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a569feef-be6c-4ef4-9476-96589ed990e0-tls-cert\") pod \"authorino-8475574dc4-wphjh\" (UID: \"a569feef-be6c-4ef4-9476-96589ed990e0\") " pod="kuadrant-system/authorino-8475574dc4-wphjh"
Sep 17 11:01:17.913343 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.913309    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvndt\" (UniqueName: \"kubernetes.io/projected/a569feef-be6c-4ef4-9476-96589ed990e0-kube-api-access-gvndt\") pod \"authorino-8475574dc4-wphjh\" (UID: \"a569feef-be6c-4ef4-9476-96589ed990e0\") " pod="kuadrant-system/authorino-8475574dc4-wphjh"
Sep 17 11:01:17.913495 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:17.913380    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56k92\" (UniqueName: \"kubernetes.io/projected/27f31218-ad27-454b-a1b4-81d9c22466c9-kube-api-access-56k92\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:01:18.013895 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:18.013867    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a569feef-be6c-4ef4-9476-96589ed990e0-tls-cert\") pod \"authorino-8475574dc4-wphjh\" (UID: \"a569feef-be6c-4ef4-9476-96589ed990e0\") " pod="kuadrant-system/authorino-8475574dc4-wphjh"
Sep 17 11:01:18.013895 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:18.013896    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvndt\" (UniqueName: \"kubernetes.io/projected/a569feef-be6c-4ef4-9476-96589ed990e0-kube-api-access-gvndt\") pod \"authorino-8475574dc4-wphjh\" (UID: \"a569feef-be6c-4ef4-9476-96589ed990e0\") " pod="kuadrant-system/authorino-8475574dc4-wphjh"
Sep 17 11:01:18.016249 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:18.016227    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a569feef-be6c-4ef4-9476-96589ed990e0-tls-cert\") pod \"authorino-8475574dc4-wphjh\" (UID: \"a569feef-be6c-4ef4-9476-96589ed990e0\") " pod="kuadrant-system/authorino-8475574dc4-wphjh"
Sep 17 11:01:18.037018 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:18.036993    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvndt\" (UniqueName: \"kubernetes.io/projected/a569feef-be6c-4ef4-9476-96589ed990e0-kube-api-access-gvndt\") pod \"authorino-8475574dc4-wphjh\" (UID: \"a569feef-be6c-4ef4-9476-96589ed990e0\") " pod="kuadrant-system/authorino-8475574dc4-wphjh"
Sep 17 11:01:18.142785 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:18.142758    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8475574dc4-wphjh"
Sep 17 11:01:18.430211 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:18.430188    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8475574dc4-wphjh"]
Sep 17 11:01:18.432434 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:01:18.432409    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda569feef_be6c_4ef4_9476_96589ed990e0.slice/crio-9e7926550d6f181f99db7856c7de6165d85c3c4f036327545c0a7ca1dd99f2c0 WatchSource:0}: Error finding container 9e7926550d6f181f99db7856c7de6165d85c3c4f036327545c0a7ca1dd99f2c0: Status 404 returned error can't find the container with id 9e7926550d6f181f99db7856c7de6165d85c3c4f036327545c0a7ca1dd99f2c0
Sep 17 11:01:18.621831 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:18.621797    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8475574dc4-wphjh" event={"ID":"a569feef-be6c-4ef4-9476-96589ed990e0","Type":"ContainerStarted","Data":"9e7926550d6f181f99db7856c7de6165d85c3c4f036327545c0a7ca1dd99f2c0"}
Sep 17 11:01:18.621831 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:18.621819    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-k9l9m"
Sep 17 11:01:18.622235 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:18.621819    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-6qtlf"
Sep 17 11:01:18.637588 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:18.637568    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-k9l9m"
Sep 17 11:01:18.706140 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:18.706116    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-6qtlf"]
Sep 17 11:01:18.714736 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:18.714715    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-6qtlf"]
Sep 17 11:01:18.719576 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:18.719559    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjb6k\" (UniqueName: \"kubernetes.io/projected/6d817516-a272-477b-bc85-8f3122ba3430-kube-api-access-qjb6k\") pod \"6d817516-a272-477b-bc85-8f3122ba3430\" (UID: \"6d817516-a272-477b-bc85-8f3122ba3430\") "
Sep 17 11:01:18.719645 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:18.719632    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6d817516-a272-477b-bc85-8f3122ba3430-tls-cert\") pod \"6d817516-a272-477b-bc85-8f3122ba3430\" (UID: \"6d817516-a272-477b-bc85-8f3122ba3430\") "
Sep 17 11:01:18.721497 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:18.721473    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d817516-a272-477b-bc85-8f3122ba3430-kube-api-access-qjb6k" (OuterVolumeSpecName: "kube-api-access-qjb6k") pod "6d817516-a272-477b-bc85-8f3122ba3430" (UID: "6d817516-a272-477b-bc85-8f3122ba3430"). InnerVolumeSpecName "kube-api-access-qjb6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:01:18.721611 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:18.721592    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d817516-a272-477b-bc85-8f3122ba3430-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6d817516-a272-477b-bc85-8f3122ba3430" (UID: "6d817516-a272-477b-bc85-8f3122ba3430"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:01:18.820771 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:18.820745    2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6d817516-a272-477b-bc85-8f3122ba3430-tls-cert\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:01:18.820771 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:18.820767    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjb6k\" (UniqueName: \"kubernetes.io/projected/6d817516-a272-477b-bc85-8f3122ba3430-kube-api-access-qjb6k\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:01:19.628217 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:19.628175    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8475574dc4-wphjh" event={"ID":"a569feef-be6c-4ef4-9476-96589ed990e0","Type":"ContainerStarted","Data":"212f09bb29591b9e21a4c913a502e1a6d7799874fe6c669b8a975d04846371ae"}
Sep 17 11:01:19.628621 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:19.628255    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-k9l9m"
Sep 17 11:01:19.652135 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:19.652087    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8475574dc4-wphjh" podStartSLOduration=2.115291228 podStartE2EDuration="2.652075127s" totalImagesPullingTime="536.783899ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:01:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:01:19.651666764 +0000 UTC m=+469.447001202" watchObservedRunningTime="2026-09-17 11:01:19.652075127 +0000 UTC m=+469.447409566"
Sep 17 11:01:19.707728 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:19.707697    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-k9l9m"]
Sep 17 11:01:19.716999 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:19.716974    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-k9l9m"]
Sep 17 11:01:20.689631 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:20.689602    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27f31218-ad27-454b-a1b4-81d9c22466c9" path="/var/lib/kubelet/pods/27f31218-ad27-454b-a1b4-81d9c22466c9/volumes"
Sep 17 11:01:20.689969 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:20.689836    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d817516-a272-477b-bc85-8f3122ba3430" path="/var/lib/kubelet/pods/6d817516-a272-477b-bc85-8f3122ba3430/volumes"
Sep 17 11:01:25.476991 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.476957    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-nwsd8"]
Sep 17 11:01:25.480387 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.480366    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-nwsd8"
Sep 17 11:01:25.485690 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.485668    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 11:01:25.487392 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.487298    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 11:01:25.487392 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.487319    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tj882\""
Sep 17 11:01:25.487533 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.487302    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 11:01:25.518700 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.518678    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-nwsd8"]
Sep 17 11:01:25.568890 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.568860    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c3c9c39-23c7-4b92-8516-ae272b9e9c89-webhook-cert\") pod \"maas-controller-75dc6cbdf-nwsd8\" (UID: \"0c3c9c39-23c7-4b92-8516-ae272b9e9c89\") " pod="opendatahub/maas-controller-75dc6cbdf-nwsd8"
Sep 17 11:01:25.569002 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.568917    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3c9c39-23c7-4b92-8516-ae272b9e9c89-metrics-certs\") pod \"maas-controller-75dc6cbdf-nwsd8\" (UID: \"0c3c9c39-23c7-4b92-8516-ae272b9e9c89\") " pod="opendatahub/maas-controller-75dc6cbdf-nwsd8"
Sep 17 11:01:25.569002 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.568972    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xw6n\" (UniqueName: \"kubernetes.io/projected/0c3c9c39-23c7-4b92-8516-ae272b9e9c89-kube-api-access-8xw6n\") pod \"maas-controller-75dc6cbdf-nwsd8\" (UID: \"0c3c9c39-23c7-4b92-8516-ae272b9e9c89\") " pod="opendatahub/maas-controller-75dc6cbdf-nwsd8"
Sep 17 11:01:25.669573 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.669547    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3c9c39-23c7-4b92-8516-ae272b9e9c89-metrics-certs\") pod \"maas-controller-75dc6cbdf-nwsd8\" (UID: \"0c3c9c39-23c7-4b92-8516-ae272b9e9c89\") " pod="opendatahub/maas-controller-75dc6cbdf-nwsd8"
Sep 17 11:01:25.669690 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.669595    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xw6n\" (UniqueName: \"kubernetes.io/projected/0c3c9c39-23c7-4b92-8516-ae272b9e9c89-kube-api-access-8xw6n\") pod \"maas-controller-75dc6cbdf-nwsd8\" (UID: \"0c3c9c39-23c7-4b92-8516-ae272b9e9c89\") " pod="opendatahub/maas-controller-75dc6cbdf-nwsd8"
Sep 17 11:01:25.669690 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.669672    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c3c9c39-23c7-4b92-8516-ae272b9e9c89-webhook-cert\") pod \"maas-controller-75dc6cbdf-nwsd8\" (UID: \"0c3c9c39-23c7-4b92-8516-ae272b9e9c89\") " pod="opendatahub/maas-controller-75dc6cbdf-nwsd8"
Sep 17 11:01:25.672034 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.672002    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3c9c39-23c7-4b92-8516-ae272b9e9c89-metrics-certs\") pod \"maas-controller-75dc6cbdf-nwsd8\" (UID: \"0c3c9c39-23c7-4b92-8516-ae272b9e9c89\") " pod="opendatahub/maas-controller-75dc6cbdf-nwsd8"
Sep 17 11:01:25.672119 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.672040    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c3c9c39-23c7-4b92-8516-ae272b9e9c89-webhook-cert\") pod \"maas-controller-75dc6cbdf-nwsd8\" (UID: \"0c3c9c39-23c7-4b92-8516-ae272b9e9c89\") " pod="opendatahub/maas-controller-75dc6cbdf-nwsd8"
Sep 17 11:01:25.683631 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.683612    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xw6n\" (UniqueName: \"kubernetes.io/projected/0c3c9c39-23c7-4b92-8516-ae272b9e9c89-kube-api-access-8xw6n\") pod \"maas-controller-75dc6cbdf-nwsd8\" (UID: \"0c3c9c39-23c7-4b92-8516-ae272b9e9c89\") " pod="opendatahub/maas-controller-75dc6cbdf-nwsd8"
Sep 17 11:01:25.768837 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.768814    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-4ztwj"]
Sep 17 11:01:25.772160 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.772145    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-658cf9cdcf-4ztwj"
Sep 17 11:01:25.790570 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.790546    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-nwsd8"
Sep 17 11:01:25.805843 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.805821    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-4ztwj"]
Sep 17 11:01:25.871044 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.871012    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6604f5d2-6a2c-41ea-a96f-6049212760f8-webhook-cert\") pod \"maas-controller-658cf9cdcf-4ztwj\" (UID: \"6604f5d2-6a2c-41ea-a96f-6049212760f8\") " pod="opendatahub/maas-controller-658cf9cdcf-4ztwj"
Sep 17 11:01:25.871181 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.871062    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6604f5d2-6a2c-41ea-a96f-6049212760f8-metrics-certs\") pod \"maas-controller-658cf9cdcf-4ztwj\" (UID: \"6604f5d2-6a2c-41ea-a96f-6049212760f8\") " pod="opendatahub/maas-controller-658cf9cdcf-4ztwj"
Sep 17 11:01:25.871181 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.871139    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb5mz\" (UniqueName: \"kubernetes.io/projected/6604f5d2-6a2c-41ea-a96f-6049212760f8-kube-api-access-zb5mz\") pod \"maas-controller-658cf9cdcf-4ztwj\" (UID: \"6604f5d2-6a2c-41ea-a96f-6049212760f8\") " pod="opendatahub/maas-controller-658cf9cdcf-4ztwj"
Sep 17 11:01:25.971782 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.971760    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6604f5d2-6a2c-41ea-a96f-6049212760f8-webhook-cert\") pod \"maas-controller-658cf9cdcf-4ztwj\" (UID: \"6604f5d2-6a2c-41ea-a96f-6049212760f8\") " pod="opendatahub/maas-controller-658cf9cdcf-4ztwj"
Sep 17 11:01:25.971916 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.971796    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6604f5d2-6a2c-41ea-a96f-6049212760f8-metrics-certs\") pod \"maas-controller-658cf9cdcf-4ztwj\" (UID: \"6604f5d2-6a2c-41ea-a96f-6049212760f8\") " pod="opendatahub/maas-controller-658cf9cdcf-4ztwj"
Sep 17 11:01:25.971916 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.971822    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb5mz\" (UniqueName: \"kubernetes.io/projected/6604f5d2-6a2c-41ea-a96f-6049212760f8-kube-api-access-zb5mz\") pod \"maas-controller-658cf9cdcf-4ztwj\" (UID: \"6604f5d2-6a2c-41ea-a96f-6049212760f8\") " pod="opendatahub/maas-controller-658cf9cdcf-4ztwj"
Sep 17 11:01:25.974125 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.974103    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6604f5d2-6a2c-41ea-a96f-6049212760f8-metrics-certs\") pod \"maas-controller-658cf9cdcf-4ztwj\" (UID: \"6604f5d2-6a2c-41ea-a96f-6049212760f8\") " pod="opendatahub/maas-controller-658cf9cdcf-4ztwj"
Sep 17 11:01:25.974211 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.974133    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6604f5d2-6a2c-41ea-a96f-6049212760f8-webhook-cert\") pod \"maas-controller-658cf9cdcf-4ztwj\" (UID: \"6604f5d2-6a2c-41ea-a96f-6049212760f8\") " pod="opendatahub/maas-controller-658cf9cdcf-4ztwj"
Sep 17 11:01:25.983755 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:25.983734    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb5mz\" (UniqueName: \"kubernetes.io/projected/6604f5d2-6a2c-41ea-a96f-6049212760f8-kube-api-access-zb5mz\") pod \"maas-controller-658cf9cdcf-4ztwj\" (UID: \"6604f5d2-6a2c-41ea-a96f-6049212760f8\") " pod="opendatahub/maas-controller-658cf9cdcf-4ztwj"
Sep 17 11:01:26.082260 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:26.082212    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-658cf9cdcf-4ztwj"
Sep 17 11:01:26.086769 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:26.086714    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-nwsd8"]
Sep 17 11:01:26.089092 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:01:26.089056    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c3c9c39_23c7_4b92_8516_ae272b9e9c89.slice/crio-7235b42a55619699eaa6e84f407cc7ed2227e501e0754084f05521938daededd WatchSource:0}: Error finding container 7235b42a55619699eaa6e84f407cc7ed2227e501e0754084f05521938daededd: Status 404 returned error can't find the container with id 7235b42a55619699eaa6e84f407cc7ed2227e501e0754084f05521938daededd
Sep 17 11:01:26.369451 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:26.369405    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-4ztwj"]
Sep 17 11:01:26.371567 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:01:26.371537    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6604f5d2_6a2c_41ea_a96f_6049212760f8.slice/crio-cd59cc33fe1faa1d71fb94d3c5311a50887652b6ea873a4b02ad6013b501ea6f WatchSource:0}: Error finding container cd59cc33fe1faa1d71fb94d3c5311a50887652b6ea873a4b02ad6013b501ea6f: Status 404 returned error can't find the container with id cd59cc33fe1faa1d71fb94d3c5311a50887652b6ea873a4b02ad6013b501ea6f
Sep 17 11:01:26.663672 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:26.663571    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-658cf9cdcf-4ztwj" event={"ID":"6604f5d2-6a2c-41ea-a96f-6049212760f8","Type":"ContainerStarted","Data":"cd59cc33fe1faa1d71fb94d3c5311a50887652b6ea873a4b02ad6013b501ea6f"}
Sep 17 11:01:26.665469 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:26.665388    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-nwsd8" event={"ID":"0c3c9c39-23c7-4b92-8516-ae272b9e9c89","Type":"ContainerStarted","Data":"7235b42a55619699eaa6e84f407cc7ed2227e501e0754084f05521938daededd"}
Sep 17 11:01:28.678791 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:28.678758    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-658cf9cdcf-4ztwj" event={"ID":"6604f5d2-6a2c-41ea-a96f-6049212760f8","Type":"ContainerStarted","Data":"4a53375a41cbd2ae671d684e03e99f1c4e4cc80fb313c375749ecc08a6788891"}
Sep 17 11:01:28.679211 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:28.678850    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-658cf9cdcf-4ztwj"
Sep 17 11:01:28.680256 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:28.680232    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-nwsd8" event={"ID":"0c3c9c39-23c7-4b92-8516-ae272b9e9c89","Type":"ContainerStarted","Data":"049144b6f59026c6ff7120d29ec93ca90cc3c19feddcf2e7664069727fb0696c"}
Sep 17 11:01:28.680385 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:28.680278    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75dc6cbdf-nwsd8"
Sep 17 11:01:28.777486 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:28.777434    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-658cf9cdcf-4ztwj" podStartSLOduration=1.5634199560000002 podStartE2EDuration="3.777418124s" totalImagesPullingTime="2.213998168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:01:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:01:28.776203796 +0000 UTC m=+478.571538236" watchObservedRunningTime="2026-09-17 11:01:28.777418124 +0000 UTC m=+478.572752564"
Sep 17 11:01:28.848163 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:28.848086    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75dc6cbdf-nwsd8" podStartSLOduration=1.362919787 podStartE2EDuration="3.848073744s" totalImagesPullingTime="2.485153957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:01:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:01:28.847785389 +0000 UTC m=+478.643119831" watchObservedRunningTime="2026-09-17 11:01:28.848073744 +0000 UTC m=+478.643408183"
Sep 17 11:01:39.687121 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:39.687087    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75dc6cbdf-nwsd8"
Sep 17 11:01:39.687574 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:39.687161    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-658cf9cdcf-4ztwj"
Sep 17 11:01:39.826441 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:39.826406    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-nwsd8"]
Sep 17 11:01:39.826780 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:39.826661    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-75dc6cbdf-nwsd8" podUID="0c3c9c39-23c7-4b92-8516-ae272b9e9c89" containerName="manager" containerID="cri-o://049144b6f59026c6ff7120d29ec93ca90cc3c19feddcf2e7664069727fb0696c" gracePeriod=30
Sep 17 11:01:40.623439 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:40.623415    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-nwsd8"
Sep 17 11:01:40.694777 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:40.694749    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xw6n\" (UniqueName: \"kubernetes.io/projected/0c3c9c39-23c7-4b92-8516-ae272b9e9c89-kube-api-access-8xw6n\") pod \"0c3c9c39-23c7-4b92-8516-ae272b9e9c89\" (UID: \"0c3c9c39-23c7-4b92-8516-ae272b9e9c89\") "
Sep 17 11:01:40.695111 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:40.694789    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3c9c39-23c7-4b92-8516-ae272b9e9c89-metrics-certs\") pod \"0c3c9c39-23c7-4b92-8516-ae272b9e9c89\" (UID: \"0c3c9c39-23c7-4b92-8516-ae272b9e9c89\") "
Sep 17 11:01:40.695111 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:40.694837    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c3c9c39-23c7-4b92-8516-ae272b9e9c89-webhook-cert\") pod \"0c3c9c39-23c7-4b92-8516-ae272b9e9c89\" (UID: \"0c3c9c39-23c7-4b92-8516-ae272b9e9c89\") "
Sep 17 11:01:40.696984 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:40.696952    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c3c9c39-23c7-4b92-8516-ae272b9e9c89-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0c3c9c39-23c7-4b92-8516-ae272b9e9c89" (UID: "0c3c9c39-23c7-4b92-8516-ae272b9e9c89"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:01:40.697107 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:40.697092    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c3c9c39-23c7-4b92-8516-ae272b9e9c89-kube-api-access-8xw6n" (OuterVolumeSpecName: "kube-api-access-8xw6n") pod "0c3c9c39-23c7-4b92-8516-ae272b9e9c89" (UID: "0c3c9c39-23c7-4b92-8516-ae272b9e9c89"). InnerVolumeSpecName "kube-api-access-8xw6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:01:40.697172 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:40.697114    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c3c9c39-23c7-4b92-8516-ae272b9e9c89-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0c3c9c39-23c7-4b92-8516-ae272b9e9c89" (UID: "0c3c9c39-23c7-4b92-8516-ae272b9e9c89"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:01:40.733483 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:40.733417    2570 generic.go:356] "Generic (PLEG): container finished" podID="0c3c9c39-23c7-4b92-8516-ae272b9e9c89" containerID="049144b6f59026c6ff7120d29ec93ca90cc3c19feddcf2e7664069727fb0696c" exitCode=0
Sep 17 11:01:40.733483 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:40.733464    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75dc6cbdf-nwsd8"
Sep 17 11:01:40.733735 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:40.733501    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-nwsd8" event={"ID":"0c3c9c39-23c7-4b92-8516-ae272b9e9c89","Type":"ContainerDied","Data":"049144b6f59026c6ff7120d29ec93ca90cc3c19feddcf2e7664069727fb0696c"}
Sep 17 11:01:40.733805 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:40.733773    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75dc6cbdf-nwsd8" event={"ID":"0c3c9c39-23c7-4b92-8516-ae272b9e9c89","Type":"ContainerDied","Data":"7235b42a55619699eaa6e84f407cc7ed2227e501e0754084f05521938daededd"}
Sep 17 11:01:40.733859 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:40.733805    2570 scope.go:117] "RemoveContainer" containerID="049144b6f59026c6ff7120d29ec93ca90cc3c19feddcf2e7664069727fb0696c"
Sep 17 11:01:40.743038 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:40.743023    2570 scope.go:117] "RemoveContainer" containerID="049144b6f59026c6ff7120d29ec93ca90cc3c19feddcf2e7664069727fb0696c"
Sep 17 11:01:40.743282 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:01:40.743263    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"049144b6f59026c6ff7120d29ec93ca90cc3c19feddcf2e7664069727fb0696c\": container with ID starting with 049144b6f59026c6ff7120d29ec93ca90cc3c19feddcf2e7664069727fb0696c not found: ID does not exist" containerID="049144b6f59026c6ff7120d29ec93ca90cc3c19feddcf2e7664069727fb0696c"
Sep 17 11:01:40.743346 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:40.743288    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"049144b6f59026c6ff7120d29ec93ca90cc3c19feddcf2e7664069727fb0696c"} err="failed to get container status \"049144b6f59026c6ff7120d29ec93ca90cc3c19feddcf2e7664069727fb0696c\": rpc error: code = NotFound desc = could not find container \"049144b6f59026c6ff7120d29ec93ca90cc3c19feddcf2e7664069727fb0696c\": container with ID starting with 049144b6f59026c6ff7120d29ec93ca90cc3c19feddcf2e7664069727fb0696c not found: ID does not exist"
Sep 17 11:01:40.758449 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:40.758426    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-nwsd8"]
Sep 17 11:01:40.764240 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:40.764219    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75dc6cbdf-nwsd8"]
Sep 17 11:01:40.795862 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:40.795839    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c3c9c39-23c7-4b92-8516-ae272b9e9c89-webhook-cert\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:01:40.795862 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:40.795860    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xw6n\" (UniqueName: \"kubernetes.io/projected/0c3c9c39-23c7-4b92-8516-ae272b9e9c89-kube-api-access-8xw6n\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:01:40.795974 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:40.795870    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3c9c39-23c7-4b92-8516-ae272b9e9c89-metrics-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:01:42.689678 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:01:42.689649    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c3c9c39-23c7-4b92-8516-ae272b9e9c89" path="/var/lib/kubelet/pods/0c3c9c39-23c7-4b92-8516-ae272b9e9c89/volumes"
Sep 17 11:02:03.978014 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:03.977982    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z"]
Sep 17 11:02:03.978380 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:03.978305    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c3c9c39-23c7-4b92-8516-ae272b9e9c89" containerName="manager"
Sep 17 11:02:03.978380 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:03.978315    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c3c9c39-23c7-4b92-8516-ae272b9e9c89" containerName="manager"
Sep 17 11:02:03.978380 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:03.978366    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c3c9c39-23c7-4b92-8516-ae272b9e9c89" containerName="manager"
Sep 17 11:02:03.983057 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:03.983036    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z"
Sep 17 11:02:03.990278 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:03.990262    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 17 11:02:03.990344 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:03.990310    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 17 11:02:04.018039 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:04.015799    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z"]
Sep 17 11:02:04.065390 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:04.065362    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce-openshift-service-ca\") pod \"maas-api-59f6566bbc-ghz8z\" (UID: \"84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z"
Sep 17 11:02:04.065536 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:04.065400    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce-metrics-certs\") pod \"maas-api-59f6566bbc-ghz8z\" (UID: \"84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z"
Sep 17 11:02:04.065536 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:04.065434    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lvgx\" (UniqueName: \"kubernetes.io/projected/84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce-kube-api-access-8lvgx\") pod \"maas-api-59f6566bbc-ghz8z\" (UID: \"84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z"
Sep 17 11:02:04.065536 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:04.065490    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce-maas-api-tls\") pod \"maas-api-59f6566bbc-ghz8z\" (UID: \"84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z"
Sep 17 11:02:04.166775 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:04.166746    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce-openshift-service-ca\") pod \"maas-api-59f6566bbc-ghz8z\" (UID: \"84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z"
Sep 17 11:02:04.166905 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:04.166780    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce-metrics-certs\") pod \"maas-api-59f6566bbc-ghz8z\" (UID: \"84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z"
Sep 17 11:02:04.166905 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:04.166813    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lvgx\" (UniqueName: \"kubernetes.io/projected/84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce-kube-api-access-8lvgx\") pod \"maas-api-59f6566bbc-ghz8z\" (UID: \"84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z"
Sep 17 11:02:04.166905 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:04.166878    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce-maas-api-tls\") pod \"maas-api-59f6566bbc-ghz8z\" (UID: \"84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z"
Sep 17 11:02:04.167484 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:04.167464    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce-openshift-service-ca\") pod \"maas-api-59f6566bbc-ghz8z\" (UID: \"84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z"
Sep 17 11:02:04.169267 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:04.169240    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce-metrics-certs\") pod \"maas-api-59f6566bbc-ghz8z\" (UID: \"84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z"
Sep 17 11:02:04.169357 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:04.169297    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce-maas-api-tls\") pod \"maas-api-59f6566bbc-ghz8z\" (UID: \"84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z"
Sep 17 11:02:04.176798 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:04.176775    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lvgx\" (UniqueName: \"kubernetes.io/projected/84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce-kube-api-access-8lvgx\") pod \"maas-api-59f6566bbc-ghz8z\" (UID: \"84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce\") " pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z"
Sep 17 11:02:04.292594 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:04.292570    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z"
Sep 17 11:02:04.615857 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:04.615661    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z"]
Sep 17 11:02:04.618626 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:02:04.618598    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84f3e7ad_4863_49f7_a4d6_a0a6ba0fddce.slice/crio-c27467656b34fbef8a9c6028756b973152e9ca57e6ed7ef2f2c8d52d9002c952 WatchSource:0}: Error finding container c27467656b34fbef8a9c6028756b973152e9ca57e6ed7ef2f2c8d52d9002c952: Status 404 returned error can't find the container with id c27467656b34fbef8a9c6028756b973152e9ca57e6ed7ef2f2c8d52d9002c952
Sep 17 11:02:04.835554 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:04.835493    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z" event={"ID":"84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce","Type":"ContainerStarted","Data":"c27467656b34fbef8a9c6028756b973152e9ca57e6ed7ef2f2c8d52d9002c952"}
Sep 17 11:02:06.845992 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:06.845959    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z" event={"ID":"84f3e7ad-4863-49f7-a4d6-a0a6ba0fddce","Type":"ContainerStarted","Data":"39758af2d843bb501e5bb808fd8e10eef86aef6f9efe932eda72dbaedda3ca5f"}
Sep 17 11:02:06.846346 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:06.846113    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z"
Sep 17 11:02:06.898608 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:06.898553    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z" podStartSLOduration=1.826733941 podStartE2EDuration="3.898535685s" totalImagesPullingTime="2.071801744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:02:06.895445418 +0000 UTC m=+516.690779858" watchObservedRunningTime="2026-09-17 11:02:06.898535685 +0000 UTC m=+516.693870140"
Sep 17 11:02:12.856421 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:12.856394    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59f6566bbc-ghz8z"
Sep 17 11:02:13.483663 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:13.483627    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-pgmjq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 11:02:13.483822 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:13.483694    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq" podUID="d1616799-1ec0-4cf2-948a-12c8ffaba408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 11:02:14.893909 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:14.893874    2570 generic.go:356] "Generic (PLEG): container finished" podID="d1616799-1ec0-4cf2-948a-12c8ffaba408" containerID="12e9e21a046ea3fb0276683d93597047e35e459fd2c771a759daf658ff64eb6b" exitCode=0
Sep 17 11:02:14.893909 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:14.893915    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq" event={"ID":"d1616799-1ec0-4cf2-948a-12c8ffaba408","Type":"ContainerDied","Data":"12e9e21a046ea3fb0276683d93597047e35e459fd2c771a759daf658ff64eb6b"}
Sep 17 11:02:14.894473 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:14.894372    2570 scope.go:117] "RemoveContainer" containerID="12e9e21a046ea3fb0276683d93597047e35e459fd2c771a759daf658ff64eb6b"
Sep 17 11:02:14.895346 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:14.895316    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:02:14.895428 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:14.895379    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:02:14.895428 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:14.895406    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:02:15.900852 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:15.900815    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq" event={"ID":"d1616799-1ec0-4cf2-948a-12c8ffaba408","Type":"ContainerStarted","Data":"f665ab32604837972127fbfcd934aa7bde8a5e4a2aab6e0080d26a49f870c173"}
Sep 17 11:02:16.217114 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:16.217029    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:02:16.217258 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:16.217231    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-pgmjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 17 11:02:16.217304 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:16.217281    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq" podUID="d1616799-1ec0-4cf2-948a-12c8ffaba408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 17 11:02:17.217024 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:17.216987    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-pgmjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 17 11:02:17.217381 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:17.217049    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq" podUID="d1616799-1ec0-4cf2-948a-12c8ffaba408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 17 11:02:18.216952 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:18.216917    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-pgmjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 17 11:02:18.217125 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:18.216972    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq" podUID="d1616799-1ec0-4cf2-948a-12c8ffaba408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 17 11:02:19.216905 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:19.216870    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-pgmjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 17 11:02:19.217064 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:19.216931    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq" podUID="d1616799-1ec0-4cf2-948a-12c8ffaba408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 17 11:02:20.217334 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:20.217303    2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-pgmjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 17 11:02:20.217724 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:20.217362    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq" podUID="d1616799-1ec0-4cf2-948a-12c8ffaba408" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 17 11:02:21.220199 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:21.220171    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:02:21.220601 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:21.220433    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:02:21.221042 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:21.221025    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pgmjq"
Sep 17 11:02:24.085239 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.085162    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"]
Sep 17 11:02:24.087985 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.087965    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.099067 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.099045    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 17 11:02:24.099144 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.099053    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 17 11:02:24.099452 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.099439    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 17 11:02:24.099712 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.099697    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4xkgq\""
Sep 17 11:02:24.180568 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.180542    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"]
Sep 17 11:02:24.246201 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.246174    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/786e3cea-d469-4b8e-91ae-3bf1a447f9b5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2\" (UID: \"786e3cea-d469-4b8e-91ae-3bf1a447f9b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.246333 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.246213    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4mgv\" (UniqueName: \"kubernetes.io/projected/786e3cea-d469-4b8e-91ae-3bf1a447f9b5-kube-api-access-p4mgv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2\" (UID: \"786e3cea-d469-4b8e-91ae-3bf1a447f9b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.246333 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.246265    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/786e3cea-d469-4b8e-91ae-3bf1a447f9b5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2\" (UID: \"786e3cea-d469-4b8e-91ae-3bf1a447f9b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.246333 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.246293    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/786e3cea-d469-4b8e-91ae-3bf1a447f9b5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2\" (UID: \"786e3cea-d469-4b8e-91ae-3bf1a447f9b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.246432 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.246393    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/786e3cea-d469-4b8e-91ae-3bf1a447f9b5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2\" (UID: \"786e3cea-d469-4b8e-91ae-3bf1a447f9b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.246432 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.246421    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/786e3cea-d469-4b8e-91ae-3bf1a447f9b5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2\" (UID: \"786e3cea-d469-4b8e-91ae-3bf1a447f9b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.347294 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.347223    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/786e3cea-d469-4b8e-91ae-3bf1a447f9b5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2\" (UID: \"786e3cea-d469-4b8e-91ae-3bf1a447f9b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.347294 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.347277    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/786e3cea-d469-4b8e-91ae-3bf1a447f9b5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2\" (UID: \"786e3cea-d469-4b8e-91ae-3bf1a447f9b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.347446 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.347388    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/786e3cea-d469-4b8e-91ae-3bf1a447f9b5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2\" (UID: \"786e3cea-d469-4b8e-91ae-3bf1a447f9b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.347446 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.347433    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/786e3cea-d469-4b8e-91ae-3bf1a447f9b5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2\" (UID: \"786e3cea-d469-4b8e-91ae-3bf1a447f9b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.347546 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.347483    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4mgv\" (UniqueName: \"kubernetes.io/projected/786e3cea-d469-4b8e-91ae-3bf1a447f9b5-kube-api-access-p4mgv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2\" (UID: \"786e3cea-d469-4b8e-91ae-3bf1a447f9b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.347593 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.347553    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/786e3cea-d469-4b8e-91ae-3bf1a447f9b5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2\" (UID: \"786e3cea-d469-4b8e-91ae-3bf1a447f9b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.347810 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.347779    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/786e3cea-d469-4b8e-91ae-3bf1a447f9b5-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2\" (UID: \"786e3cea-d469-4b8e-91ae-3bf1a447f9b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.347927 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.347790    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/786e3cea-d469-4b8e-91ae-3bf1a447f9b5-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2\" (UID: \"786e3cea-d469-4b8e-91ae-3bf1a447f9b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.347927 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.347862    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/786e3cea-d469-4b8e-91ae-3bf1a447f9b5-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2\" (UID: \"786e3cea-d469-4b8e-91ae-3bf1a447f9b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.349600 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.349574    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/786e3cea-d469-4b8e-91ae-3bf1a447f9b5-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2\" (UID: \"786e3cea-d469-4b8e-91ae-3bf1a447f9b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.349849 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.349831    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/786e3cea-d469-4b8e-91ae-3bf1a447f9b5-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2\" (UID: \"786e3cea-d469-4b8e-91ae-3bf1a447f9b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.356246 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.356224    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4mgv\" (UniqueName: \"kubernetes.io/projected/786e3cea-d469-4b8e-91ae-3bf1a447f9b5-kube-api-access-p4mgv\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2\" (UID: \"786e3cea-d469-4b8e-91ae-3bf1a447f9b5\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.398783 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.398759    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:24.676544 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.676437    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"]
Sep 17 11:02:24.679349 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:02:24.679322    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod786e3cea_d469_4b8e_91ae_3bf1a447f9b5.slice/crio-6ab79bc09ec0e11a11e7f11c3169140453dc5b293f61e1afc27b6acd88694ab5 WatchSource:0}: Error finding container 6ab79bc09ec0e11a11e7f11c3169140453dc5b293f61e1afc27b6acd88694ab5: Status 404 returned error can't find the container with id 6ab79bc09ec0e11a11e7f11c3169140453dc5b293f61e1afc27b6acd88694ab5
Sep 17 11:02:24.942149 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:24.942065    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2" event={"ID":"786e3cea-d469-4b8e-91ae-3bf1a447f9b5","Type":"ContainerStarted","Data":"6ab79bc09ec0e11a11e7f11c3169140453dc5b293f61e1afc27b6acd88694ab5"}
Sep 17 11:02:25.948641 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:25.948613    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2" event={"ID":"786e3cea-d469-4b8e-91ae-3bf1a447f9b5","Type":"ContainerStarted","Data":"997586e97c7f222e665e500e5cf665431bf0d05d487003a064149c73c097d405"}
Sep 17 11:02:25.984420 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:25.984377    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2" podStartSLOduration=0.814754702 podStartE2EDuration="1.984363398s" totalImagesPullingTime="1.169608696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:02:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:02:25.984004446 +0000 UTC m=+535.779338885" watchObservedRunningTime="2026-09-17 11:02:25.984363398 +0000 UTC m=+535.779697836"
Sep 17 11:02:34.399344 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:34.399307    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:34.399784 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:34.399372    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:34.411623 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:34.411597    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:35.001829 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:35.001801    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zspz2"
Sep 17 11:02:42.821983 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:42.821950    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"]
Sep 17 11:02:42.828282 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:42.828262    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:42.832026 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:42.832000    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 17 11:02:42.841440 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:42.841414    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"]
Sep 17 11:02:42.901813 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:42.901789    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ed5deac-0c8a-4d21-8e35-fb99b0d04696-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg\" (UID: \"0ed5deac-0c8a-4d21-8e35-fb99b0d04696\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:42.901945 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:42.901837    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ed5deac-0c8a-4d21-8e35-fb99b0d04696-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg\" (UID: \"0ed5deac-0c8a-4d21-8e35-fb99b0d04696\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:42.901945 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:42.901867    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2m4f\" (UniqueName: \"kubernetes.io/projected/0ed5deac-0c8a-4d21-8e35-fb99b0d04696-kube-api-access-w2m4f\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg\" (UID: \"0ed5deac-0c8a-4d21-8e35-fb99b0d04696\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:42.902038 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:42.902014    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ed5deac-0c8a-4d21-8e35-fb99b0d04696-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg\" (UID: \"0ed5deac-0c8a-4d21-8e35-fb99b0d04696\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:42.902098 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:42.902076    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ed5deac-0c8a-4d21-8e35-fb99b0d04696-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg\" (UID: \"0ed5deac-0c8a-4d21-8e35-fb99b0d04696\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:42.902147 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:42.902129    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ed5deac-0c8a-4d21-8e35-fb99b0d04696-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg\" (UID: \"0ed5deac-0c8a-4d21-8e35-fb99b0d04696\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:43.003134 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:43.003100    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ed5deac-0c8a-4d21-8e35-fb99b0d04696-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg\" (UID: \"0ed5deac-0c8a-4d21-8e35-fb99b0d04696\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:43.003272 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:43.003149    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ed5deac-0c8a-4d21-8e35-fb99b0d04696-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg\" (UID: \"0ed5deac-0c8a-4d21-8e35-fb99b0d04696\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:43.003272 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:43.003167    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2m4f\" (UniqueName: \"kubernetes.io/projected/0ed5deac-0c8a-4d21-8e35-fb99b0d04696-kube-api-access-w2m4f\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg\" (UID: \"0ed5deac-0c8a-4d21-8e35-fb99b0d04696\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:43.003272 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:43.003214    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ed5deac-0c8a-4d21-8e35-fb99b0d04696-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg\" (UID: \"0ed5deac-0c8a-4d21-8e35-fb99b0d04696\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:43.003272 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:43.003232    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ed5deac-0c8a-4d21-8e35-fb99b0d04696-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg\" (UID: \"0ed5deac-0c8a-4d21-8e35-fb99b0d04696\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:43.003272 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:43.003261    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ed5deac-0c8a-4d21-8e35-fb99b0d04696-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg\" (UID: \"0ed5deac-0c8a-4d21-8e35-fb99b0d04696\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:43.003590 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:43.003567    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0ed5deac-0c8a-4d21-8e35-fb99b0d04696-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg\" (UID: \"0ed5deac-0c8a-4d21-8e35-fb99b0d04696\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:43.003665 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:43.003647    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ed5deac-0c8a-4d21-8e35-fb99b0d04696-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg\" (UID: \"0ed5deac-0c8a-4d21-8e35-fb99b0d04696\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:43.003704 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:43.003683    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ed5deac-0c8a-4d21-8e35-fb99b0d04696-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg\" (UID: \"0ed5deac-0c8a-4d21-8e35-fb99b0d04696\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:43.005477 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:43.005458    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ed5deac-0c8a-4d21-8e35-fb99b0d04696-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg\" (UID: \"0ed5deac-0c8a-4d21-8e35-fb99b0d04696\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:43.005667 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:43.005649    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ed5deac-0c8a-4d21-8e35-fb99b0d04696-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg\" (UID: \"0ed5deac-0c8a-4d21-8e35-fb99b0d04696\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:43.012912 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:43.012891    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2m4f\" (UniqueName: \"kubernetes.io/projected/0ed5deac-0c8a-4d21-8e35-fb99b0d04696-kube-api-access-w2m4f\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg\" (UID: \"0ed5deac-0c8a-4d21-8e35-fb99b0d04696\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:43.138674 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:43.138616    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:43.418526 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:43.418489    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"]
Sep 17 11:02:43.420420 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:02:43.420390    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed5deac_0c8a_4d21_8e35_fb99b0d04696.slice/crio-a7c9a2e59734c06323e945d4528a4b18c41569a181850221971c7d1fc76ebd54 WatchSource:0}: Error finding container a7c9a2e59734c06323e945d4528a4b18c41569a181850221971c7d1fc76ebd54: Status 404 returned error can't find the container with id a7c9a2e59734c06323e945d4528a4b18c41569a181850221971c7d1fc76ebd54
Sep 17 11:02:44.035006 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:44.034158    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg" event={"ID":"0ed5deac-0c8a-4d21-8e35-fb99b0d04696","Type":"ContainerStarted","Data":"8aea58ee0c01bd096c47e0a7bc7b97151f6163a317eb981e8dcdd9d585d311b2"}
Sep 17 11:02:44.035006 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:44.034224    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg" event={"ID":"0ed5deac-0c8a-4d21-8e35-fb99b0d04696","Type":"ContainerStarted","Data":"a7c9a2e59734c06323e945d4528a4b18c41569a181850221971c7d1fc76ebd54"}
Sep 17 11:02:44.063026 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:44.062973    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg" podStartSLOduration=1.8701614709999999 podStartE2EDuration="2.062958305s" totalImagesPullingTime="192.796834ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:02:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:02:44.060970698 +0000 UTC m=+553.856305140" watchObservedRunningTime="2026-09-17 11:02:44.062958305 +0000 UTC m=+553.858292743"
Sep 17 11:02:53.139032 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:53.139002    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:53.139477 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:53.139054    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:53.151720 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:53.151699    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:02:54.098873 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:02:54.098839    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-68dtg"
Sep 17 11:03:18.226888 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.226853    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"]
Sep 17 11:03:18.231597 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.231575    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.234685 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.234664    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 17 11:03:18.241790 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.241769    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"]
Sep 17 11:03:18.389053 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.389016    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/303e008e-9b25-4430-bc8b-b5c01d2242ef-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9h2p\" (UID: \"303e008e-9b25-4430-bc8b-b5c01d2242ef\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.389221 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.389079    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/303e008e-9b25-4430-bc8b-b5c01d2242ef-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9h2p\" (UID: \"303e008e-9b25-4430-bc8b-b5c01d2242ef\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.389221 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.389150    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/303e008e-9b25-4430-bc8b-b5c01d2242ef-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9h2p\" (UID: \"303e008e-9b25-4430-bc8b-b5c01d2242ef\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.389318 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.389221    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/303e008e-9b25-4430-bc8b-b5c01d2242ef-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9h2p\" (UID: \"303e008e-9b25-4430-bc8b-b5c01d2242ef\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.389318 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.389292    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9cbl\" (UniqueName: \"kubernetes.io/projected/303e008e-9b25-4430-bc8b-b5c01d2242ef-kube-api-access-t9cbl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9h2p\" (UID: \"303e008e-9b25-4430-bc8b-b5c01d2242ef\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.389452 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.389330    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/303e008e-9b25-4430-bc8b-b5c01d2242ef-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9h2p\" (UID: \"303e008e-9b25-4430-bc8b-b5c01d2242ef\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.490367 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.490281    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9cbl\" (UniqueName: \"kubernetes.io/projected/303e008e-9b25-4430-bc8b-b5c01d2242ef-kube-api-access-t9cbl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9h2p\" (UID: \"303e008e-9b25-4430-bc8b-b5c01d2242ef\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.490367 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.490326    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/303e008e-9b25-4430-bc8b-b5c01d2242ef-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9h2p\" (UID: \"303e008e-9b25-4430-bc8b-b5c01d2242ef\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.490630 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.490372    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/303e008e-9b25-4430-bc8b-b5c01d2242ef-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9h2p\" (UID: \"303e008e-9b25-4430-bc8b-b5c01d2242ef\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.490630 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.490420    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/303e008e-9b25-4430-bc8b-b5c01d2242ef-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9h2p\" (UID: \"303e008e-9b25-4430-bc8b-b5c01d2242ef\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.490630 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.490454    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/303e008e-9b25-4430-bc8b-b5c01d2242ef-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9h2p\" (UID: \"303e008e-9b25-4430-bc8b-b5c01d2242ef\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.490630 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.490480    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/303e008e-9b25-4430-bc8b-b5c01d2242ef-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9h2p\" (UID: \"303e008e-9b25-4430-bc8b-b5c01d2242ef\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.490798 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.490785    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/303e008e-9b25-4430-bc8b-b5c01d2242ef-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9h2p\" (UID: \"303e008e-9b25-4430-bc8b-b5c01d2242ef\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.490861 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.490843    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/303e008e-9b25-4430-bc8b-b5c01d2242ef-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9h2p\" (UID: \"303e008e-9b25-4430-bc8b-b5c01d2242ef\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.490970 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.490952    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/303e008e-9b25-4430-bc8b-b5c01d2242ef-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9h2p\" (UID: \"303e008e-9b25-4430-bc8b-b5c01d2242ef\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.492780 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.492758    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/303e008e-9b25-4430-bc8b-b5c01d2242ef-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9h2p\" (UID: \"303e008e-9b25-4430-bc8b-b5c01d2242ef\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.492889 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.492873    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/303e008e-9b25-4430-bc8b-b5c01d2242ef-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9h2p\" (UID: \"303e008e-9b25-4430-bc8b-b5c01d2242ef\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.502375 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.502349    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9cbl\" (UniqueName: \"kubernetes.io/projected/303e008e-9b25-4430-bc8b-b5c01d2242ef-kube-api-access-t9cbl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9h2p\" (UID: \"303e008e-9b25-4430-bc8b-b5c01d2242ef\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.543529 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.543490    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:18.820666 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:18.820644    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"]
Sep 17 11:03:18.822971 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:03:18.822948    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod303e008e_9b25_4430_bc8b_b5c01d2242ef.slice/crio-9d0071f15ed0b2c2a6730e62f4c68566d691933d14be8479311d1092edfae2cf WatchSource:0}: Error finding container 9d0071f15ed0b2c2a6730e62f4c68566d691933d14be8479311d1092edfae2cf: Status 404 returned error can't find the container with id 9d0071f15ed0b2c2a6730e62f4c68566d691933d14be8479311d1092edfae2cf
Sep 17 11:03:19.193525 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:19.193481    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p" event={"ID":"303e008e-9b25-4430-bc8b-b5c01d2242ef","Type":"ContainerStarted","Data":"550133dcb3916467a11a3f24537bc17c522533eae19e636b28dc661c34001011"}
Sep 17 11:03:19.193668 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:19.193546    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p" event={"ID":"303e008e-9b25-4430-bc8b-b5c01d2242ef","Type":"ContainerStarted","Data":"9d0071f15ed0b2c2a6730e62f4c68566d691933d14be8479311d1092edfae2cf"}
Sep 17 11:03:19.213726 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:19.213681    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p" podStartSLOduration=1.011821934 podStartE2EDuration="1.213662573s" totalImagesPullingTime="201.840639ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:03:19.211756202 +0000 UTC m=+589.007090655" watchObservedRunningTime="2026-09-17 11:03:19.213662573 +0000 UTC m=+589.008997012"
Sep 17 11:03:28.544384 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:28.544348    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:28.544887 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:28.544402    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:28.556894 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:28.556872    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:29.250684 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:29.250656    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9h2p"
Sep 17 11:03:30.631021 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:30.630997    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 11:03:30.632358 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:30.632338    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 11:03:40.625567 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.625527    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"]
Sep 17 11:03:40.631042 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.631017    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:40.634036 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.634016    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 17 11:03:40.640449 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.640427    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"]
Sep 17 11:03:40.675332 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.675306    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqpvv\" (UniqueName: \"kubernetes.io/projected/43bebc9f-58c8-4fed-8f9a-c2d55f3988f1-kube-api-access-zqpvv\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg\" (UID: \"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:40.675449 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.675366    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43bebc9f-58c8-4fed-8f9a-c2d55f3988f1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg\" (UID: \"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:40.675553 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.675445    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43bebc9f-58c8-4fed-8f9a-c2d55f3988f1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg\" (UID: \"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:40.675553 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.675472    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43bebc9f-58c8-4fed-8f9a-c2d55f3988f1-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg\" (UID: \"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:40.675686 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.675545    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43bebc9f-58c8-4fed-8f9a-c2d55f3988f1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg\" (UID: \"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:40.675686 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.675583    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43bebc9f-58c8-4fed-8f9a-c2d55f3988f1-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg\" (UID: \"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:40.776020 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.775985    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43bebc9f-58c8-4fed-8f9a-c2d55f3988f1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg\" (UID: \"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:40.776176 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.776023    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43bebc9f-58c8-4fed-8f9a-c2d55f3988f1-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg\" (UID: \"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:40.776176 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.776047    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43bebc9f-58c8-4fed-8f9a-c2d55f3988f1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg\" (UID: \"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:40.776176 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.776155    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43bebc9f-58c8-4fed-8f9a-c2d55f3988f1-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg\" (UID: \"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:40.776355 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.776244    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqpvv\" (UniqueName: \"kubernetes.io/projected/43bebc9f-58c8-4fed-8f9a-c2d55f3988f1-kube-api-access-zqpvv\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg\" (UID: \"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:40.776355 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.776288    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43bebc9f-58c8-4fed-8f9a-c2d55f3988f1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg\" (UID: \"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:40.776485 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.776467    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43bebc9f-58c8-4fed-8f9a-c2d55f3988f1-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg\" (UID: \"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:40.776558 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.776466    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/43bebc9f-58c8-4fed-8f9a-c2d55f3988f1-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg\" (UID: \"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:40.776611 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.776566    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/43bebc9f-58c8-4fed-8f9a-c2d55f3988f1-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg\" (UID: \"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:40.778298 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.778274    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/43bebc9f-58c8-4fed-8f9a-c2d55f3988f1-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg\" (UID: \"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:40.778571 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.778556    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/43bebc9f-58c8-4fed-8f9a-c2d55f3988f1-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg\" (UID: \"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:40.785695 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.785677    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqpvv\" (UniqueName: \"kubernetes.io/projected/43bebc9f-58c8-4fed-8f9a-c2d55f3988f1-kube-api-access-zqpvv\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg\" (UID: \"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:40.940608 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:40.940526    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:41.211776 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:41.211696    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"]
Sep 17 11:03:41.214380 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:03:41.214353    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43bebc9f_58c8_4fed_8f9a_c2d55f3988f1.slice/crio-167048b08fbfbb26060c78d75b1a46b438c5a52c386712336c05f9b98ab5b700 WatchSource:0}: Error finding container 167048b08fbfbb26060c78d75b1a46b438c5a52c386712336c05f9b98ab5b700: Status 404 returned error can't find the container with id 167048b08fbfbb26060c78d75b1a46b438c5a52c386712336c05f9b98ab5b700
Sep 17 11:03:41.215723 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:41.215706    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 11:03:41.297737 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:41.297703    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg" event={"ID":"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1","Type":"ContainerStarted","Data":"167048b08fbfbb26060c78d75b1a46b438c5a52c386712336c05f9b98ab5b700"}
Sep 17 11:03:42.304455 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:42.304424    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg" event={"ID":"43bebc9f-58c8-4fed-8f9a-c2d55f3988f1","Type":"ContainerStarted","Data":"789af2c13548ac135544ac4164f0aeee25be9d20288fad473939a2699dc56132"}
Sep 17 11:03:42.329328 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:42.329282    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg" podStartSLOduration=2.114972981 podStartE2EDuration="2.329266867s" totalImagesPullingTime="214.293886ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:03:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:03:42.325696969 +0000 UTC m=+612.121031408" watchObservedRunningTime="2026-09-17 11:03:42.329266867 +0000 UTC m=+612.124601305"
Sep 17 11:03:50.941231 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:50.941195    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:50.941231 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:50.941239    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:50.953812 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:50.953787    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:03:51.367405 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:03:51.367377    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-2dnjg"
Sep 17 11:04:27.875324 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:27.875291    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8475574dc4-wphjh"]
Sep 17 11:04:27.875901 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:27.875526    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-8475574dc4-wphjh" podUID="a569feef-be6c-4ef4-9476-96589ed990e0" containerName="authorino" containerID="cri-o://212f09bb29591b9e21a4c913a502e1a6d7799874fe6c669b8a975d04846371ae" gracePeriod=30
Sep 17 11:04:28.120005 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.119984    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8475574dc4-wphjh"
Sep 17 11:04:28.253794 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.253722    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvndt\" (UniqueName: \"kubernetes.io/projected/a569feef-be6c-4ef4-9476-96589ed990e0-kube-api-access-gvndt\") pod \"a569feef-be6c-4ef4-9476-96589ed990e0\" (UID: \"a569feef-be6c-4ef4-9476-96589ed990e0\") "
Sep 17 11:04:28.253957 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.253798    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a569feef-be6c-4ef4-9476-96589ed990e0-tls-cert\") pod \"a569feef-be6c-4ef4-9476-96589ed990e0\" (UID: \"a569feef-be6c-4ef4-9476-96589ed990e0\") "
Sep 17 11:04:28.256557 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.256475    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a569feef-be6c-4ef4-9476-96589ed990e0-kube-api-access-gvndt" (OuterVolumeSpecName: "kube-api-access-gvndt") pod "a569feef-be6c-4ef4-9476-96589ed990e0" (UID: "a569feef-be6c-4ef4-9476-96589ed990e0"). InnerVolumeSpecName "kube-api-access-gvndt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:04:28.264742 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.264711    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a569feef-be6c-4ef4-9476-96589ed990e0-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a569feef-be6c-4ef4-9476-96589ed990e0" (UID: "a569feef-be6c-4ef4-9476-96589ed990e0"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:04:28.354751 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.354721    2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a569feef-be6c-4ef4-9476-96589ed990e0-tls-cert\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:04:28.354751 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.354744    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvndt\" (UniqueName: \"kubernetes.io/projected/a569feef-be6c-4ef4-9476-96589ed990e0-kube-api-access-gvndt\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:04:28.481331 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.481303    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-4ztwj"]
Sep 17 11:04:28.481584 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.481560    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-658cf9cdcf-4ztwj" podUID="6604f5d2-6a2c-41ea-a96f-6049212760f8" containerName="manager" containerID="cri-o://4a53375a41cbd2ae671d684e03e99f1c4e4cc80fb313c375749ecc08a6788891" gracePeriod=30
Sep 17 11:04:28.524958 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.524928    2570 generic.go:356] "Generic (PLEG): container finished" podID="a569feef-be6c-4ef4-9476-96589ed990e0" containerID="212f09bb29591b9e21a4c913a502e1a6d7799874fe6c669b8a975d04846371ae" exitCode=0
Sep 17 11:04:28.525086 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.524969    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8475574dc4-wphjh"
Sep 17 11:04:28.525086 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.525017    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8475574dc4-wphjh" event={"ID":"a569feef-be6c-4ef4-9476-96589ed990e0","Type":"ContainerDied","Data":"212f09bb29591b9e21a4c913a502e1a6d7799874fe6c669b8a975d04846371ae"}
Sep 17 11:04:28.525086 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.525054    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8475574dc4-wphjh" event={"ID":"a569feef-be6c-4ef4-9476-96589ed990e0","Type":"ContainerDied","Data":"9e7926550d6f181f99db7856c7de6165d85c3c4f036327545c0a7ca1dd99f2c0"}
Sep 17 11:04:28.525086 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.525069    2570 scope.go:117] "RemoveContainer" containerID="212f09bb29591b9e21a4c913a502e1a6d7799874fe6c669b8a975d04846371ae"
Sep 17 11:04:28.560269 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.560246    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8475574dc4-wphjh"]
Sep 17 11:04:28.567566 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.567541    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8475574dc4-wphjh"]
Sep 17 11:04:28.592610 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.592591    2570 scope.go:117] "RemoveContainer" containerID="212f09bb29591b9e21a4c913a502e1a6d7799874fe6c669b8a975d04846371ae"
Sep 17 11:04:28.592931 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:04:28.592913    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"212f09bb29591b9e21a4c913a502e1a6d7799874fe6c669b8a975d04846371ae\": container with ID starting with 212f09bb29591b9e21a4c913a502e1a6d7799874fe6c669b8a975d04846371ae not found: ID does not exist" containerID="212f09bb29591b9e21a4c913a502e1a6d7799874fe6c669b8a975d04846371ae"
Sep 17 11:04:28.592994 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.592940    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"212f09bb29591b9e21a4c913a502e1a6d7799874fe6c669b8a975d04846371ae"} err="failed to get container status \"212f09bb29591b9e21a4c913a502e1a6d7799874fe6c669b8a975d04846371ae\": rpc error: code = NotFound desc = could not find container \"212f09bb29591b9e21a4c913a502e1a6d7799874fe6c669b8a975d04846371ae\": container with ID starting with 212f09bb29591b9e21a4c913a502e1a6d7799874fe6c669b8a975d04846371ae not found: ID does not exist"
Sep 17 11:04:28.691899 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.691868    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a569feef-be6c-4ef4-9476-96589ed990e0" path="/var/lib/kubelet/pods/a569feef-be6c-4ef4-9476-96589ed990e0/volumes"
Sep 17 11:04:28.717672 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.717652    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-658cf9cdcf-4ztwj"
Sep 17 11:04:28.859575 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.859490    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zb5mz\" (UniqueName: \"kubernetes.io/projected/6604f5d2-6a2c-41ea-a96f-6049212760f8-kube-api-access-zb5mz\") pod \"6604f5d2-6a2c-41ea-a96f-6049212760f8\" (UID: \"6604f5d2-6a2c-41ea-a96f-6049212760f8\") "
Sep 17 11:04:28.859575 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.859563    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6604f5d2-6a2c-41ea-a96f-6049212760f8-webhook-cert\") pod \"6604f5d2-6a2c-41ea-a96f-6049212760f8\" (UID: \"6604f5d2-6a2c-41ea-a96f-6049212760f8\") "
Sep 17 11:04:28.859792 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.859623    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6604f5d2-6a2c-41ea-a96f-6049212760f8-metrics-certs\") pod \"6604f5d2-6a2c-41ea-a96f-6049212760f8\" (UID: \"6604f5d2-6a2c-41ea-a96f-6049212760f8\") "
Sep 17 11:04:28.861592 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.861553    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6604f5d2-6a2c-41ea-a96f-6049212760f8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6604f5d2-6a2c-41ea-a96f-6049212760f8" (UID: "6604f5d2-6a2c-41ea-a96f-6049212760f8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:04:28.861890 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.861867    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6604f5d2-6a2c-41ea-a96f-6049212760f8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6604f5d2-6a2c-41ea-a96f-6049212760f8" (UID: "6604f5d2-6a2c-41ea-a96f-6049212760f8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:04:28.861974 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.861899    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6604f5d2-6a2c-41ea-a96f-6049212760f8-kube-api-access-zb5mz" (OuterVolumeSpecName: "kube-api-access-zb5mz") pod "6604f5d2-6a2c-41ea-a96f-6049212760f8" (UID: "6604f5d2-6a2c-41ea-a96f-6049212760f8"). InnerVolumeSpecName "kube-api-access-zb5mz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:04:28.960637 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.960610    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6604f5d2-6a2c-41ea-a96f-6049212760f8-webhook-cert\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:04:28.960637 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.960634    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6604f5d2-6a2c-41ea-a96f-6049212760f8-metrics-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:04:28.960971 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:28.960645    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb5mz\" (UniqueName: \"kubernetes.io/projected/6604f5d2-6a2c-41ea-a96f-6049212760f8-kube-api-access-zb5mz\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:04:29.531602 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.531565    2570 generic.go:356] "Generic (PLEG): container finished" podID="6604f5d2-6a2c-41ea-a96f-6049212760f8" containerID="4a53375a41cbd2ae671d684e03e99f1c4e4cc80fb313c375749ecc08a6788891" exitCode=0
Sep 17 11:04:29.531771 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.531608    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-658cf9cdcf-4ztwj"
Sep 17 11:04:29.531771 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.531623    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-658cf9cdcf-4ztwj" event={"ID":"6604f5d2-6a2c-41ea-a96f-6049212760f8","Type":"ContainerDied","Data":"4a53375a41cbd2ae671d684e03e99f1c4e4cc80fb313c375749ecc08a6788891"}
Sep 17 11:04:29.531771 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.531672    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-658cf9cdcf-4ztwj" event={"ID":"6604f5d2-6a2c-41ea-a96f-6049212760f8","Type":"ContainerDied","Data":"cd59cc33fe1faa1d71fb94d3c5311a50887652b6ea873a4b02ad6013b501ea6f"}
Sep 17 11:04:29.531771 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.531696    2570 scope.go:117] "RemoveContainer" containerID="4a53375a41cbd2ae671d684e03e99f1c4e4cc80fb313c375749ecc08a6788891"
Sep 17 11:04:29.540146 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.540127    2570 scope.go:117] "RemoveContainer" containerID="4a53375a41cbd2ae671d684e03e99f1c4e4cc80fb313c375749ecc08a6788891"
Sep 17 11:04:29.540433 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:04:29.540416    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a53375a41cbd2ae671d684e03e99f1c4e4cc80fb313c375749ecc08a6788891\": container with ID starting with 4a53375a41cbd2ae671d684e03e99f1c4e4cc80fb313c375749ecc08a6788891 not found: ID does not exist" containerID="4a53375a41cbd2ae671d684e03e99f1c4e4cc80fb313c375749ecc08a6788891"
Sep 17 11:04:29.540494 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.540446    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a53375a41cbd2ae671d684e03e99f1c4e4cc80fb313c375749ecc08a6788891"} err="failed to get container status \"4a53375a41cbd2ae671d684e03e99f1c4e4cc80fb313c375749ecc08a6788891\": rpc error: code = NotFound desc = could not find container \"4a53375a41cbd2ae671d684e03e99f1c4e4cc80fb313c375749ecc08a6788891\": container with ID starting with 4a53375a41cbd2ae671d684e03e99f1c4e4cc80fb313c375749ecc08a6788891 not found: ID does not exist"
Sep 17 11:04:29.556411 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.556380    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-4ztwj"]
Sep 17 11:04:29.568006 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.567974    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-4ztwj"]
Sep 17 11:04:29.575040 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.575019    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-xdjh4"]
Sep 17 11:04:29.575386 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.575374    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a569feef-be6c-4ef4-9476-96589ed990e0" containerName="authorino"
Sep 17 11:04:29.575424 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.575389    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a569feef-be6c-4ef4-9476-96589ed990e0" containerName="authorino"
Sep 17 11:04:29.575424 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.575397    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6604f5d2-6a2c-41ea-a96f-6049212760f8" containerName="manager"
Sep 17 11:04:29.575424 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.575402    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6604f5d2-6a2c-41ea-a96f-6049212760f8" containerName="manager"
Sep 17 11:04:29.575535 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.575479    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a569feef-be6c-4ef4-9476-96589ed990e0" containerName="authorino"
Sep 17 11:04:29.575535 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.575488    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6604f5d2-6a2c-41ea-a96f-6049212760f8" containerName="manager"
Sep 17 11:04:29.579670 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.579657    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-658cf9cdcf-xdjh4"
Sep 17 11:04:29.582398 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.582379    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 11:04:29.582486 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.582458    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 11:04:29.582674 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.582659    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tj882\""
Sep 17 11:04:29.582674 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.582667    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 11:04:29.595653 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.595632    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-xdjh4"]
Sep 17 11:04:29.667499 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.667473    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09937e0c-545e-4e16-86f3-2f2e33bc1e11-webhook-cert\") pod \"maas-controller-658cf9cdcf-xdjh4\" (UID: \"09937e0c-545e-4e16-86f3-2f2e33bc1e11\") " pod="opendatahub/maas-controller-658cf9cdcf-xdjh4"
Sep 17 11:04:29.667656 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.667588    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8nfv\" (UniqueName: \"kubernetes.io/projected/09937e0c-545e-4e16-86f3-2f2e33bc1e11-kube-api-access-w8nfv\") pod \"maas-controller-658cf9cdcf-xdjh4\" (UID: \"09937e0c-545e-4e16-86f3-2f2e33bc1e11\") " pod="opendatahub/maas-controller-658cf9cdcf-xdjh4"
Sep 17 11:04:29.667718 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.667664    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09937e0c-545e-4e16-86f3-2f2e33bc1e11-metrics-certs\") pod \"maas-controller-658cf9cdcf-xdjh4\" (UID: \"09937e0c-545e-4e16-86f3-2f2e33bc1e11\") " pod="opendatahub/maas-controller-658cf9cdcf-xdjh4"
Sep 17 11:04:29.768961 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.768932    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8nfv\" (UniqueName: \"kubernetes.io/projected/09937e0c-545e-4e16-86f3-2f2e33bc1e11-kube-api-access-w8nfv\") pod \"maas-controller-658cf9cdcf-xdjh4\" (UID: \"09937e0c-545e-4e16-86f3-2f2e33bc1e11\") " pod="opendatahub/maas-controller-658cf9cdcf-xdjh4"
Sep 17 11:04:29.769079 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.768975    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09937e0c-545e-4e16-86f3-2f2e33bc1e11-metrics-certs\") pod \"maas-controller-658cf9cdcf-xdjh4\" (UID: \"09937e0c-545e-4e16-86f3-2f2e33bc1e11\") " pod="opendatahub/maas-controller-658cf9cdcf-xdjh4"
Sep 17 11:04:29.769079 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.769020    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09937e0c-545e-4e16-86f3-2f2e33bc1e11-webhook-cert\") pod \"maas-controller-658cf9cdcf-xdjh4\" (UID: \"09937e0c-545e-4e16-86f3-2f2e33bc1e11\") " pod="opendatahub/maas-controller-658cf9cdcf-xdjh4"
Sep 17 11:04:29.771542 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.771496    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09937e0c-545e-4e16-86f3-2f2e33bc1e11-metrics-certs\") pod \"maas-controller-658cf9cdcf-xdjh4\" (UID: \"09937e0c-545e-4e16-86f3-2f2e33bc1e11\") " pod="opendatahub/maas-controller-658cf9cdcf-xdjh4"
Sep 17 11:04:29.771542 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.771535    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09937e0c-545e-4e16-86f3-2f2e33bc1e11-webhook-cert\") pod \"maas-controller-658cf9cdcf-xdjh4\" (UID: \"09937e0c-545e-4e16-86f3-2f2e33bc1e11\") " pod="opendatahub/maas-controller-658cf9cdcf-xdjh4"
Sep 17 11:04:29.778943 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.778923    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8nfv\" (UniqueName: \"kubernetes.io/projected/09937e0c-545e-4e16-86f3-2f2e33bc1e11-kube-api-access-w8nfv\") pod \"maas-controller-658cf9cdcf-xdjh4\" (UID: \"09937e0c-545e-4e16-86f3-2f2e33bc1e11\") " pod="opendatahub/maas-controller-658cf9cdcf-xdjh4"
Sep 17 11:04:29.889237 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:29.889177    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-658cf9cdcf-xdjh4"
Sep 17 11:04:30.166474 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:30.165298    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-xdjh4"]
Sep 17 11:04:30.537783 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:30.537746    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-658cf9cdcf-xdjh4" event={"ID":"09937e0c-545e-4e16-86f3-2f2e33bc1e11","Type":"ContainerStarted","Data":"442fcad61c6a1fa722f4a2cadcb263f91a54483bf631e27e41a1bdc63208ae1d"}
Sep 17 11:04:30.690309 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:30.690285    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6604f5d2-6a2c-41ea-a96f-6049212760f8" path="/var/lib/kubelet/pods/6604f5d2-6a2c-41ea-a96f-6049212760f8/volumes"
Sep 17 11:04:30.794294 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:30.794274    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 11:04:31.545325 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:31.545291    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-658cf9cdcf-xdjh4" event={"ID":"09937e0c-545e-4e16-86f3-2f2e33bc1e11","Type":"ContainerStarted","Data":"726d8e231389dd373e9374b992d9149e4f53653f0eb167d43faec5d514fb75da"}
Sep 17 11:04:31.545729 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:31.545432    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-658cf9cdcf-xdjh4"
Sep 17 11:04:31.565214 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:31.565166    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-658cf9cdcf-xdjh4" podStartSLOduration=1.9416267569999999 podStartE2EDuration="2.565150798s" totalImagesPullingTime="623.524041ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:04:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:04:31.563857925 +0000 UTC m=+661.359192364" watchObservedRunningTime="2026-09-17 11:04:31.565150798 +0000 UTC m=+661.360485236"
Sep 17 11:04:42.552645 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:04:42.552614    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-658cf9cdcf-xdjh4"
Sep 17 11:05:33.066076 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.065991    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"]
Sep 17 11:05:33.069498 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.069473    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.082882 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.082862    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-d7b97f-openshift-default-dockercfg-tckvd\""
Sep 17 11:05:33.104235 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.104210    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"]
Sep 17 11:05:33.190181 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.190144    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-credential-socket\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.190346 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.190189    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-envoy\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.190346 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.190214    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-token\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.190346 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.190283    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-data\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.190346 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.190308    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-podinfo\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.190533 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.190394    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-workload-socket\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.190533 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.190420    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-workload-certs\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.190533 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.190439    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istiod-ca-cert\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.190533 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.190459    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkrgq\" (UniqueName: \"kubernetes.io/projected/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-kube-api-access-pkrgq\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.291927 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.291896    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-workload-socket\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.291927 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.291928    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-workload-certs\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.292152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.291950    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istiod-ca-cert\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.292152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.291998    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkrgq\" (UniqueName: \"kubernetes.io/projected/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-kube-api-access-pkrgq\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.292152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.292115    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-credential-socket\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.292152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.292143    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-envoy\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.292382 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.292166    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-token\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.292382 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.292214    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-data\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.292382 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.292241    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-podinfo\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.292382 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.292342    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-workload-socket\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.292625 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.292412    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-workload-certs\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.292625 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.292444    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-credential-socket\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.292740 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.292628    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-data\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.292740 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.292731    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istiod-ca-cert\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.294817 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.294796    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-envoy\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.294913 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.294860    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-podinfo\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.321901 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.321850    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkrgq\" (UniqueName: \"kubernetes.io/projected/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-kube-api-access-pkrgq\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.324866 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.324845    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-token\") pod \"e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") " pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.379213 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.379180    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:33.668297 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.668255    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"]
Sep 17 11:05:33.671531 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:05:33.671483    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ad3ce73_73d6_4a5e_ae1c_83670b7abdf4.slice/crio-61fca212cec87bac90a8ac5ad5a312d35afb6523fe72cec1b18e230e730ec26c WatchSource:0}: Error finding container 61fca212cec87bac90a8ac5ad5a312d35afb6523fe72cec1b18e230e730ec26c: Status 404 returned error can't find the container with id 61fca212cec87bac90a8ac5ad5a312d35afb6523fe72cec1b18e230e730ec26c
Sep 17 11:05:33.673794 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.673761    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:05:33.673897 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.673823    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:05:33.673897 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.673851    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:05:33.834582 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.834540    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z" event={"ID":"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4","Type":"ContainerStarted","Data":"fdf2eb113e21d97ddf1e1a14b52565b624c30dfb97dd9199f89cd8d1f2005994"}
Sep 17 11:05:33.835021 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.834609    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z" event={"ID":"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4","Type":"ContainerStarted","Data":"61fca212cec87bac90a8ac5ad5a312d35afb6523fe72cec1b18e230e730ec26c"}
Sep 17 11:05:33.878579 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:33.878503    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z" podStartSLOduration=0.878482226 podStartE2EDuration="878.482226ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:05:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:05:33.875945766 +0000 UTC m=+723.671280230" watchObservedRunningTime="2026-09-17 11:05:33.878482226 +0000 UTC m=+723.673816667"
Sep 17 11:05:34.380102 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:34.380072    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:34.385204 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:34.385178    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:34.839471 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:34.839441    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:34.840409 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:34.840384    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:38.034819 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:38.034783    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"]
Sep 17 11:05:38.038260 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:38.038242    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"
Sep 17 11:05:38.042375 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:38.042351    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gvplj\""
Sep 17 11:05:38.042616 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:38.042602    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-d7b97f-serving-cert\""
Sep 17 11:05:38.080443 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:38.080418    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"]
Sep 17 11:05:38.135189 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:38.135071    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7lvd\" (UniqueName: \"kubernetes.io/projected/de8267ad-49f7-4423-8ea9-d97a132cfc63-kube-api-access-h7lvd\") pod \"maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq\" (UID: \"de8267ad-49f7-4423-8ea9-d97a132cfc63\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"
Sep 17 11:05:38.135407 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:38.135381    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de8267ad-49f7-4423-8ea9-d97a132cfc63-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq\" (UID: \"de8267ad-49f7-4423-8ea9-d97a132cfc63\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"
Sep 17 11:05:38.135600 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:38.135568    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de8267ad-49f7-4423-8ea9-d97a132cfc63-metrics-certs\") pod \"maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq\" (UID: \"de8267ad-49f7-4423-8ea9-d97a132cfc63\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"
Sep 17 11:05:38.135736 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:38.135618    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de8267ad-49f7-4423-8ea9-d97a132cfc63-maas-api-tls\") pod \"maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq\" (UID: \"de8267ad-49f7-4423-8ea9-d97a132cfc63\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"
Sep 17 11:05:38.237002 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:38.236963    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de8267ad-49f7-4423-8ea9-d97a132cfc63-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq\" (UID: \"de8267ad-49f7-4423-8ea9-d97a132cfc63\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"
Sep 17 11:05:38.237153 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:38.237020    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de8267ad-49f7-4423-8ea9-d97a132cfc63-metrics-certs\") pod \"maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq\" (UID: \"de8267ad-49f7-4423-8ea9-d97a132cfc63\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"
Sep 17 11:05:38.237153 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:38.237043    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de8267ad-49f7-4423-8ea9-d97a132cfc63-maas-api-tls\") pod \"maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq\" (UID: \"de8267ad-49f7-4423-8ea9-d97a132cfc63\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"
Sep 17 11:05:38.237153 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:38.237077    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7lvd\" (UniqueName: \"kubernetes.io/projected/de8267ad-49f7-4423-8ea9-d97a132cfc63-kube-api-access-h7lvd\") pod \"maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq\" (UID: \"de8267ad-49f7-4423-8ea9-d97a132cfc63\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"
Sep 17 11:05:38.237295 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:05:38.237226    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-serving-cert: secret "maas-api-e2e-worker-w0-d7b97f-serving-cert" not found
Sep 17 11:05:38.237339 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:05:38.237302    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de8267ad-49f7-4423-8ea9-d97a132cfc63-maas-api-tls podName:de8267ad-49f7-4423-8ea9-d97a132cfc63 nodeName:}" failed. No retries permitted until 2026-09-17 11:05:38.73728136 +0000 UTC m=+728.532615780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/de8267ad-49f7-4423-8ea9-d97a132cfc63-maas-api-tls") pod "maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq" (UID: "de8267ad-49f7-4423-8ea9-d97a132cfc63") : secret "maas-api-e2e-worker-w0-d7b97f-serving-cert" not found
Sep 17 11:05:38.237742 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:38.237719    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de8267ad-49f7-4423-8ea9-d97a132cfc63-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq\" (UID: \"de8267ad-49f7-4423-8ea9-d97a132cfc63\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"
Sep 17 11:05:38.239744 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:38.239718    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de8267ad-49f7-4423-8ea9-d97a132cfc63-metrics-certs\") pod \"maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq\" (UID: \"de8267ad-49f7-4423-8ea9-d97a132cfc63\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"
Sep 17 11:05:38.259634 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:38.259608    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7lvd\" (UniqueName: \"kubernetes.io/projected/de8267ad-49f7-4423-8ea9-d97a132cfc63-kube-api-access-h7lvd\") pod \"maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq\" (UID: \"de8267ad-49f7-4423-8ea9-d97a132cfc63\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"
Sep 17 11:05:38.741394 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:38.741362    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de8267ad-49f7-4423-8ea9-d97a132cfc63-maas-api-tls\") pod \"maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq\" (UID: \"de8267ad-49f7-4423-8ea9-d97a132cfc63\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"
Sep 17 11:05:38.743660 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:38.743636    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de8267ad-49f7-4423-8ea9-d97a132cfc63-maas-api-tls\") pod \"maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq\" (UID: \"de8267ad-49f7-4423-8ea9-d97a132cfc63\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"
Sep 17 11:05:38.949026 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:38.948996    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"
Sep 17 11:05:39.229628 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:39.229597    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"]
Sep 17 11:05:39.230753 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:05:39.230722    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde8267ad_49f7_4423_8ea9_d97a132cfc63.slice/crio-341bcf3e1dad308e5f4a1f7caafbdab577b4e75848687a5c7eee55c2d64ebf4f WatchSource:0}: Error finding container 341bcf3e1dad308e5f4a1f7caafbdab577b4e75848687a5c7eee55c2d64ebf4f: Status 404 returned error can't find the container with id 341bcf3e1dad308e5f4a1f7caafbdab577b4e75848687a5c7eee55c2d64ebf4f
Sep 17 11:05:39.826548 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:39.826521    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"]
Sep 17 11:05:39.831389 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:39.831368    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"
Sep 17 11:05:39.834469 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:39.834451    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-79a70a-serving-cert\""
Sep 17 11:05:39.857766 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:39.857739    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"]
Sep 17 11:05:39.869563 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:39.869536    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq" event={"ID":"de8267ad-49f7-4423-8ea9-d97a132cfc63","Type":"ContainerStarted","Data":"341bcf3e1dad308e5f4a1f7caafbdab577b4e75848687a5c7eee55c2d64ebf4f"}
Sep 17 11:05:39.951938 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:39.951900    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-openshift-service-ca\") pod \"maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv\" (UID: \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"
Sep 17 11:05:39.952350 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:39.952273    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9whcx\" (UniqueName: \"kubernetes.io/projected/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-kube-api-access-9whcx\") pod \"maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv\" (UID: \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"
Sep 17 11:05:39.952502 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:39.952485    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-metrics-certs\") pod \"maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv\" (UID: \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"
Sep 17 11:05:39.952729 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:39.952712    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-maas-api-tls\") pod \"maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv\" (UID: \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"
Sep 17 11:05:40.054019 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:40.053929    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9whcx\" (UniqueName: \"kubernetes.io/projected/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-kube-api-access-9whcx\") pod \"maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv\" (UID: \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"
Sep 17 11:05:40.054019 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:40.053980    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-metrics-certs\") pod \"maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv\" (UID: \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"
Sep 17 11:05:40.054237 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:40.054021    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-maas-api-tls\") pod \"maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv\" (UID: \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"
Sep 17 11:05:40.054237 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:40.054079    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-openshift-service-ca\") pod \"maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv\" (UID: \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"
Sep 17 11:05:40.054397 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:05:40.054373    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-serving-cert: secret "maas-api-e2e-inf-a-79a70a-serving-cert" not found
Sep 17 11:05:40.054463 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:05:40.054452    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-maas-api-tls podName:dc3fba0e-cc5b-43cc-b95b-a54616a942f4 nodeName:}" failed. No retries permitted until 2026-09-17 11:05:40.55443269 +0000 UTC m=+730.349767113 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-maas-api-tls") pod "maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv" (UID: "dc3fba0e-cc5b-43cc-b95b-a54616a942f4") : secret "maas-api-e2e-inf-a-79a70a-serving-cert" not found
Sep 17 11:05:40.054892 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:40.054867    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-openshift-service-ca\") pod \"maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv\" (UID: \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"
Sep 17 11:05:40.056815 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:40.056795    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-metrics-certs\") pod \"maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv\" (UID: \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"
Sep 17 11:05:40.080825 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:40.080801    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9whcx\" (UniqueName: \"kubernetes.io/projected/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-kube-api-access-9whcx\") pod \"maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv\" (UID: \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"
Sep 17 11:05:40.559667 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:40.559631    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-maas-api-tls\") pod \"maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv\" (UID: \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"
Sep 17 11:05:40.562862 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:40.562835    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-maas-api-tls\") pod \"maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv\" (UID: \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"
Sep 17 11:05:40.752069 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:40.752038    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"
Sep 17 11:05:40.875839 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:40.875683    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq" event={"ID":"de8267ad-49f7-4423-8ea9-d97a132cfc63","Type":"ContainerStarted","Data":"95d4bf765db03e15bc0e6995339c598f666dc36e5e909f6e87a9c312767349cf"}
Sep 17 11:05:40.875839 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:40.875759    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"
Sep 17 11:05:40.904268 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:40.904215    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq" podStartSLOduration=2.342685081 podStartE2EDuration="2.904195819s" totalImagesPullingTime="561.510738ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:05:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:05:40.902277373 +0000 UTC m=+730.697611824" watchObservedRunningTime="2026-09-17 11:05:40.904195819 +0000 UTC m=+730.699530261"
Sep 17 11:05:41.041552 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.041505    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"]
Sep 17 11:05:41.042561 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:05:41.042534    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc3fba0e_cc5b_43cc_b95b_a54616a942f4.slice/crio-bbfd14843ce5851d9832f408337d27544801b39e99333750ab8d8fdb83043c55 WatchSource:0}: Error finding container bbfd14843ce5851d9832f408337d27544801b39e99333750ab8d8fdb83043c55: Status 404 returned error can't find the container with id bbfd14843ce5851d9832f408337d27544801b39e99333750ab8d8fdb83043c55
Sep 17 11:05:41.292535 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.292478    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"]
Sep 17 11:05:41.297638 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.297615    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"
Sep 17 11:05:41.301140 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.301118    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-766cc3-serving-cert\""
Sep 17 11:05:41.309321 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.309299    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"]
Sep 17 11:05:41.467213 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.467180    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-maas-api-tls\") pod \"maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm\" (UID: \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"
Sep 17 11:05:41.467355 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.467247    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvrvb\" (UniqueName: \"kubernetes.io/projected/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-kube-api-access-gvrvb\") pod \"maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm\" (UID: \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"
Sep 17 11:05:41.467407 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.467352    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-metrics-certs\") pod \"maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm\" (UID: \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"
Sep 17 11:05:41.467407 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.467388    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm\" (UID: \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"
Sep 17 11:05:41.568544 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.568488    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-metrics-certs\") pod \"maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm\" (UID: \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"
Sep 17 11:05:41.568544 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.568535    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm\" (UID: \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"
Sep 17 11:05:41.568991 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.568724    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-maas-api-tls\") pod \"maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm\" (UID: \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"
Sep 17 11:05:41.568991 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.568861    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvrvb\" (UniqueName: \"kubernetes.io/projected/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-kube-api-access-gvrvb\") pod \"maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm\" (UID: \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"
Sep 17 11:05:41.569214 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.569196    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm\" (UID: \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"
Sep 17 11:05:41.571323 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.571297    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-metrics-certs\") pod \"maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm\" (UID: \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"
Sep 17 11:05:41.571436 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.571393    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-maas-api-tls\") pod \"maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm\" (UID: \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"
Sep 17 11:05:41.599213 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.599189    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvrvb\" (UniqueName: \"kubernetes.io/projected/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-kube-api-access-gvrvb\") pod \"maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm\" (UID: \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"
Sep 17 11:05:41.609999 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.609979    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"
Sep 17 11:05:41.881719 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.881629    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv" event={"ID":"dc3fba0e-cc5b-43cc-b95b-a54616a942f4","Type":"ContainerStarted","Data":"e797aee18929d89c047708e7af834de23d06d82f593ff8bd9a05c2b634cef09f"}
Sep 17 11:05:41.881719 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.881710    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv" event={"ID":"dc3fba0e-cc5b-43cc-b95b-a54616a942f4","Type":"ContainerStarted","Data":"bbfd14843ce5851d9832f408337d27544801b39e99333750ab8d8fdb83043c55"}
Sep 17 11:05:41.881918 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.881842    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"
Sep 17 11:05:41.895743 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.895664    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"]
Sep 17 11:05:41.897816 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:05:41.897795    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83776c7b_ca6d_4e7d_8d29_2bf7a25c3a96.slice/crio-5d04339cb200bcd0c151835abb3f56f3b4d921a85088634b7e9a53b6832555a1 WatchSource:0}: Error finding container 5d04339cb200bcd0c151835abb3f56f3b4d921a85088634b7e9a53b6832555a1: Status 404 returned error can't find the container with id 5d04339cb200bcd0c151835abb3f56f3b4d921a85088634b7e9a53b6832555a1
Sep 17 11:05:41.909942 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:41.909897    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv" podStartSLOduration=2.425949069 podStartE2EDuration="2.909882264s" totalImagesPullingTime="483.933195ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:05:41.908321776 +0000 UTC m=+731.703656215" watchObservedRunningTime="2026-09-17 11:05:41.909882264 +0000 UTC m=+731.705216702"
Sep 17 11:05:42.888423 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:42.888386    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm" event={"ID":"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96","Type":"ContainerStarted","Data":"f8f55f3f87e438a612ae4ddd16d55334ec6d2607647dd57521992bda5c78495e"}
Sep 17 11:05:42.888909 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:42.888448    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm" event={"ID":"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96","Type":"ContainerStarted","Data":"5d04339cb200bcd0c151835abb3f56f3b4d921a85088634b7e9a53b6832555a1"}
Sep 17 11:05:42.888909 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:42.888531    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"
Sep 17 11:05:42.919779 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:42.919723    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm" podStartSLOduration=1.553201537 podStartE2EDuration="1.919703832s" totalImagesPullingTime="366.502295ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:05:42.919443554 +0000 UTC m=+732.714777995" watchObservedRunningTime="2026-09-17 11:05:42.919703832 +0000 UTC m=+732.715038271"
Sep 17 11:05:46.887834 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:46.887808    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"
Sep 17 11:05:47.894701 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:47.894672    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"
Sep 17 11:05:48.902649 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:48.902620    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"
Sep 17 11:05:50.881701 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:50.881658    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 11:05:50.882071 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:50.881736    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z" podUID="6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 11:05:52.941893 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:52.941804    2570 generic.go:356] "Generic (PLEG): container finished" podID="6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" containerID="fdf2eb113e21d97ddf1e1a14b52565b624c30dfb97dd9199f89cd8d1f2005994" exitCode=0
Sep 17 11:05:52.941893 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:52.941873    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z" event={"ID":"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4","Type":"ContainerDied","Data":"fdf2eb113e21d97ddf1e1a14b52565b624c30dfb97dd9199f89cd8d1f2005994"}
Sep 17 11:05:52.942329 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:52.942298    2570 scope.go:117] "RemoveContainer" containerID="fdf2eb113e21d97ddf1e1a14b52565b624c30dfb97dd9199f89cd8d1f2005994"
Sep 17 11:05:52.943453 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:52.943423    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:05:52.943551 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:52.943532    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:05:52.943600 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:52.943574    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:05:53.949450 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:53.949415    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z" event={"ID":"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4","Type":"ContainerStarted","Data":"e4e5650725c0058d429d3b4b7508daed764b40c9ff3149028bfb697073d8b434"}
Sep 17 11:05:54.379796 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:54.379754    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:54.379975 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:54.379955    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 17 11:05:54.380039 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:54.380002    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z" podUID="6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 17 11:05:55.379706 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:55.379671    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 17 11:05:55.380107 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:55.379739    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z" podUID="6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 17 11:05:56.380110 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:56.380069    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 17 11:05:56.380521 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:56.380126    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z" podUID="6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 17 11:05:57.380560 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:57.380090    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 17 11:05:57.380560 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:57.380156    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z" podUID="6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 17 11:05:58.379615 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:58.379576    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 17 11:05:58.379804 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:58.379641    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z" podUID="6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 17 11:05:59.383584 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:59.383551    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:59.383973 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:59.383899    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:05:59.384629 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:05:59.384607    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:06:07.904704 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:07.904672    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"]
Sep 17 11:06:07.907433 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:07.907411    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:07.911040 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:07.911016    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-c10e0b-openshift-default-dockercfg-t744f\""
Sep 17 11:06:07.928483 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:07.928453    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"]
Sep 17 11:06:08.023578 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.023528    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-workload-socket\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.023793 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.023607    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-credential-socket\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.023793 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.023638    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-data\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.023793 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.023735    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-workload-certs\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.023976 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.023789    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-podinfo\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.023976 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.023859    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-token\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.023976 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.023931    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-envoy\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.024145 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.024011    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istiod-ca-cert\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.024145 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.024053    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsdxx\" (UniqueName: \"kubernetes.io/projected/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-kube-api-access-fsdxx\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.125203 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.125164    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istiod-ca-cert\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.125203 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.125210    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsdxx\" (UniqueName: \"kubernetes.io/projected/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-kube-api-access-fsdxx\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.125493 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.125245    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-workload-socket\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.125493 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.125277    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-credential-socket\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.125493 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.125291    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-data\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.125493 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.125317    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-workload-certs\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.125493 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.125338    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-podinfo\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.125493 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.125355    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-token\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.125493 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.125409    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-envoy\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.125914 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.125787    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-credential-socket\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.125914 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.125823    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-workload-socket\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.125914 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.125902    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-workload-certs\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.126051 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.126032    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istiod-ca-cert\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.126194 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.126177    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-data\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.127751 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.127733    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-envoy\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.127956 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.127932    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-podinfo\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.141175 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.141144    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-token\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.142068 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.142040    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsdxx\" (UniqueName: \"kubernetes.io/projected/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-kube-api-access-fsdxx\") pod \"e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") " pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.217959 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.217863    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:08.562186 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.562160    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"]
Sep 17 11:06:08.562649 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:06:08.562623    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod710a9a8c_a0a6_449d_a816_8a32bbf1a65b.slice/crio-92f041737c52cb7eedc3b5367e6f2e2562a907340f2d09504db069f1aa8b06b3 WatchSource:0}: Error finding container 92f041737c52cb7eedc3b5367e6f2e2562a907340f2d09504db069f1aa8b06b3: Status 404 returned error can't find the container with id 92f041737c52cb7eedc3b5367e6f2e2562a907340f2d09504db069f1aa8b06b3
Sep 17 11:06:08.567417 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.567368    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:06:08.567477 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.567452    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:06:08.567537 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:08.567481    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:06:09.038711 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:09.038671    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf" event={"ID":"710a9a8c-a0a6-449d-a816-8a32bbf1a65b","Type":"ContainerStarted","Data":"f7853af9ad90e3c5615a35caf1ecd70db7a3c9da8ffc37da4803140183d4fb60"}
Sep 17 11:06:09.039091 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:09.038756    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf" event={"ID":"710a9a8c-a0a6-449d-a816-8a32bbf1a65b","Type":"ContainerStarted","Data":"92f041737c52cb7eedc3b5367e6f2e2562a907340f2d09504db069f1aa8b06b3"}
Sep 17 11:06:09.104582 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:09.104527    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf" podStartSLOduration=2.104498745 podStartE2EDuration="2.104498745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:06:09.102648292 +0000 UTC m=+758.897982733" watchObservedRunningTime="2026-09-17 11:06:09.104498745 +0000 UTC m=+758.899833183"
Sep 17 11:06:09.218343 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:09.218296    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:09.229665 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:09.229632    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:10.044319 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:10.044286    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:10.045340 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:10.045320    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:31.163266 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:31.163153    2570 generic.go:356] "Generic (PLEG): container finished" podID="710a9a8c-a0a6-449d-a816-8a32bbf1a65b" containerID="f7853af9ad90e3c5615a35caf1ecd70db7a3c9da8ffc37da4803140183d4fb60" exitCode=0
Sep 17 11:06:31.163266 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:31.163229    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf" event={"ID":"710a9a8c-a0a6-449d-a816-8a32bbf1a65b","Type":"ContainerDied","Data":"f7853af9ad90e3c5615a35caf1ecd70db7a3c9da8ffc37da4803140183d4fb60"}
Sep 17 11:06:31.163853 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:31.163777    2570 scope.go:117] "RemoveContainer" containerID="f7853af9ad90e3c5615a35caf1ecd70db7a3c9da8ffc37da4803140183d4fb60"
Sep 17 11:06:31.164963 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:31.164936    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:06:31.165034 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:31.165022    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:06:31.165074 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:31.165058    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:06:32.175252 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:32.175204    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf" event={"ID":"710a9a8c-a0a6-449d-a816-8a32bbf1a65b","Type":"ContainerStarted","Data":"8d0f1b028876f16da98588083a25622e62002c78918f03249f00b935fce41b1d"}
Sep 17 11:06:32.218582 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:32.218548    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:32.218779 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:32.218753    2570 patch_prober.go:28] interesting pod/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 17 11:06:32.218858 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:32.218809    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf" podUID="710a9a8c-a0a6-449d-a816-8a32bbf1a65b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 17 11:06:33.218500 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:33.218464    2570 patch_prober.go:28] interesting pod/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 17 11:06:33.218932 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:33.218553    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf" podUID="710a9a8c-a0a6-449d-a816-8a32bbf1a65b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 17 11:06:34.219202 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:34.219163    2570 patch_prober.go:28] interesting pod/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 17 11:06:34.219641 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:34.219228    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf" podUID="710a9a8c-a0a6-449d-a816-8a32bbf1a65b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 17 11:06:35.180535 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.179710    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"]
Sep 17 11:06:35.182849 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.182823    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.187784 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.187762    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-766cc3\"/\"default-dockercfg-kcxrj\""
Sep 17 11:06:35.189307 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.189284    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-766cc3\"/\"kube-root-ca.crt\""
Sep 17 11:06:35.189456 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.189332    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-766cc3\"/\"simulator-w3-766cc3-kserve-self-signed-certs\""
Sep 17 11:06:35.209186 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.209150    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"]
Sep 17 11:06:35.218907 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.218875    2570 patch_prober.go:28] interesting pod/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 17 11:06:35.219085 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.218933    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf" podUID="710a9a8c-a0a6-449d-a816-8a32bbf1a65b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 17 11:06:35.256608 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.255843    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-766cc3\"/\"openshift-service-ca.crt\""
Sep 17 11:06:35.300170 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.300136    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-model-cache\") pod \"simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") " pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.300170 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.300175    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9496351f-bc56-49f3-a00a-5dc75fa3de69-tls-certs\") pod \"simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") " pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.300399 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.300234    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-dshm\") pod \"simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") " pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.300399 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.300260    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-tmp-dir\") pod \"simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") " pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.300399 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.300328    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-home\") pod \"simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") " pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.300399 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.300347    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkqzq\" (UniqueName: \"kubernetes.io/projected/9496351f-bc56-49f3-a00a-5dc75fa3de69-kube-api-access-pkqzq\") pod \"simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") " pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.401603 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.401566    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-tmp-dir\") pod \"simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") " pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.401770 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.401639    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-home\") pod \"simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") " pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.401770 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.401662    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkqzq\" (UniqueName: \"kubernetes.io/projected/9496351f-bc56-49f3-a00a-5dc75fa3de69-kube-api-access-pkqzq\") pod \"simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") " pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.401770 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.401687    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-model-cache\") pod \"simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") " pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.401770 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.401714    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9496351f-bc56-49f3-a00a-5dc75fa3de69-tls-certs\") pod \"simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") " pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.401908 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.401782    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-dshm\") pod \"simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") " pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.402091 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.402069    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-home\") pod \"simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") " pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.402128 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.402069    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-tmp-dir\") pod \"simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") " pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.402289 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.402272    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-model-cache\") pod \"simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") " pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.403856 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.403837    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-dshm\") pod \"simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") " pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.404370 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.404313    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9496351f-bc56-49f3-a00a-5dc75fa3de69-tls-certs\") pod \"simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") " pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.418332 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.418306    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkqzq\" (UniqueName: \"kubernetes.io/projected/9496351f-bc56-49f3-a00a-5dc75fa3de69-kube-api-access-pkqzq\") pod \"simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") " pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.493605 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.493484    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:35.797329 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:35.797294    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"]
Sep 17 11:06:35.812000 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:06:35.811972    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9496351f_bc56_49f3_a00a_5dc75fa3de69.slice/crio-1501f58fe97e41cf7dd1dd3694b78e25f67ce7a14e8996ff9306b0e3dc21b56a WatchSource:0}: Error finding container 1501f58fe97e41cf7dd1dd3694b78e25f67ce7a14e8996ff9306b0e3dc21b56a: Status 404 returned error can't find the container with id 1501f58fe97e41cf7dd1dd3694b78e25f67ce7a14e8996ff9306b0e3dc21b56a
Sep 17 11:06:36.198406 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:36.198308    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5" event={"ID":"9496351f-bc56-49f3-a00a-5dc75fa3de69","Type":"ContainerStarted","Data":"9536eaa3b6facbfa12eb61f10cdbfb15ef8c45b684ea75de357187da8830cf8b"}
Sep 17 11:06:36.198406 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:36.198351    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5" event={"ID":"9496351f-bc56-49f3-a00a-5dc75fa3de69","Type":"ContainerStarted","Data":"1501f58fe97e41cf7dd1dd3694b78e25f67ce7a14e8996ff9306b0e3dc21b56a"}
Sep 17 11:06:36.218557 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:36.218499    2570 patch_prober.go:28] interesting pod/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 17 11:06:36.218721 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:36.218578    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf" podUID="710a9a8c-a0a6-449d-a816-8a32bbf1a65b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 17 11:06:36.218721 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:36.218624    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5" podStartSLOduration=1.21860941 podStartE2EDuration="1.21860941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:06:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:06:36.2172702 +0000 UTC m=+786.012604638" watchObservedRunningTime="2026-09-17 11:06:36.21860941 +0000 UTC m=+786.013943848"
Sep 17 11:06:37.218989 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:37.218955    2570 patch_prober.go:28] interesting pod/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 17 11:06:37.219550 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:37.219492    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf" podUID="710a9a8c-a0a6-449d-a816-8a32bbf1a65b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 17 11:06:38.223047 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:38.223010    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:38.223444 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:38.223317    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:38.223961 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:38.223943    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:06:45.493919 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:45.493885    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:45.494474 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:45.493963    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:45.506199 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:45.506173    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:06:46.257791 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:06:46.257763    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:08:30.665294 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:30.665211    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 11:08:30.673793 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:30.673772    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 11:08:47.666936 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.666903    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"]
Sep 17 11:08:47.669677 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.669655    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:47.674331 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.674303    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c10e0b\"/\"openshift-service-ca.crt\""
Sep 17 11:08:47.674461 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.674430    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c10e0b\"/\"kube-root-ca.crt\""
Sep 17 11:08:47.676005 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.675983    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c10e0b\"/\"default-dockercfg-7p9hx\""
Sep 17 11:08:47.676120 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.676027    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c10e0b\"/\"test-model-c10e0b-kserve-self-signed-certs\""
Sep 17 11:08:47.693418 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.693395    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"]
Sep 17 11:08:47.789960 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.789926    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-tls-certs\") pod \"test-model-c10e0b-kserve-5f86bc9bb7-m8d7g\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") " pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:47.790133 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.789974    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj86k\" (UniqueName: \"kubernetes.io/projected/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-kube-api-access-kj86k\") pod \"test-model-c10e0b-kserve-5f86bc9bb7-m8d7g\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") " pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:47.790133 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.790001    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-model-cache\") pod \"test-model-c10e0b-kserve-5f86bc9bb7-m8d7g\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") " pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:47.790133 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.790091    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-tmp-dir\") pod \"test-model-c10e0b-kserve-5f86bc9bb7-m8d7g\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") " pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:47.790133 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.790121    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-dshm\") pod \"test-model-c10e0b-kserve-5f86bc9bb7-m8d7g\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") " pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:47.790273 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.790188    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-home\") pod \"test-model-c10e0b-kserve-5f86bc9bb7-m8d7g\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") " pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:47.890741 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.890711    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-tls-certs\") pod \"test-model-c10e0b-kserve-5f86bc9bb7-m8d7g\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") " pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:47.890916 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.890757    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj86k\" (UniqueName: \"kubernetes.io/projected/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-kube-api-access-kj86k\") pod \"test-model-c10e0b-kserve-5f86bc9bb7-m8d7g\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") " pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:47.890964 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.890931    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-model-cache\") pod \"test-model-c10e0b-kserve-5f86bc9bb7-m8d7g\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") " pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:47.891023 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.890992    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-tmp-dir\") pod \"test-model-c10e0b-kserve-5f86bc9bb7-m8d7g\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") " pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:47.891075 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.891022    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-dshm\") pod \"test-model-c10e0b-kserve-5f86bc9bb7-m8d7g\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") " pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:47.891118 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.891105    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-home\") pod \"test-model-c10e0b-kserve-5f86bc9bb7-m8d7g\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") " pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:47.891358 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.891338    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-tmp-dir\") pod \"test-model-c10e0b-kserve-5f86bc9bb7-m8d7g\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") " pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:47.891455 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.891386    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-model-cache\") pod \"test-model-c10e0b-kserve-5f86bc9bb7-m8d7g\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") " pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:47.891525 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.891488    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-home\") pod \"test-model-c10e0b-kserve-5f86bc9bb7-m8d7g\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") " pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:47.893342 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.893315    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-tls-certs\") pod \"test-model-c10e0b-kserve-5f86bc9bb7-m8d7g\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") " pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:47.893433 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.893345    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-dshm\") pod \"test-model-c10e0b-kserve-5f86bc9bb7-m8d7g\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") " pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:47.901561 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.901542    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj86k\" (UniqueName: \"kubernetes.io/projected/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-kube-api-access-kj86k\") pod \"test-model-c10e0b-kserve-5f86bc9bb7-m8d7g\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") " pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:47.979531 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:47.979420    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:48.263181 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:48.263149    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"]
Sep 17 11:08:48.265354 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:08:48.265327    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93779cf7_2a6d_4e9b_ad53_f1d665ea3bdc.slice/crio-a95affd59ee5615c0cba7a0028cf12682f576a78c3b8cdf99286b93e9f5512a3 WatchSource:0}: Error finding container a95affd59ee5615c0cba7a0028cf12682f576a78c3b8cdf99286b93e9f5512a3: Status 404 returned error can't find the container with id a95affd59ee5615c0cba7a0028cf12682f576a78c3b8cdf99286b93e9f5512a3
Sep 17 11:08:48.872897 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:48.872863    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g" event={"ID":"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc","Type":"ContainerStarted","Data":"90e96ac390b1e37b44f57056f4220736ad57012ffc2e09cc046c70af3801e03d"}
Sep 17 11:08:48.872897 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:48.872908    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g" event={"ID":"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc","Type":"ContainerStarted","Data":"a95affd59ee5615c0cba7a0028cf12682f576a78c3b8cdf99286b93e9f5512a3"}
Sep 17 11:08:48.896342 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:48.896282    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g" podStartSLOduration=1.8962616909999999 podStartE2EDuration="1.896261691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:08:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:08:48.893923594 +0000 UTC m=+918.689258033" watchObservedRunningTime="2026-09-17 11:08:48.896261691 +0000 UTC m=+918.691596132"
Sep 17 11:08:57.980561 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:57.980495    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:57.981008 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:57.980575    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:57.993054 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:57.993027    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:08:58.933881 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:08:58.933852    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:09:50.206236 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.206199    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"]
Sep 17 11:09:50.208903 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.208886    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.211936 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.211917    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-766cc3\"/\"distinct-2-w3-766cc3-kserve-self-signed-certs\""
Sep 17 11:09:50.220217 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.220194    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"]
Sep 17 11:09:50.328665 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.328634    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-model-cache\") pod \"distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") " pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.328880 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.328693    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-home\") pod \"distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") " pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.328880 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.328793    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-dshm\") pod \"distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") " pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.328880 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.328849    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-tmp-dir\") pod \"distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") " pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.329030 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.328932    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd751282-fc0f-43b4-9648-6695cdd5e7f2-tls-certs\") pod \"distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") " pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.329030 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.328976    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcztq\" (UniqueName: \"kubernetes.io/projected/bd751282-fc0f-43b4-9648-6695cdd5e7f2-kube-api-access-qcztq\") pod \"distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") " pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.429820 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.429787    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcztq\" (UniqueName: \"kubernetes.io/projected/bd751282-fc0f-43b4-9648-6695cdd5e7f2-kube-api-access-qcztq\") pod \"distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") " pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.430016 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.429853    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-model-cache\") pod \"distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") " pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.430016 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.429920    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-home\") pod \"distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") " pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.430016 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.429950    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-dshm\") pod \"distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") " pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.430016 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.429993    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-tmp-dir\") pod \"distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") " pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.430234 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.430043    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd751282-fc0f-43b4-9648-6695cdd5e7f2-tls-certs\") pod \"distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") " pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.430299 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.430249    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-model-cache\") pod \"distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") " pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.430353 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.430316    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-home\") pod \"distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") " pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.430393 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.430369    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-tmp-dir\") pod \"distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") " pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.432242 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.432214    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-dshm\") pod \"distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") " pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.432643 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.432623    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd751282-fc0f-43b4-9648-6695cdd5e7f2-tls-certs\") pod \"distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") " pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.439258 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.439229    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcztq\" (UniqueName: \"kubernetes.io/projected/bd751282-fc0f-43b4-9648-6695cdd5e7f2-kube-api-access-qcztq\") pod \"distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") " pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.517688 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.517658    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:09:50.793727 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:50.793699    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"]
Sep 17 11:09:50.795304 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:09:50.795279    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd751282_fc0f_43b4_9648_6695cdd5e7f2.slice/crio-4ccbb8aae9ecda20f6be0c16a3f60a9f6234e15474e32101ec20224bc4c19ee9 WatchSource:0}: Error finding container 4ccbb8aae9ecda20f6be0c16a3f60a9f6234e15474e32101ec20224bc4c19ee9: Status 404 returned error can't find the container with id 4ccbb8aae9ecda20f6be0c16a3f60a9f6234e15474e32101ec20224bc4c19ee9
Sep 17 11:09:51.196627 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:51.196527    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6" event={"ID":"bd751282-fc0f-43b4-9648-6695cdd5e7f2","Type":"ContainerStarted","Data":"0734684ffcb893046d89b9bc9ccf56ca849688935a2a075c35b70ccd59f3c14d"}
Sep 17 11:09:51.196627 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:51.196582    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6" event={"ID":"bd751282-fc0f-43b4-9648-6695cdd5e7f2","Type":"ContainerStarted","Data":"4ccbb8aae9ecda20f6be0c16a3f60a9f6234e15474e32101ec20224bc4c19ee9"}
Sep 17 11:09:51.217310 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:09:51.217265    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6" podStartSLOduration=1.217249651 podStartE2EDuration="1.217249651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:09:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:09:51.215075305 +0000 UTC m=+981.010409745" watchObservedRunningTime="2026-09-17 11:09:51.217249651 +0000 UTC m=+981.012584124"
Sep 17 11:10:00.518408 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:00.518325    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:10:00.518408 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:00.518380    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:10:00.530581 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:00.530554    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:10:01.262047 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:01.262017    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:10:16.495647 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.495607    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"]
Sep 17 11:10:16.498337 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.498315    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:16.501470 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.501444    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-d7b97f\"/\"distinct-2-w0-d7b97f-kserve-self-signed-certs\""
Sep 17 11:10:16.501616 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.501501    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-d7b97f\"/\"openshift-service-ca.crt\""
Sep 17 11:10:16.502351 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.502327    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-d7b97f\"/\"kube-root-ca.crt\""
Sep 17 11:10:16.502451 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.502435    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-d7b97f\"/\"default-dockercfg-v7mwd\""
Sep 17 11:10:16.512077 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.512054    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"]
Sep 17 11:10:16.592625 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.592583    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-dshm\") pod \"distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") " pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:16.592625 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.592630    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-model-cache\") pod \"distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") " pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:16.592888 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.592661    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fb7cae8-44d1-47ad-bb42-6da56b1de345-tls-certs\") pod \"distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") " pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:16.592888 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.592744    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-tmp-dir\") pod \"distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") " pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:16.592888 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.592838    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-home\") pod \"distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") " pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:16.592888 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.592882    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59rgf\" (UniqueName: \"kubernetes.io/projected/9fb7cae8-44d1-47ad-bb42-6da56b1de345-kube-api-access-59rgf\") pod \"distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") " pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:16.693376 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.693336    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-tmp-dir\") pod \"distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") " pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:16.693589 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.693484    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-home\") pod \"distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") " pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:16.693589 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.693533    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59rgf\" (UniqueName: \"kubernetes.io/projected/9fb7cae8-44d1-47ad-bb42-6da56b1de345-kube-api-access-59rgf\") pod \"distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") " pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:16.693721 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.693623    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-dshm\") pod \"distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") " pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:16.693721 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.693674    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-model-cache\") pod \"distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") " pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:16.693721 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.693711    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fb7cae8-44d1-47ad-bb42-6da56b1de345-tls-certs\") pod \"distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") " pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:16.693888 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.693754    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-tmp-dir\") pod \"distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") " pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:16.693888 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.693811    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-home\") pod \"distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") " pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:16.694004 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.693968    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-model-cache\") pod \"distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") " pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:16.695846 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.695825    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-dshm\") pod \"distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") " pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:16.696191 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.696174    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fb7cae8-44d1-47ad-bb42-6da56b1de345-tls-certs\") pod \"distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") " pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:16.702175 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.702155    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59rgf\" (UniqueName: \"kubernetes.io/projected/9fb7cae8-44d1-47ad-bb42-6da56b1de345-kube-api-access-59rgf\") pod \"distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") " pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:16.808909 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:16.808870    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:17.095698 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:17.095612    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"]
Sep 17 11:10:17.098827 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:10:17.098791    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fb7cae8_44d1_47ad_bb42_6da56b1de345.slice/crio-c936b76f0dcccf0f17f5211ea8a4f393f14bc9ff0865cfe78cdaabfb6d04be38 WatchSource:0}: Error finding container c936b76f0dcccf0f17f5211ea8a4f393f14bc9ff0865cfe78cdaabfb6d04be38: Status 404 returned error can't find the container with id c936b76f0dcccf0f17f5211ea8a4f393f14bc9ff0865cfe78cdaabfb6d04be38
Sep 17 11:10:17.332076 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:17.332040    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d" event={"ID":"9fb7cae8-44d1-47ad-bb42-6da56b1de345","Type":"ContainerStarted","Data":"11a1e1d1221ec354d1af2a2ea5d659db5845e7c571f658a6c3ff82e840de7b3f"}
Sep 17 11:10:17.332252 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:17.332088    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d" event={"ID":"9fb7cae8-44d1-47ad-bb42-6da56b1de345","Type":"ContainerStarted","Data":"c936b76f0dcccf0f17f5211ea8a4f393f14bc9ff0865cfe78cdaabfb6d04be38"}
Sep 17 11:10:17.382272 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:17.382161    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d" podStartSLOduration=1.382143971 podStartE2EDuration="1.382143971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:10:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:10:17.380152384 +0000 UTC m=+1007.175486824" watchObservedRunningTime="2026-09-17 11:10:17.382143971 +0000 UTC m=+1007.177478409"
Sep 17 11:10:26.809621 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:26.809582    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:26.810139 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:26.809633    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:26.822325 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:26.822294    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:10:27.407253 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:10:27.407221    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:11:06.903091 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:06.903049    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"]
Sep 17 11:11:18.278246 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.278215    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"]
Sep 17 11:11:18.278629 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.278422    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv" podUID="dc3fba0e-cc5b-43cc-b95b-a54616a942f4" containerName="maas-api" containerID="cri-o://e797aee18929d89c047708e7af834de23d06d82f593ff8bd9a05c2b634cef09f" gracePeriod=30
Sep 17 11:11:18.532823 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.532751    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"
Sep 17 11:11:18.600581 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.600549    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9whcx\" (UniqueName: \"kubernetes.io/projected/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-kube-api-access-9whcx\") pod \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\" (UID: \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\") "
Sep 17 11:11:18.600733 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.600623    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-openshift-service-ca\") pod \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\" (UID: \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\") "
Sep 17 11:11:18.600733 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.600715    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-maas-api-tls\") pod \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\" (UID: \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\") "
Sep 17 11:11:18.600834 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.600794    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-metrics-certs\") pod \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\" (UID: \"dc3fba0e-cc5b-43cc-b95b-a54616a942f4\") "
Sep 17 11:11:18.601078 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.601046    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dc3fba0e-cc5b-43cc-b95b-a54616a942f4" (UID: "dc3fba0e-cc5b-43cc-b95b-a54616a942f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:11:18.601206 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.601192    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-openshift-service-ca\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:11:18.603140 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.603109    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dc3fba0e-cc5b-43cc-b95b-a54616a942f4" (UID: "dc3fba0e-cc5b-43cc-b95b-a54616a942f4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:11:18.603409 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.603379    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dc3fba0e-cc5b-43cc-b95b-a54616a942f4" (UID: "dc3fba0e-cc5b-43cc-b95b-a54616a942f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:11:18.603561 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.603489    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-kube-api-access-9whcx" (OuterVolumeSpecName: "kube-api-access-9whcx") pod "dc3fba0e-cc5b-43cc-b95b-a54616a942f4" (UID: "dc3fba0e-cc5b-43cc-b95b-a54616a942f4"). InnerVolumeSpecName "kube-api-access-9whcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:11:18.658321 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.658292    2570 generic.go:356] "Generic (PLEG): container finished" podID="dc3fba0e-cc5b-43cc-b95b-a54616a942f4" containerID="e797aee18929d89c047708e7af834de23d06d82f593ff8bd9a05c2b634cef09f" exitCode=0
Sep 17 11:11:18.658472 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.658350    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"
Sep 17 11:11:18.658472 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.658374    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv" event={"ID":"dc3fba0e-cc5b-43cc-b95b-a54616a942f4","Type":"ContainerDied","Data":"e797aee18929d89c047708e7af834de23d06d82f593ff8bd9a05c2b634cef09f"}
Sep 17 11:11:18.658472 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.658412    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv" event={"ID":"dc3fba0e-cc5b-43cc-b95b-a54616a942f4","Type":"ContainerDied","Data":"bbfd14843ce5851d9832f408337d27544801b39e99333750ab8d8fdb83043c55"}
Sep 17 11:11:18.658472 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.658433    2570 scope.go:117] "RemoveContainer" containerID="e797aee18929d89c047708e7af834de23d06d82f593ff8bd9a05c2b634cef09f"
Sep 17 11:11:18.672247 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.671823    2570 scope.go:117] "RemoveContainer" containerID="e797aee18929d89c047708e7af834de23d06d82f593ff8bd9a05c2b634cef09f"
Sep 17 11:11:18.675898 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:11:18.673294    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e797aee18929d89c047708e7af834de23d06d82f593ff8bd9a05c2b634cef09f\": container with ID starting with e797aee18929d89c047708e7af834de23d06d82f593ff8bd9a05c2b634cef09f not found: ID does not exist" containerID="e797aee18929d89c047708e7af834de23d06d82f593ff8bd9a05c2b634cef09f"
Sep 17 11:11:18.675898 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.673330    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e797aee18929d89c047708e7af834de23d06d82f593ff8bd9a05c2b634cef09f"} err="failed to get container status \"e797aee18929d89c047708e7af834de23d06d82f593ff8bd9a05c2b634cef09f\": rpc error: code = NotFound desc = could not find container \"e797aee18929d89c047708e7af834de23d06d82f593ff8bd9a05c2b634cef09f\": container with ID starting with e797aee18929d89c047708e7af834de23d06d82f593ff8bd9a05c2b634cef09f not found: ID does not exist"
Sep 17 11:11:18.694242 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.694216    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"]
Sep 17 11:11:18.696634 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.696608    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-79a70a-fb84f7dcb-knddv"]
Sep 17 11:11:18.702606 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.702586    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-maas-api-tls\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:11:18.702606 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.702605    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-metrics-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:11:18.702729 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:18.702615    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9whcx\" (UniqueName: \"kubernetes.io/projected/dc3fba0e-cc5b-43cc-b95b-a54616a942f4-kube-api-access-9whcx\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:11:20.697807 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:20.697776    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc3fba0e-cc5b-43cc-b95b-a54616a942f4" path="/var/lib/kubelet/pods/dc3fba0e-cc5b-43cc-b95b-a54616a942f4/volumes"
Sep 17 11:11:21.921752 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:21.921713    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g" podUID="93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc" containerName="main" containerID="cri-o://90e96ac390b1e37b44f57056f4220736ad57012ffc2e09cc046c70af3801e03d" gracePeriod=45
Sep 17 11:11:22.182538 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.182467    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:11:22.335247 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.335219    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-model-cache\") pod \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") "
Sep 17 11:11:22.335247 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.335249    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-home\") pod \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") "
Sep 17 11:11:22.335450 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.335315    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-tmp-dir\") pod \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") "
Sep 17 11:11:22.335450 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.335331    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-dshm\") pod \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") "
Sep 17 11:11:22.335450 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.335383    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-tls-certs\") pod \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") "
Sep 17 11:11:22.335450 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.335412    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj86k\" (UniqueName: \"kubernetes.io/projected/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-kube-api-access-kj86k\") pod \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\" (UID: \"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc\") "
Sep 17 11:11:22.335690 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.335548    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-model-cache" (OuterVolumeSpecName: "model-cache") pod "93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc" (UID: "93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:11:22.335690 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.335571    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-home" (OuterVolumeSpecName: "home") pod "93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc" (UID: "93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:11:22.335690 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.335676    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc" (UID: "93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:11:22.335864 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.335849    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-model-cache\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:11:22.335903 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.335866    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-home\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:11:22.335903 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.335874    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-tmp-dir\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:11:22.337535 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.337501    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-dshm" (OuterVolumeSpecName: "dshm") pod "93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc" (UID: "93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:11:22.337904 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.337871    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc" (UID: "93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:11:22.337904 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.337883    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-kube-api-access-kj86k" (OuterVolumeSpecName: "kube-api-access-kj86k") pod "93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc" (UID: "93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc"). InnerVolumeSpecName "kube-api-access-kj86k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:11:22.436713 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.436638    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-tls-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:11:22.436713 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.436669    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj86k\" (UniqueName: \"kubernetes.io/projected/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-kube-api-access-kj86k\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:11:22.436713 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.436683    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc-dshm\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:11:22.681127 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.681089    2570 generic.go:356] "Generic (PLEG): container finished" podID="93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc" containerID="90e96ac390b1e37b44f57056f4220736ad57012ffc2e09cc046c70af3801e03d" exitCode=0
Sep 17 11:11:22.681127 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.681133    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"
Sep 17 11:11:22.681372 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.681176    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g" event={"ID":"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc","Type":"ContainerDied","Data":"90e96ac390b1e37b44f57056f4220736ad57012ffc2e09cc046c70af3801e03d"}
Sep 17 11:11:22.681372 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.681228    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g" event={"ID":"93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc","Type":"ContainerDied","Data":"a95affd59ee5615c0cba7a0028cf12682f576a78c3b8cdf99286b93e9f5512a3"}
Sep 17 11:11:22.681372 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.681252    2570 scope.go:117] "RemoveContainer" containerID="90e96ac390b1e37b44f57056f4220736ad57012ffc2e09cc046c70af3801e03d"
Sep 17 11:11:22.690628 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.690609    2570 scope.go:117] "RemoveContainer" containerID="90e96ac390b1e37b44f57056f4220736ad57012ffc2e09cc046c70af3801e03d"
Sep 17 11:11:22.690898 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:11:22.690874    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90e96ac390b1e37b44f57056f4220736ad57012ffc2e09cc046c70af3801e03d\": container with ID starting with 90e96ac390b1e37b44f57056f4220736ad57012ffc2e09cc046c70af3801e03d not found: ID does not exist" containerID="90e96ac390b1e37b44f57056f4220736ad57012ffc2e09cc046c70af3801e03d"
Sep 17 11:11:22.690937 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.690911    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90e96ac390b1e37b44f57056f4220736ad57012ffc2e09cc046c70af3801e03d"} err="failed to get container status \"90e96ac390b1e37b44f57056f4220736ad57012ffc2e09cc046c70af3801e03d\": rpc error: code = NotFound desc = could not find container \"90e96ac390b1e37b44f57056f4220736ad57012ffc2e09cc046c70af3801e03d\": container with ID starting with 90e96ac390b1e37b44f57056f4220736ad57012ffc2e09cc046c70af3801e03d not found: ID does not exist"
Sep 17 11:11:22.711783 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.711760    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"]
Sep 17 11:11:22.719930 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:22.719907    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-c10e0b/test-model-c10e0b-kserve-5f86bc9bb7-m8d7g"]
Sep 17 11:11:24.690975 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:24.690904    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc" path="/var/lib/kubelet/pods/93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc/volumes"
Sep 17 11:11:46.224791 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:46.224749    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"]
Sep 17 11:11:46.227241 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:46.225014    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf" podUID="710a9a8c-a0a6-449d-a816-8a32bbf1a65b" containerName="istio-proxy" containerID="cri-o://8d0f1b028876f16da98588083a25622e62002c78918f03249f00b935fce41b1d" gracePeriod=30
Sep 17 11:11:51.480214 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.480183    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:11:51.502821 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.502752    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istiod-ca-cert\") pod \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") "
Sep 17 11:11:51.502821 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.502815    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fsdxx\" (UniqueName: \"kubernetes.io/projected/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-kube-api-access-fsdxx\") pod \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") "
Sep 17 11:11:51.503015 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.502842    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-token\") pod \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") "
Sep 17 11:11:51.503015 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.502868    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-podinfo\") pod \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") "
Sep 17 11:11:51.503015 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.502897    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-envoy\") pod \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") "
Sep 17 11:11:51.503015 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.502919    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-credential-socket\") pod \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") "
Sep 17 11:11:51.503015 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.502959    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-workload-certs\") pod \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") "
Sep 17 11:11:51.503015 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.503003    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-data\") pod \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") "
Sep 17 11:11:51.503318 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.503046    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-workload-socket\") pod \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\" (UID: \"710a9a8c-a0a6-449d-a816-8a32bbf1a65b\") "
Sep 17 11:11:51.503318 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.503166    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "710a9a8c-a0a6-449d-a816-8a32bbf1a65b" (UID: "710a9a8c-a0a6-449d-a816-8a32bbf1a65b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:11:51.503456 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.503431    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "710a9a8c-a0a6-449d-a816-8a32bbf1a65b" (UID: "710a9a8c-a0a6-449d-a816-8a32bbf1a65b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:11:51.503456 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.503445    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "710a9a8c-a0a6-449d-a816-8a32bbf1a65b" (UID: "710a9a8c-a0a6-449d-a816-8a32bbf1a65b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:11:51.503731 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.503706    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-workload-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:11:51.503861 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.503727    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-data" (OuterVolumeSpecName: "istio-data") pod "710a9a8c-a0a6-449d-a816-8a32bbf1a65b" (UID: "710a9a8c-a0a6-449d-a816-8a32bbf1a65b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:11:51.503861 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.503732    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-workload-socket\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:11:51.503861 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.503802    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istiod-ca-cert\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:11:51.504047 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.503972    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "710a9a8c-a0a6-449d-a816-8a32bbf1a65b" (UID: "710a9a8c-a0a6-449d-a816-8a32bbf1a65b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:11:51.506420 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.506384    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-token" (OuterVolumeSpecName: "istio-token") pod "710a9a8c-a0a6-449d-a816-8a32bbf1a65b" (UID: "710a9a8c-a0a6-449d-a816-8a32bbf1a65b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:11:51.506598 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.506576    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-kube-api-access-fsdxx" (OuterVolumeSpecName: "kube-api-access-fsdxx") pod "710a9a8c-a0a6-449d-a816-8a32bbf1a65b" (UID: "710a9a8c-a0a6-449d-a816-8a32bbf1a65b"). InnerVolumeSpecName "kube-api-access-fsdxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:11:51.507000 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.506977    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "710a9a8c-a0a6-449d-a816-8a32bbf1a65b" (UID: "710a9a8c-a0a6-449d-a816-8a32bbf1a65b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:11:51.507104 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.507061    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "710a9a8c-a0a6-449d-a816-8a32bbf1a65b" (UID: "710a9a8c-a0a6-449d-a816-8a32bbf1a65b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 11:11:51.605422 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.605390    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-data\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:11:51.605422 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.605424    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fsdxx\" (UniqueName: \"kubernetes.io/projected/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-kube-api-access-fsdxx\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:11:51.605686 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.605441    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-token\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:11:51.605686 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.605455    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-podinfo\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:11:51.605686 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.605468    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-istio-envoy\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:11:51.605686 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.605481    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/710a9a8c-a0a6-449d-a816-8a32bbf1a65b-credential-socket\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:11:51.831217 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.831181    2570 generic.go:356] "Generic (PLEG): container finished" podID="710a9a8c-a0a6-449d-a816-8a32bbf1a65b" containerID="8d0f1b028876f16da98588083a25622e62002c78918f03249f00b935fce41b1d" exitCode=0
Sep 17 11:11:51.831382 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.831250    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"
Sep 17 11:11:51.831382 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.831269    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf" event={"ID":"710a9a8c-a0a6-449d-a816-8a32bbf1a65b","Type":"ContainerDied","Data":"8d0f1b028876f16da98588083a25622e62002c78918f03249f00b935fce41b1d"}
Sep 17 11:11:51.831382 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.831324    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf" event={"ID":"710a9a8c-a0a6-449d-a816-8a32bbf1a65b","Type":"ContainerDied","Data":"92f041737c52cb7eedc3b5367e6f2e2562a907340f2d09504db069f1aa8b06b3"}
Sep 17 11:11:51.831382 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.831347    2570 scope.go:117] "RemoveContainer" containerID="8d0f1b028876f16da98588083a25622e62002c78918f03249f00b935fce41b1d"
Sep 17 11:11:51.840595 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.840580    2570 scope.go:117] "RemoveContainer" containerID="f7853af9ad90e3c5615a35caf1ecd70db7a3c9da8ffc37da4803140183d4fb60"
Sep 17 11:11:51.848752 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.848737    2570 scope.go:117] "RemoveContainer" containerID="8d0f1b028876f16da98588083a25622e62002c78918f03249f00b935fce41b1d"
Sep 17 11:11:51.849018 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:11:51.848999    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d0f1b028876f16da98588083a25622e62002c78918f03249f00b935fce41b1d\": container with ID starting with 8d0f1b028876f16da98588083a25622e62002c78918f03249f00b935fce41b1d not found: ID does not exist" containerID="8d0f1b028876f16da98588083a25622e62002c78918f03249f00b935fce41b1d"
Sep 17 11:11:51.849062 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.849024    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d0f1b028876f16da98588083a25622e62002c78918f03249f00b935fce41b1d"} err="failed to get container status \"8d0f1b028876f16da98588083a25622e62002c78918f03249f00b935fce41b1d\": rpc error: code = NotFound desc = could not find container \"8d0f1b028876f16da98588083a25622e62002c78918f03249f00b935fce41b1d\": container with ID starting with 8d0f1b028876f16da98588083a25622e62002c78918f03249f00b935fce41b1d not found: ID does not exist"
Sep 17 11:11:51.849062 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.849040    2570 scope.go:117] "RemoveContainer" containerID="f7853af9ad90e3c5615a35caf1ecd70db7a3c9da8ffc37da4803140183d4fb60"
Sep 17 11:11:51.849290 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:11:51.849268    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7853af9ad90e3c5615a35caf1ecd70db7a3c9da8ffc37da4803140183d4fb60\": container with ID starting with f7853af9ad90e3c5615a35caf1ecd70db7a3c9da8ffc37da4803140183d4fb60 not found: ID does not exist" containerID="f7853af9ad90e3c5615a35caf1ecd70db7a3c9da8ffc37da4803140183d4fb60"
Sep 17 11:11:51.849332 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.849299    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7853af9ad90e3c5615a35caf1ecd70db7a3c9da8ffc37da4803140183d4fb60"} err="failed to get container status \"f7853af9ad90e3c5615a35caf1ecd70db7a3c9da8ffc37da4803140183d4fb60\": rpc error: code = NotFound desc = could not find container \"f7853af9ad90e3c5615a35caf1ecd70db7a3c9da8ffc37da4803140183d4fb60\": container with ID starting with f7853af9ad90e3c5615a35caf1ecd70db7a3c9da8ffc37da4803140183d4fb60 not found: ID does not exist"
Sep 17 11:11:51.857139 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.857113    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"]
Sep 17 11:11:51.862338 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:51.862314    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-c10e0b-openshift-default-5b7f5d69c8-nwsxf"]
Sep 17 11:11:52.690565 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:52.690533    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="710a9a8c-a0a6-449d-a816-8a32bbf1a65b" path="/var/lib/kubelet/pods/710a9a8c-a0a6-449d-a816-8a32bbf1a65b/volumes"
Sep 17 11:11:53.039402 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.039368    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x"]
Sep 17 11:11:53.039774 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.039762    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc" containerName="main"
Sep 17 11:11:53.039774 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.039775    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc" containerName="main"
Sep 17 11:11:53.039856 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.039784    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="710a9a8c-a0a6-449d-a816-8a32bbf1a65b" containerName="istio-proxy"
Sep 17 11:11:53.039856 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.039789    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="710a9a8c-a0a6-449d-a816-8a32bbf1a65b" containerName="istio-proxy"
Sep 17 11:11:53.039856 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.039813    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc3fba0e-cc5b-43cc-b95b-a54616a942f4" containerName="maas-api"
Sep 17 11:11:53.039856 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.039819    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc3fba0e-cc5b-43cc-b95b-a54616a942f4" containerName="maas-api"
Sep 17 11:11:53.039984 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.039871    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc3fba0e-cc5b-43cc-b95b-a54616a942f4" containerName="maas-api"
Sep 17 11:11:53.039984 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.039877    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="710a9a8c-a0a6-449d-a816-8a32bbf1a65b" containerName="istio-proxy"
Sep 17 11:11:53.039984 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.039883    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="710a9a8c-a0a6-449d-a816-8a32bbf1a65b" containerName="istio-proxy"
Sep 17 11:11:53.039984 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.039891    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="93779cf7-2a6d-4e9b-ad53-f1d665ea3bdc" containerName="main"
Sep 17 11:11:53.044545 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.044530    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x"
Sep 17 11:11:53.047555 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.047533    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-026f86\""
Sep 17 11:11:53.047687 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.047627    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-026f86-dockercfg-lgpsw\""
Sep 17 11:11:53.056088 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.056063    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x"]
Sep 17 11:11:53.118673 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.118641    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cff8fe0-aa14-41cb-8654-5c84d123f325-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x\" (UID: \"2cff8fe0-aa14-41cb-8654-5c84d123f325\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x"
Sep 17 11:11:53.118853 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.118681    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbpf4\" (UniqueName: \"kubernetes.io/projected/2cff8fe0-aa14-41cb-8654-5c84d123f325-kube-api-access-dbpf4\") pod \"payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x\" (UID: \"2cff8fe0-aa14-41cb-8654-5c84d123f325\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x"
Sep 17 11:11:53.219451 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.219416    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cff8fe0-aa14-41cb-8654-5c84d123f325-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x\" (UID: \"2cff8fe0-aa14-41cb-8654-5c84d123f325\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x"
Sep 17 11:11:53.219451 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.219451    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbpf4\" (UniqueName: \"kubernetes.io/projected/2cff8fe0-aa14-41cb-8654-5c84d123f325-kube-api-access-dbpf4\") pod \"payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x\" (UID: \"2cff8fe0-aa14-41cb-8654-5c84d123f325\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x"
Sep 17 11:11:53.220104 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.220077    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cff8fe0-aa14-41cb-8654-5c84d123f325-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x\" (UID: \"2cff8fe0-aa14-41cb-8654-5c84d123f325\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x"
Sep 17 11:11:53.230047 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.230012    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbpf4\" (UniqueName: \"kubernetes.io/projected/2cff8fe0-aa14-41cb-8654-5c84d123f325-kube-api-access-dbpf4\") pod \"payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x\" (UID: \"2cff8fe0-aa14-41cb-8654-5c84d123f325\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x"
Sep 17 11:11:53.355841 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.355758    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x"
Sep 17 11:11:53.625695 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.625672    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x"]
Sep 17 11:11:53.628222 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:11:53.628184    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cff8fe0_aa14_41cb_8654_5c84d123f325.slice/crio-7a5d4cd6cd3ead80487e65c53bd55709461a44534ba1ecb2c2917671fd471ad3 WatchSource:0}: Error finding container 7a5d4cd6cd3ead80487e65c53bd55709461a44534ba1ecb2c2917671fd471ad3: Status 404 returned error can't find the container with id 7a5d4cd6cd3ead80487e65c53bd55709461a44534ba1ecb2c2917671fd471ad3
Sep 17 11:11:53.630100 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.630083    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 11:11:53.845420 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:53.845389    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x" event={"ID":"2cff8fe0-aa14-41cb-8654-5c84d123f325","Type":"ContainerStarted","Data":"7a5d4cd6cd3ead80487e65c53bd55709461a44534ba1ecb2c2917671fd471ad3"}
Sep 17 11:11:56.867429 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:56.867396    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x" event={"ID":"2cff8fe0-aa14-41cb-8654-5c84d123f325","Type":"ContainerStarted","Data":"87f307031808b2fd440f802ce773f8e8adbdd72f78ebe77d81a7e6a66b532409"}
Sep 17 11:11:56.867828 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:56.867552    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x"
Sep 17 11:11:56.889804 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:11:56.889760    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x" podStartSLOduration=1.491712852 podStartE2EDuration="3.889746737s" totalImagesPullingTime="2.398033885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:11:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:11:56.889499919 +0000 UTC m=+1106.684834357" watchObservedRunningTime="2026-09-17 11:11:56.889746737 +0000 UTC m=+1106.685081176"
Sep 17 11:12:07.875609 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:07.875575    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x"
Sep 17 11:12:10.597032 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.596994    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"]
Sep 17 11:12:10.597613 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.597592    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="710a9a8c-a0a6-449d-a816-8a32bbf1a65b" containerName="istio-proxy"
Sep 17 11:12:10.597613 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.597613    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="710a9a8c-a0a6-449d-a816-8a32bbf1a65b" containerName="istio-proxy"
Sep 17 11:12:10.600404 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.600383    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.603470 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.603452    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-b8287f-openshift-default-dockercfg-nhjkj\""
Sep 17 11:12:10.632530 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.632491    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"]
Sep 17 11:12:10.687370 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.687337    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56shb\" (UniqueName: \"kubernetes.io/projected/1e25f05f-cc33-49b9-8453-61fb59bb92c1-kube-api-access-56shb\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.687554 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.687436    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-workload-socket\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.687554 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.687542    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-token\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.687680 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.687569    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-workload-certs\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.687680 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.687593    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istiod-ca-cert\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.687680 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.687651    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-envoy\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.687841 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.687775    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-credential-socket\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.687902 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.687849    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-podinfo\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.687954 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.687933    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-data\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.789005 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.788970    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-podinfo\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.789191 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.789023    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-data\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.789191 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.789064    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56shb\" (UniqueName: \"kubernetes.io/projected/1e25f05f-cc33-49b9-8453-61fb59bb92c1-kube-api-access-56shb\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.789191 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.789101    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-workload-socket\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.789378 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.789265    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-token\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.789378 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.789317    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-workload-certs\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.789378 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.789345    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istiod-ca-cert\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.789378 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.789371    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-envoy\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.789690 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.789424    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-credential-socket\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.789690 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.789594    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-workload-socket\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.789690 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.789679    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-workload-certs\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.789846 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.789708    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-data\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.789901 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.789869    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-credential-socket\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.790117 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.790097    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istiod-ca-cert\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.791659 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.791641    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-podinfo\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.791751 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.791666    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-envoy\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.813735 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.813710    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-token\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.814264 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.814246    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56shb\" (UniqueName: \"kubernetes.io/projected/1e25f05f-cc33-49b9-8453-61fb59bb92c1-kube-api-access-56shb\") pod \"e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") " pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:10.910996 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:10.910926    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:11.200666 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:11.200641    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"]
Sep 17 11:12:11.202819 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:12:11.202790    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e25f05f_cc33_49b9_8453_61fb59bb92c1.slice/crio-92f870625570367ab6562f296fb0c12cb7550633fb44f952b5700bd1db0b1827 WatchSource:0}: Error finding container 92f870625570367ab6562f296fb0c12cb7550633fb44f952b5700bd1db0b1827: Status 404 returned error can't find the container with id 92f870625570367ab6562f296fb0c12cb7550633fb44f952b5700bd1db0b1827
Sep 17 11:12:11.207047 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:11.206993    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:12:11.207165 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:11.207135    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:12:11.207240 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:11.207219    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:12:11.950231 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:11.950189    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc" event={"ID":"1e25f05f-cc33-49b9-8453-61fb59bb92c1","Type":"ContainerStarted","Data":"10baa356715620f5e6cc94700d3e27b0ac62e4cca5c8f8f047462bf4d6d661a5"}
Sep 17 11:12:11.950688 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:11.950295    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc" event={"ID":"1e25f05f-cc33-49b9-8453-61fb59bb92c1","Type":"ContainerStarted","Data":"92f870625570367ab6562f296fb0c12cb7550633fb44f952b5700bd1db0b1827"}
Sep 17 11:12:11.974905 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:11.974862    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc" podStartSLOduration=1.974847869 podStartE2EDuration="1.974847869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:12:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:12:11.972454789 +0000 UTC m=+1121.767789229" watchObservedRunningTime="2026-09-17 11:12:11.974847869 +0000 UTC m=+1121.770182309"
Sep 17 11:12:12.911894 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:12.911859    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:12.916986 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:12.916961    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:12.957350 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:12.957317    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:12.958351 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:12.958316    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:18.286570 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:18.286532    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr"]
Sep 17 11:12:18.290005 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:18.289983    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr"
Sep 17 11:12:18.293187 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:18.293163    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-b8287f\""
Sep 17 11:12:18.293395 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:18.293376    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-b8287f-dockercfg-vgqkq\""
Sep 17 11:12:18.303962 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:18.303938    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr"]
Sep 17 11:12:18.373330 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:18.373307    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65rbc\" (UniqueName: \"kubernetes.io/projected/6c5afcad-b6e4-4e98-bc46-6fd32a12e34d-kube-api-access-65rbc\") pod \"payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr\" (UID: \"6c5afcad-b6e4-4e98-bc46-6fd32a12e34d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr"
Sep 17 11:12:18.373458 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:18.373342    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c5afcad-b6e4-4e98-bc46-6fd32a12e34d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr\" (UID: \"6c5afcad-b6e4-4e98-bc46-6fd32a12e34d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr"
Sep 17 11:12:18.474324 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:18.474286    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65rbc\" (UniqueName: \"kubernetes.io/projected/6c5afcad-b6e4-4e98-bc46-6fd32a12e34d-kube-api-access-65rbc\") pod \"payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr\" (UID: \"6c5afcad-b6e4-4e98-bc46-6fd32a12e34d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr"
Sep 17 11:12:18.474493 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:18.474332    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c5afcad-b6e4-4e98-bc46-6fd32a12e34d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr\" (UID: \"6c5afcad-b6e4-4e98-bc46-6fd32a12e34d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr"
Sep 17 11:12:18.475069 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:18.475049    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c5afcad-b6e4-4e98-bc46-6fd32a12e34d-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr\" (UID: \"6c5afcad-b6e4-4e98-bc46-6fd32a12e34d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr"
Sep 17 11:12:18.486693 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:18.486665    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65rbc\" (UniqueName: \"kubernetes.io/projected/6c5afcad-b6e4-4e98-bc46-6fd32a12e34d-kube-api-access-65rbc\") pod \"payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr\" (UID: \"6c5afcad-b6e4-4e98-bc46-6fd32a12e34d\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr"
Sep 17 11:12:18.600472 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:18.600406    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr"
Sep 17 11:12:18.886372 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:18.886346    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr"]
Sep 17 11:12:18.887879 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:12:18.887852    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c5afcad_b6e4_4e98_bc46_6fd32a12e34d.slice/crio-3fef22335bb467798302016fc7aafc7afa09a3f5483599612c1c21fdf4212348 WatchSource:0}: Error finding container 3fef22335bb467798302016fc7aafc7afa09a3f5483599612c1c21fdf4212348: Status 404 returned error can't find the container with id 3fef22335bb467798302016fc7aafc7afa09a3f5483599612c1c21fdf4212348
Sep 17 11:12:18.990338 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:18.990307    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr" event={"ID":"6c5afcad-b6e4-4e98-bc46-6fd32a12e34d","Type":"ContainerStarted","Data":"22baf2f30a86d6adbce0371369f7fc9015b8c82fd35118446eb590d935f64f7d"}
Sep 17 11:12:18.990480 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:18.990356    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr" event={"ID":"6c5afcad-b6e4-4e98-bc46-6fd32a12e34d","Type":"ContainerStarted","Data":"3fef22335bb467798302016fc7aafc7afa09a3f5483599612c1c21fdf4212348"}
Sep 17 11:12:18.990480 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:18.990452    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr"
Sep 17 11:12:19.014253 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:19.014201    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr" podStartSLOduration=1.014186806 podStartE2EDuration="1.014186806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:12:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:12:19.011022055 +0000 UTC m=+1128.806356493" watchObservedRunningTime="2026-09-17 11:12:19.014186806 +0000 UTC m=+1128.809521244"
Sep 17 11:12:29.997266 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:29.997236    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr"
Sep 17 11:12:43.998682 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:43.998638    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 11:12:43.999121 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:43.998723    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc" podUID="1e25f05f-cc33-49b9-8453-61fb59bb92c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 11:12:46.141856 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:46.141779    2570 generic.go:356] "Generic (PLEG): container finished" podID="1e25f05f-cc33-49b9-8453-61fb59bb92c1" containerID="10baa356715620f5e6cc94700d3e27b0ac62e4cca5c8f8f047462bf4d6d661a5" exitCode=0
Sep 17 11:12:46.142243 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:46.141849    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc" event={"ID":"1e25f05f-cc33-49b9-8453-61fb59bb92c1","Type":"ContainerDied","Data":"10baa356715620f5e6cc94700d3e27b0ac62e4cca5c8f8f047462bf4d6d661a5"}
Sep 17 11:12:46.142305 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:46.142288    2570 scope.go:117] "RemoveContainer" containerID="10baa356715620f5e6cc94700d3e27b0ac62e4cca5c8f8f047462bf4d6d661a5"
Sep 17 11:12:46.143330 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:46.143301    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:12:46.143436 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:46.143383    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:12:46.143497 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:46.143431    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:12:47.149863 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:47.149807    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc" event={"ID":"1e25f05f-cc33-49b9-8453-61fb59bb92c1","Type":"ContainerStarted","Data":"7ae8dc941352fd6e8c325ce285cdf04775d291a4b2db9b62f8c256ea1452424a"}
Sep 17 11:12:47.911263 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:47.911229    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:47.911471 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:47.911448    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 17 11:12:47.911555 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:47.911536    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc" podUID="1e25f05f-cc33-49b9-8453-61fb59bb92c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 17 11:12:48.911914 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:48.911877    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 17 11:12:48.912299 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:48.911943    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc" podUID="1e25f05f-cc33-49b9-8453-61fb59bb92c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 17 11:12:49.912232 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:49.912197    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 17 11:12:49.912700 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:49.912253    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc" podUID="1e25f05f-cc33-49b9-8453-61fb59bb92c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 17 11:12:50.911717 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:50.911681    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 17 11:12:50.912024 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:50.911976    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc" podUID="1e25f05f-cc33-49b9-8453-61fb59bb92c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 17 11:12:51.911881 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:51.911846    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 17 11:12:51.912249 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:51.911908    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc" podUID="1e25f05f-cc33-49b9-8453-61fb59bb92c1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 17 11:12:52.915588 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:52.915559    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:52.915947 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:52.915865    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:12:52.916557 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:12:52.916537    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:13:16.925898 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:16.925864    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"]
Sep 17 11:13:16.957053 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:16.957021    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"]
Sep 17 11:13:27.629819 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:27.629781    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"]
Sep 17 11:13:27.630420 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:27.630050    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm" podUID="83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96" containerName="maas-api" containerID="cri-o://f8f55f3f87e438a612ae4ddd16d55334ec6d2607647dd57521992bda5c78495e" gracePeriod=30
Sep 17 11:13:27.886378 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:27.886311    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"
Sep 17 11:13:28.050208 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.050175    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-maas-api-tls\") pod \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\" (UID: \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\") "
Sep 17 11:13:28.050421 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.050286    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-metrics-certs\") pod \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\" (UID: \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\") "
Sep 17 11:13:28.050421 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.050325    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvrvb\" (UniqueName: \"kubernetes.io/projected/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-kube-api-access-gvrvb\") pod \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\" (UID: \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\") "
Sep 17 11:13:28.050421 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.050364    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-openshift-service-ca\") pod \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\" (UID: \"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96\") "
Sep 17 11:13:28.051104 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.051072    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96" (UID: "83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:13:28.053553 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.053478    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96" (UID: "83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:13:28.053670 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.053617    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-kube-api-access-gvrvb" (OuterVolumeSpecName: "kube-api-access-gvrvb") pod "83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96" (UID: "83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96"). InnerVolumeSpecName "kube-api-access-gvrvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:13:28.053736 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.053693    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96" (UID: "83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:13:28.152483 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.152398    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-maas-api-tls\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:13:28.152483 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.152433    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-metrics-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:13:28.152483 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.152448    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvrvb\" (UniqueName: \"kubernetes.io/projected/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-kube-api-access-gvrvb\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:13:28.152483 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.152462    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96-openshift-service-ca\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:13:28.396023 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.395980    2570 generic.go:356] "Generic (PLEG): container finished" podID="83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96" containerID="f8f55f3f87e438a612ae4ddd16d55334ec6d2607647dd57521992bda5c78495e" exitCode=0
Sep 17 11:13:28.396023 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.396017    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"
Sep 17 11:13:28.396023 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.396029    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm" event={"ID":"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96","Type":"ContainerDied","Data":"f8f55f3f87e438a612ae4ddd16d55334ec6d2607647dd57521992bda5c78495e"}
Sep 17 11:13:28.396282 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.396087    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm" event={"ID":"83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96","Type":"ContainerDied","Data":"5d04339cb200bcd0c151835abb3f56f3b4d921a85088634b7e9a53b6832555a1"}
Sep 17 11:13:28.396282 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.396118    2570 scope.go:117] "RemoveContainer" containerID="f8f55f3f87e438a612ae4ddd16d55334ec6d2607647dd57521992bda5c78495e"
Sep 17 11:13:28.406303 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.406282    2570 scope.go:117] "RemoveContainer" containerID="f8f55f3f87e438a612ae4ddd16d55334ec6d2607647dd57521992bda5c78495e"
Sep 17 11:13:28.406605 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:13:28.406585    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8f55f3f87e438a612ae4ddd16d55334ec6d2607647dd57521992bda5c78495e\": container with ID starting with f8f55f3f87e438a612ae4ddd16d55334ec6d2607647dd57521992bda5c78495e not found: ID does not exist" containerID="f8f55f3f87e438a612ae4ddd16d55334ec6d2607647dd57521992bda5c78495e"
Sep 17 11:13:28.406678 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.406614    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8f55f3f87e438a612ae4ddd16d55334ec6d2607647dd57521992bda5c78495e"} err="failed to get container status \"f8f55f3f87e438a612ae4ddd16d55334ec6d2607647dd57521992bda5c78495e\": rpc error: code = NotFound desc = could not find container \"f8f55f3f87e438a612ae4ddd16d55334ec6d2607647dd57521992bda5c78495e\": container with ID starting with f8f55f3f87e438a612ae4ddd16d55334ec6d2607647dd57521992bda5c78495e not found: ID does not exist"
Sep 17 11:13:28.419401 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.419377    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"]
Sep 17 11:13:28.424070 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.424051    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-766cc3-56875d98b7-h8nfm"]
Sep 17 11:13:28.694753 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:28.691468    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96" path="/var/lib/kubelet/pods/83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96/volumes"
Sep 17 11:13:30.706383 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:30.706350    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 11:13:30.709764 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:30.709741    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 11:13:31.945689 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:31.945629    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6" podUID="bd751282-fc0f-43b4-9648-6695cdd5e7f2" containerName="main" containerID="cri-o://0734684ffcb893046d89b9bc9ccf56ca849688935a2a075c35b70ccd59f3c14d" gracePeriod=45
Sep 17 11:13:31.976495 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:31.976443    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5" podUID="9496351f-bc56-49f3-a00a-5dc75fa3de69" containerName="main" containerID="cri-o://9536eaa3b6facbfa12eb61f10cdbfb15ef8c45b684ea75de357187da8830cf8b" gracePeriod=45
Sep 17 11:13:32.249968 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.249940    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:13:32.254162 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.254140    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:13:32.395052 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.395009    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-home\") pod \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") "
Sep 17 11:13:32.395241 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.395071    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-dshm\") pod \"9496351f-bc56-49f3-a00a-5dc75fa3de69\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") "
Sep 17 11:13:32.395241 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.395091    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-tmp-dir\") pod \"9496351f-bc56-49f3-a00a-5dc75fa3de69\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") "
Sep 17 11:13:32.395241 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.395112    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-tmp-dir\") pod \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") "
Sep 17 11:13:32.395241 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.395143    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkqzq\" (UniqueName: \"kubernetes.io/projected/9496351f-bc56-49f3-a00a-5dc75fa3de69-kube-api-access-pkqzq\") pod \"9496351f-bc56-49f3-a00a-5dc75fa3de69\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") "
Sep 17 11:13:32.395241 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.395213    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcztq\" (UniqueName: \"kubernetes.io/projected/bd751282-fc0f-43b4-9648-6695cdd5e7f2-kube-api-access-qcztq\") pod \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") "
Sep 17 11:13:32.395241 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.395240    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-home\") pod \"9496351f-bc56-49f3-a00a-5dc75fa3de69\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") "
Sep 17 11:13:32.395685 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.395273    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-model-cache\") pod \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") "
Sep 17 11:13:32.395685 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.395279    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-home" (OuterVolumeSpecName: "home") pod "bd751282-fc0f-43b4-9648-6695cdd5e7f2" (UID: "bd751282-fc0f-43b4-9648-6695cdd5e7f2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:13:32.395685 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.395358    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9496351f-bc56-49f3-a00a-5dc75fa3de69" (UID: "9496351f-bc56-49f3-a00a-5dc75fa3de69"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:13:32.395685 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.395415    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bd751282-fc0f-43b4-9648-6695cdd5e7f2" (UID: "bd751282-fc0f-43b4-9648-6695cdd5e7f2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:13:32.395685 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.395434    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-model-cache\") pod \"9496351f-bc56-49f3-a00a-5dc75fa3de69\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") "
Sep 17 11:13:32.395685 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.395472    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-dshm\") pod \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") "
Sep 17 11:13:32.395685 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.395505    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd751282-fc0f-43b4-9648-6695cdd5e7f2-tls-certs\") pod \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\" (UID: \"bd751282-fc0f-43b4-9648-6695cdd5e7f2\") "
Sep 17 11:13:32.395685 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.395543    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-model-cache" (OuterVolumeSpecName: "model-cache") pod "bd751282-fc0f-43b4-9648-6695cdd5e7f2" (UID: "bd751282-fc0f-43b4-9648-6695cdd5e7f2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:13:32.395685 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.395556    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9496351f-bc56-49f3-a00a-5dc75fa3de69-tls-certs\") pod \"9496351f-bc56-49f3-a00a-5dc75fa3de69\" (UID: \"9496351f-bc56-49f3-a00a-5dc75fa3de69\") "
Sep 17 11:13:32.396172 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.395707    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-model-cache" (OuterVolumeSpecName: "model-cache") pod "9496351f-bc56-49f3-a00a-5dc75fa3de69" (UID: "9496351f-bc56-49f3-a00a-5dc75fa3de69"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:13:32.396172 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.395877    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-home" (OuterVolumeSpecName: "home") pod "9496351f-bc56-49f3-a00a-5dc75fa3de69" (UID: "9496351f-bc56-49f3-a00a-5dc75fa3de69"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:13:32.396172 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.395997    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-home\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:13:32.396172 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.396018    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-model-cache\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:13:32.396172 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.396032    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-model-cache\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:13:32.396172 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.396043    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-home\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:13:32.396172 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.396055    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-tmp-dir\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:13:32.396172 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.396068    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-tmp-dir\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:13:32.397863 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.397802    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd751282-fc0f-43b4-9648-6695cdd5e7f2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bd751282-fc0f-43b4-9648-6695cdd5e7f2" (UID: "bd751282-fc0f-43b4-9648-6695cdd5e7f2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:13:32.397863 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.397833    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9496351f-bc56-49f3-a00a-5dc75fa3de69-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9496351f-bc56-49f3-a00a-5dc75fa3de69" (UID: "9496351f-bc56-49f3-a00a-5dc75fa3de69"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:13:32.398009 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.397883    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9496351f-bc56-49f3-a00a-5dc75fa3de69-kube-api-access-pkqzq" (OuterVolumeSpecName: "kube-api-access-pkqzq") pod "9496351f-bc56-49f3-a00a-5dc75fa3de69" (UID: "9496351f-bc56-49f3-a00a-5dc75fa3de69"). InnerVolumeSpecName "kube-api-access-pkqzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:13:32.398009 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.397908    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd751282-fc0f-43b4-9648-6695cdd5e7f2-kube-api-access-qcztq" (OuterVolumeSpecName: "kube-api-access-qcztq") pod "bd751282-fc0f-43b4-9648-6695cdd5e7f2" (UID: "bd751282-fc0f-43b4-9648-6695cdd5e7f2"). InnerVolumeSpecName "kube-api-access-qcztq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:13:32.398009 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.397924    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-dshm" (OuterVolumeSpecName: "dshm") pod "bd751282-fc0f-43b4-9648-6695cdd5e7f2" (UID: "bd751282-fc0f-43b4-9648-6695cdd5e7f2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:13:32.398009 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.397946    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-dshm" (OuterVolumeSpecName: "dshm") pod "9496351f-bc56-49f3-a00a-5dc75fa3de69" (UID: "9496351f-bc56-49f3-a00a-5dc75fa3de69"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:13:32.422404 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.422376    2570 generic.go:356] "Generic (PLEG): container finished" podID="bd751282-fc0f-43b4-9648-6695cdd5e7f2" containerID="0734684ffcb893046d89b9bc9ccf56ca849688935a2a075c35b70ccd59f3c14d" exitCode=0
Sep 17 11:13:32.422493 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.422412    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"
Sep 17 11:13:32.422493 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.422453    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6" event={"ID":"bd751282-fc0f-43b4-9648-6695cdd5e7f2","Type":"ContainerDied","Data":"0734684ffcb893046d89b9bc9ccf56ca849688935a2a075c35b70ccd59f3c14d"}
Sep 17 11:13:32.422618 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.422496    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6" event={"ID":"bd751282-fc0f-43b4-9648-6695cdd5e7f2","Type":"ContainerDied","Data":"4ccbb8aae9ecda20f6be0c16a3f60a9f6234e15474e32101ec20224bc4c19ee9"}
Sep 17 11:13:32.422618 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.422537    2570 scope.go:117] "RemoveContainer" containerID="0734684ffcb893046d89b9bc9ccf56ca849688935a2a075c35b70ccd59f3c14d"
Sep 17 11:13:32.424119 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.424099    2570 generic.go:356] "Generic (PLEG): container finished" podID="9496351f-bc56-49f3-a00a-5dc75fa3de69" containerID="9536eaa3b6facbfa12eb61f10cdbfb15ef8c45b684ea75de357187da8830cf8b" exitCode=0
Sep 17 11:13:32.424208 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.424145    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"
Sep 17 11:13:32.424208 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.424186    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5" event={"ID":"9496351f-bc56-49f3-a00a-5dc75fa3de69","Type":"ContainerDied","Data":"9536eaa3b6facbfa12eb61f10cdbfb15ef8c45b684ea75de357187da8830cf8b"}
Sep 17 11:13:32.424299 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.424224    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5" event={"ID":"9496351f-bc56-49f3-a00a-5dc75fa3de69","Type":"ContainerDied","Data":"1501f58fe97e41cf7dd1dd3694b78e25f67ce7a14e8996ff9306b0e3dc21b56a"}
Sep 17 11:13:32.432091 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.432076    2570 scope.go:117] "RemoveContainer" containerID="0734684ffcb893046d89b9bc9ccf56ca849688935a2a075c35b70ccd59f3c14d"
Sep 17 11:13:32.432359 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:13:32.432340    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0734684ffcb893046d89b9bc9ccf56ca849688935a2a075c35b70ccd59f3c14d\": container with ID starting with 0734684ffcb893046d89b9bc9ccf56ca849688935a2a075c35b70ccd59f3c14d not found: ID does not exist" containerID="0734684ffcb893046d89b9bc9ccf56ca849688935a2a075c35b70ccd59f3c14d"
Sep 17 11:13:32.432471 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.432368    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0734684ffcb893046d89b9bc9ccf56ca849688935a2a075c35b70ccd59f3c14d"} err="failed to get container status \"0734684ffcb893046d89b9bc9ccf56ca849688935a2a075c35b70ccd59f3c14d\": rpc error: code = NotFound desc = could not find container \"0734684ffcb893046d89b9bc9ccf56ca849688935a2a075c35b70ccd59f3c14d\": container with ID starting with 0734684ffcb893046d89b9bc9ccf56ca849688935a2a075c35b70ccd59f3c14d not found: ID does not exist"
Sep 17 11:13:32.432471 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.432390    2570 scope.go:117] "RemoveContainer" containerID="9536eaa3b6facbfa12eb61f10cdbfb15ef8c45b684ea75de357187da8830cf8b"
Sep 17 11:13:32.439815 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.439797    2570 scope.go:117] "RemoveContainer" containerID="9536eaa3b6facbfa12eb61f10cdbfb15ef8c45b684ea75de357187da8830cf8b"
Sep 17 11:13:32.440105 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:13:32.440088    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9536eaa3b6facbfa12eb61f10cdbfb15ef8c45b684ea75de357187da8830cf8b\": container with ID starting with 9536eaa3b6facbfa12eb61f10cdbfb15ef8c45b684ea75de357187da8830cf8b not found: ID does not exist" containerID="9536eaa3b6facbfa12eb61f10cdbfb15ef8c45b684ea75de357187da8830cf8b"
Sep 17 11:13:32.440165 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.440109    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9536eaa3b6facbfa12eb61f10cdbfb15ef8c45b684ea75de357187da8830cf8b"} err="failed to get container status \"9536eaa3b6facbfa12eb61f10cdbfb15ef8c45b684ea75de357187da8830cf8b\": rpc error: code = NotFound desc = could not find container \"9536eaa3b6facbfa12eb61f10cdbfb15ef8c45b684ea75de357187da8830cf8b\": container with ID starting with 9536eaa3b6facbfa12eb61f10cdbfb15ef8c45b684ea75de357187da8830cf8b not found: ID does not exist"
Sep 17 11:13:32.449529 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.449492    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"]
Sep 17 11:13:32.455384 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.455362    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-766cc3/distinct-2-w3-766cc3-kserve-d476d8b6c-ljxm6"]
Sep 17 11:13:32.469922 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.469904    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"]
Sep 17 11:13:32.474837 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.474786    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-766cc3/simulator-w3-766cc3-kserve-7dcc8b96cb-k9dc5"]
Sep 17 11:13:32.497339 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.497316    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9496351f-bc56-49f3-a00a-5dc75fa3de69-dshm\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:13:32.497339 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.497337    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkqzq\" (UniqueName: \"kubernetes.io/projected/9496351f-bc56-49f3-a00a-5dc75fa3de69-kube-api-access-pkqzq\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:13:32.497456 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.497347    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcztq\" (UniqueName: \"kubernetes.io/projected/bd751282-fc0f-43b4-9648-6695cdd5e7f2-kube-api-access-qcztq\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:13:32.497456 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.497356    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd751282-fc0f-43b4-9648-6695cdd5e7f2-dshm\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:13:32.497456 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.497365    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd751282-fc0f-43b4-9648-6695cdd5e7f2-tls-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:13:32.497456 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.497373    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9496351f-bc56-49f3-a00a-5dc75fa3de69-tls-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:13:32.689976 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.689942    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9496351f-bc56-49f3-a00a-5dc75fa3de69" path="/var/lib/kubelet/pods/9496351f-bc56-49f3-a00a-5dc75fa3de69/volumes"
Sep 17 11:13:32.690344 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:13:32.690331    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd751282-fc0f-43b4-9648-6695cdd5e7f2" path="/var/lib/kubelet/pods/bd751282-fc0f-43b4-9648-6695cdd5e7f2/volumes"
Sep 17 11:14:01.102018 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.101977    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj"]
Sep 17 11:14:01.102471 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.102411    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd751282-fc0f-43b4-9648-6695cdd5e7f2" containerName="main"
Sep 17 11:14:01.102471 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.102424    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd751282-fc0f-43b4-9648-6695cdd5e7f2" containerName="main"
Sep 17 11:14:01.102471 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.102434    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9496351f-bc56-49f3-a00a-5dc75fa3de69" containerName="main"
Sep 17 11:14:01.102471 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.102439    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9496351f-bc56-49f3-a00a-5dc75fa3de69" containerName="main"
Sep 17 11:14:01.102471 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.102451    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96" containerName="maas-api"
Sep 17 11:14:01.102471 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.102456    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96" containerName="maas-api"
Sep 17 11:14:01.102691 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.102553    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd751282-fc0f-43b4-9648-6695cdd5e7f2" containerName="main"
Sep 17 11:14:01.102691 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.102562    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="83776c7b-ca6d-4e7d-8d29-2bf7a25c3a96" containerName="maas-api"
Sep 17 11:14:01.102691 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.102567    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9496351f-bc56-49f3-a00a-5dc75fa3de69" containerName="main"
Sep 17 11:14:01.104746 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.104731    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj"
Sep 17 11:14:01.107576 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.107556    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-d078f791-dockercfg-qmjqg\""
Sep 17 11:14:01.108717 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.108693    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-d078f791\""
Sep 17 11:14:01.117087 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.117064    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj"]
Sep 17 11:14:01.170618 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.170580    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97"]
Sep 17 11:14:01.173307 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.173284    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97"
Sep 17 11:14:01.185753 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.185729    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97"]
Sep 17 11:14:01.269970 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.269925    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68c5e697-0e1d-4c96-bb25-1c45af99b312-plugins-config-volume\") pod \"payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97\" (UID: \"68c5e697-0e1d-4c96-bb25-1c45af99b312\") " pod="openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97"
Sep 17 11:14:01.270160 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.269984    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdlt7\" (UniqueName: \"kubernetes.io/projected/68c5e697-0e1d-4c96-bb25-1c45af99b312-kube-api-access-rdlt7\") pod \"payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97\" (UID: \"68c5e697-0e1d-4c96-bb25-1c45af99b312\") " pod="openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97"
Sep 17 11:14:01.270160 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.270133    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z4br\" (UniqueName: \"kubernetes.io/projected/d21e8d31-1a20-4957-a3d7-047cf2bc0bad-kube-api-access-5z4br\") pod \"payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj\" (UID: \"d21e8d31-1a20-4957-a3d7-047cf2bc0bad\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj"
Sep 17 11:14:01.270287 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.270189    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d21e8d31-1a20-4957-a3d7-047cf2bc0bad-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj\" (UID: \"d21e8d31-1a20-4957-a3d7-047cf2bc0bad\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj"
Sep 17 11:14:01.371493 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.371406    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z4br\" (UniqueName: \"kubernetes.io/projected/d21e8d31-1a20-4957-a3d7-047cf2bc0bad-kube-api-access-5z4br\") pod \"payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj\" (UID: \"d21e8d31-1a20-4957-a3d7-047cf2bc0bad\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj"
Sep 17 11:14:01.371493 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.371456    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d21e8d31-1a20-4957-a3d7-047cf2bc0bad-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj\" (UID: \"d21e8d31-1a20-4957-a3d7-047cf2bc0bad\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj"
Sep 17 11:14:01.371493 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.371492    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68c5e697-0e1d-4c96-bb25-1c45af99b312-plugins-config-volume\") pod \"payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97\" (UID: \"68c5e697-0e1d-4c96-bb25-1c45af99b312\") " pod="openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97"
Sep 17 11:14:01.371753 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.371543    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdlt7\" (UniqueName: \"kubernetes.io/projected/68c5e697-0e1d-4c96-bb25-1c45af99b312-kube-api-access-rdlt7\") pod \"payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97\" (UID: \"68c5e697-0e1d-4c96-bb25-1c45af99b312\") " pod="openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97"
Sep 17 11:14:01.372260 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.372240    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d21e8d31-1a20-4957-a3d7-047cf2bc0bad-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj\" (UID: \"d21e8d31-1a20-4957-a3d7-047cf2bc0bad\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj"
Sep 17 11:14:01.372493 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.372475    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68c5e697-0e1d-4c96-bb25-1c45af99b312-plugins-config-volume\") pod \"payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97\" (UID: \"68c5e697-0e1d-4c96-bb25-1c45af99b312\") " pod="openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97"
Sep 17 11:14:01.380226 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.380197    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z4br\" (UniqueName: \"kubernetes.io/projected/d21e8d31-1a20-4957-a3d7-047cf2bc0bad-kube-api-access-5z4br\") pod \"payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj\" (UID: \"d21e8d31-1a20-4957-a3d7-047cf2bc0bad\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj"
Sep 17 11:14:01.380342 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.380245    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdlt7\" (UniqueName: \"kubernetes.io/projected/68c5e697-0e1d-4c96-bb25-1c45af99b312-kube-api-access-rdlt7\") pod \"payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97\" (UID: \"68c5e697-0e1d-4c96-bb25-1c45af99b312\") " pod="openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97"
Sep 17 11:14:01.415409 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.415385    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj"
Sep 17 11:14:01.484643 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.484496    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97"
Sep 17 11:14:01.687298 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.687268    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj"]
Sep 17 11:14:01.688813 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:14:01.688780    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd21e8d31_1a20_4957_a3d7_047cf2bc0bad.slice/crio-0998099e9558999b19dbbccb409434c88428d8c7bd6b08ca046001b029831aff WatchSource:0}: Error finding container 0998099e9558999b19dbbccb409434c88428d8c7bd6b08ca046001b029831aff: Status 404 returned error can't find the container with id 0998099e9558999b19dbbccb409434c88428d8c7bd6b08ca046001b029831aff
Sep 17 11:14:01.759489 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:01.759461    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97"]
Sep 17 11:14:02.593025 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:02.592984    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97" event={"ID":"68c5e697-0e1d-4c96-bb25-1c45af99b312","Type":"ContainerStarted","Data":"b74f376d984114db52e497cb5156aca635bace98857943413ba4cbb8f9e241c8"}
Sep 17 11:14:02.593494 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:02.593054    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97" event={"ID":"68c5e697-0e1d-4c96-bb25-1c45af99b312","Type":"ContainerStarted","Data":"cf098e0c81c14545a27e915f240f170523d426cdbb8965898cc607b36e082bff"}
Sep 17 11:14:02.593494 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:02.593235    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97"
Sep 17 11:14:02.594924 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:02.594901    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj" event={"ID":"d21e8d31-1a20-4957-a3d7-047cf2bc0bad","Type":"ContainerStarted","Data":"44cb1f8054f8c24ab771731b26c7ededf13aba6f6f6d24e8916d7fe4503fec40"}
Sep 17 11:14:02.595010 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:02.594943    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj" event={"ID":"d21e8d31-1a20-4957-a3d7-047cf2bc0bad","Type":"ContainerStarted","Data":"0998099e9558999b19dbbccb409434c88428d8c7bd6b08ca046001b029831aff"}
Sep 17 11:14:02.595061 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:02.595040    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj"
Sep 17 11:14:02.615755 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:02.615711    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97" podStartSLOduration=1.6156981510000001 podStartE2EDuration="1.615698151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:14:02.61306171 +0000 UTC m=+1232.408396150" watchObservedRunningTime="2026-09-17 11:14:02.615698151 +0000 UTC m=+1232.411032590"
Sep 17 11:14:02.633681 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:02.633641    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj" podStartSLOduration=1.6336266579999998 podStartE2EDuration="1.633626658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:14:02.632287217 +0000 UTC m=+1232.427621658" watchObservedRunningTime="2026-09-17 11:14:02.633626658 +0000 UTC m=+1232.428961115"
Sep 17 11:14:13.602197 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:13.602162    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97"
Sep 17 11:14:13.602684 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:13.602252    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj"
Sep 17 11:14:23.698277 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.698189    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"]
Sep 17 11:14:23.700997 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.700960    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:23.704173 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.704154    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w2-b8287f\"/\"kube-root-ca.crt\""
Sep 17 11:14:23.705379 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.705360    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w2-b8287f\"/\"auth-test-model-b8287f-kserve-self-signed-certs\""
Sep 17 11:14:23.705493 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.705465    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w2-b8287f\"/\"openshift-service-ca.crt\""
Sep 17 11:14:23.705584 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.705559    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w2-b8287f\"/\"default-dockercfg-jpfb4\""
Sep 17 11:14:23.713114 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.713091    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"]
Sep 17 11:14:23.790971 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.790934    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3e66371-b7d1-47cc-828d-f8456ab134ed-tls-certs\") pod \"auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") " pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:23.791165 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.791009    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-model-cache\") pod \"auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") " pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:23.791165 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.791047    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgm5p\" (UniqueName: \"kubernetes.io/projected/b3e66371-b7d1-47cc-828d-f8456ab134ed-kube-api-access-vgm5p\") pod \"auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") " pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:23.791165 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.791144    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-home\") pod \"auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") " pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:23.791327 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.791198    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-dshm\") pod \"auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") " pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:23.791327 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.791235    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-tmp-dir\") pod \"auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") " pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:23.891922 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.891889    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-model-cache\") pod \"auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") " pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:23.892119 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.891937    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgm5p\" (UniqueName: \"kubernetes.io/projected/b3e66371-b7d1-47cc-828d-f8456ab134ed-kube-api-access-vgm5p\") pod \"auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") " pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:23.892119 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.891994    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-home\") pod \"auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") " pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:23.892119 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.892037    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-dshm\") pod \"auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") " pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:23.892300 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.892254    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-tmp-dir\") pod \"auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") " pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:23.892359 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.892334    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-model-cache\") pod \"auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") " pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:23.892413 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.892342    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3e66371-b7d1-47cc-828d-f8456ab134ed-tls-certs\") pod \"auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") " pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:23.892413 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.892393    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-home\") pod \"auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") " pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:23.892593 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.892577    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-tmp-dir\") pod \"auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") " pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:23.894270 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.894248    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-dshm\") pod \"auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") " pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:23.894706 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.894687    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3e66371-b7d1-47cc-828d-f8456ab134ed-tls-certs\") pod \"auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") " pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:23.900213 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:23.900193    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgm5p\" (UniqueName: \"kubernetes.io/projected/b3e66371-b7d1-47cc-828d-f8456ab134ed-kube-api-access-vgm5p\") pod \"auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") " pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:24.013188 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:24.013161    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:24.296645 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:24.296613    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"]
Sep 17 11:14:24.298353 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:14:24.298325    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3e66371_b7d1_47cc_828d_f8456ab134ed.slice/crio-9e9b7a4f322e08c3fb9327252935232720ad6e766e4f8bc25bf6b67937ed46b8 WatchSource:0}: Error finding container 9e9b7a4f322e08c3fb9327252935232720ad6e766e4f8bc25bf6b67937ed46b8: Status 404 returned error can't find the container with id 9e9b7a4f322e08c3fb9327252935232720ad6e766e4f8bc25bf6b67937ed46b8
Sep 17 11:14:24.717865 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:24.717783    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r" event={"ID":"b3e66371-b7d1-47cc-828d-f8456ab134ed","Type":"ContainerStarted","Data":"5d7833e9a7677c9ba06effefb75e454e9984ecefd00b8c4192cd0afde7962bd4"}
Sep 17 11:14:24.717865 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:24.717820    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r" event={"ID":"b3e66371-b7d1-47cc-828d-f8456ab134ed","Type":"ContainerStarted","Data":"9e9b7a4f322e08c3fb9327252935232720ad6e766e4f8bc25bf6b67937ed46b8"}
Sep 17 11:14:24.739476 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:24.739425    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r" podStartSLOduration=1.739405039 podStartE2EDuration="1.739405039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:14:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:14:24.739341762 +0000 UTC m=+1254.534676202" watchObservedRunningTime="2026-09-17 11:14:24.739405039 +0000 UTC m=+1254.534739478"
Sep 17 11:14:26.025495 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:26.025461    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"]
Sep 17 11:14:34.013694 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:34.013660    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:34.014101 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:34.013954    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:34.026775 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:34.026751    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:34.784902 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:34.784877    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:14:36.831946 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:36.831907    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"]
Sep 17 11:14:36.832389 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:36.832235    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq" podUID="de8267ad-49f7-4423-8ea9-d97a132cfc63" containerName="maas-api" containerID="cri-o://95d4bf765db03e15bc0e6995339c598f666dc36e5e909f6e87a9c312767349cf" gracePeriod=30
Sep 17 11:14:36.882375 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:36.882331    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq" podUID="de8267ad-49f7-4423-8ea9-d97a132cfc63" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.43:8443/health\": dial tcp 10.134.0.43:8443: connect: connection refused"
Sep 17 11:14:37.316245 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.316219    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"
Sep 17 11:14:37.423340 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.423252    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de8267ad-49f7-4423-8ea9-d97a132cfc63-maas-api-tls\") pod \"de8267ad-49f7-4423-8ea9-d97a132cfc63\" (UID: \"de8267ad-49f7-4423-8ea9-d97a132cfc63\") "
Sep 17 11:14:37.423340 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.423295    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de8267ad-49f7-4423-8ea9-d97a132cfc63-metrics-certs\") pod \"de8267ad-49f7-4423-8ea9-d97a132cfc63\" (UID: \"de8267ad-49f7-4423-8ea9-d97a132cfc63\") "
Sep 17 11:14:37.423599 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.423401    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de8267ad-49f7-4423-8ea9-d97a132cfc63-openshift-service-ca\") pod \"de8267ad-49f7-4423-8ea9-d97a132cfc63\" (UID: \"de8267ad-49f7-4423-8ea9-d97a132cfc63\") "
Sep 17 11:14:37.423599 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.423434    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7lvd\" (UniqueName: \"kubernetes.io/projected/de8267ad-49f7-4423-8ea9-d97a132cfc63-kube-api-access-h7lvd\") pod \"de8267ad-49f7-4423-8ea9-d97a132cfc63\" (UID: \"de8267ad-49f7-4423-8ea9-d97a132cfc63\") "
Sep 17 11:14:37.423796 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.423765    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de8267ad-49f7-4423-8ea9-d97a132cfc63-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "de8267ad-49f7-4423-8ea9-d97a132cfc63" (UID: "de8267ad-49f7-4423-8ea9-d97a132cfc63"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:14:37.425607 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.425579    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de8267ad-49f7-4423-8ea9-d97a132cfc63-kube-api-access-h7lvd" (OuterVolumeSpecName: "kube-api-access-h7lvd") pod "de8267ad-49f7-4423-8ea9-d97a132cfc63" (UID: "de8267ad-49f7-4423-8ea9-d97a132cfc63"). InnerVolumeSpecName "kube-api-access-h7lvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:14:37.425830 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.425810    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de8267ad-49f7-4423-8ea9-d97a132cfc63-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "de8267ad-49f7-4423-8ea9-d97a132cfc63" (UID: "de8267ad-49f7-4423-8ea9-d97a132cfc63"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:14:37.425888 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.425857    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de8267ad-49f7-4423-8ea9-d97a132cfc63-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "de8267ad-49f7-4423-8ea9-d97a132cfc63" (UID: "de8267ad-49f7-4423-8ea9-d97a132cfc63"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:14:37.525231 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.525190    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de8267ad-49f7-4423-8ea9-d97a132cfc63-maas-api-tls\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:37.525231 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.525225    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de8267ad-49f7-4423-8ea9-d97a132cfc63-metrics-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:37.525231 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.525235    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de8267ad-49f7-4423-8ea9-d97a132cfc63-openshift-service-ca\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:37.525231 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.525244    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7lvd\" (UniqueName: \"kubernetes.io/projected/de8267ad-49f7-4423-8ea9-d97a132cfc63-kube-api-access-h7lvd\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:37.791340 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.791299    2570 generic.go:356] "Generic (PLEG): container finished" podID="de8267ad-49f7-4423-8ea9-d97a132cfc63" containerID="95d4bf765db03e15bc0e6995339c598f666dc36e5e909f6e87a9c312767349cf" exitCode=0
Sep 17 11:14:37.791340 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.791342    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq" event={"ID":"de8267ad-49f7-4423-8ea9-d97a132cfc63","Type":"ContainerDied","Data":"95d4bf765db03e15bc0e6995339c598f666dc36e5e909f6e87a9c312767349cf"}
Sep 17 11:14:37.791618 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.791352    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"
Sep 17 11:14:37.791618 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.791384    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq" event={"ID":"de8267ad-49f7-4423-8ea9-d97a132cfc63","Type":"ContainerDied","Data":"341bcf3e1dad308e5f4a1f7caafbdab577b4e75848687a5c7eee55c2d64ebf4f"}
Sep 17 11:14:37.791618 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.791405    2570 scope.go:117] "RemoveContainer" containerID="95d4bf765db03e15bc0e6995339c598f666dc36e5e909f6e87a9c312767349cf"
Sep 17 11:14:37.800808 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.800785    2570 scope.go:117] "RemoveContainer" containerID="95d4bf765db03e15bc0e6995339c598f666dc36e5e909f6e87a9c312767349cf"
Sep 17 11:14:37.801097 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:14:37.801066    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95d4bf765db03e15bc0e6995339c598f666dc36e5e909f6e87a9c312767349cf\": container with ID starting with 95d4bf765db03e15bc0e6995339c598f666dc36e5e909f6e87a9c312767349cf not found: ID does not exist" containerID="95d4bf765db03e15bc0e6995339c598f666dc36e5e909f6e87a9c312767349cf"
Sep 17 11:14:37.801147 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.801105    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95d4bf765db03e15bc0e6995339c598f666dc36e5e909f6e87a9c312767349cf"} err="failed to get container status \"95d4bf765db03e15bc0e6995339c598f666dc36e5e909f6e87a9c312767349cf\": rpc error: code = NotFound desc = could not find container \"95d4bf765db03e15bc0e6995339c598f666dc36e5e909f6e87a9c312767349cf\": container with ID starting with 95d4bf765db03e15bc0e6995339c598f666dc36e5e909f6e87a9c312767349cf not found: ID does not exist"
Sep 17 11:14:37.825436 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.825408    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"]
Sep 17 11:14:37.835680 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:37.835657    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-d7b97f-7d849b5957-tx8cq"]
Sep 17 11:14:38.690583 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:38.690542    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de8267ad-49f7-4423-8ea9-d97a132cfc63" path="/var/lib/kubelet/pods/de8267ad-49f7-4423-8ea9-d97a132cfc63/volumes"
Sep 17 11:14:41.045032 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.044965    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d" podUID="9fb7cae8-44d1-47ad-bb42-6da56b1de345" containerName="main" containerID="cri-o://11a1e1d1221ec354d1af2a2ea5d659db5845e7c571f658a6c3ff82e840de7b3f" gracePeriod=45
Sep 17 11:14:41.295228 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.295159    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:14:41.366728 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.366691    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59rgf\" (UniqueName: \"kubernetes.io/projected/9fb7cae8-44d1-47ad-bb42-6da56b1de345-kube-api-access-59rgf\") pod \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") "
Sep 17 11:14:41.366728 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.366730    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-dshm\") pod \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") "
Sep 17 11:14:41.366967 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.366754    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-tmp-dir\") pod \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") "
Sep 17 11:14:41.366967 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.366782    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fb7cae8-44d1-47ad-bb42-6da56b1de345-tls-certs\") pod \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") "
Sep 17 11:14:41.366967 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.366809    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-home\") pod \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") "
Sep 17 11:14:41.366967 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.366850    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-model-cache\") pod \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\" (UID: \"9fb7cae8-44d1-47ad-bb42-6da56b1de345\") "
Sep 17 11:14:41.367173 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.367075    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9fb7cae8-44d1-47ad-bb42-6da56b1de345" (UID: "9fb7cae8-44d1-47ad-bb42-6da56b1de345"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:14:41.367404 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.367162    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-home" (OuterVolumeSpecName: "home") pod "9fb7cae8-44d1-47ad-bb42-6da56b1de345" (UID: "9fb7cae8-44d1-47ad-bb42-6da56b1de345"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:14:41.367404 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.367224    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-tmp-dir\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:41.367404 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.367252    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-model-cache" (OuterVolumeSpecName: "model-cache") pod "9fb7cae8-44d1-47ad-bb42-6da56b1de345" (UID: "9fb7cae8-44d1-47ad-bb42-6da56b1de345"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:14:41.369088 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.369055    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fb7cae8-44d1-47ad-bb42-6da56b1de345-kube-api-access-59rgf" (OuterVolumeSpecName: "kube-api-access-59rgf") pod "9fb7cae8-44d1-47ad-bb42-6da56b1de345" (UID: "9fb7cae8-44d1-47ad-bb42-6da56b1de345"). InnerVolumeSpecName "kube-api-access-59rgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:14:41.369399 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.369362    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fb7cae8-44d1-47ad-bb42-6da56b1de345-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9fb7cae8-44d1-47ad-bb42-6da56b1de345" (UID: "9fb7cae8-44d1-47ad-bb42-6da56b1de345"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:14:41.369543 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.369410    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-dshm" (OuterVolumeSpecName: "dshm") pod "9fb7cae8-44d1-47ad-bb42-6da56b1de345" (UID: "9fb7cae8-44d1-47ad-bb42-6da56b1de345"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:14:41.468315 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.468278    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-home\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:41.468315 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.468310    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-model-cache\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:41.468315 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.468321    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59rgf\" (UniqueName: \"kubernetes.io/projected/9fb7cae8-44d1-47ad-bb42-6da56b1de345-kube-api-access-59rgf\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:41.468581 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.468330    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fb7cae8-44d1-47ad-bb42-6da56b1de345-dshm\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:41.468581 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.468339    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fb7cae8-44d1-47ad-bb42-6da56b1de345-tls-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:41.816306 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.816272    2570 generic.go:356] "Generic (PLEG): container finished" podID="9fb7cae8-44d1-47ad-bb42-6da56b1de345" containerID="11a1e1d1221ec354d1af2a2ea5d659db5845e7c571f658a6c3ff82e840de7b3f" exitCode=0
Sep 17 11:14:41.816479 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.816319    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"
Sep 17 11:14:41.816479 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.816332    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d" event={"ID":"9fb7cae8-44d1-47ad-bb42-6da56b1de345","Type":"ContainerDied","Data":"11a1e1d1221ec354d1af2a2ea5d659db5845e7c571f658a6c3ff82e840de7b3f"}
Sep 17 11:14:41.816479 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.816362    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d" event={"ID":"9fb7cae8-44d1-47ad-bb42-6da56b1de345","Type":"ContainerDied","Data":"c936b76f0dcccf0f17f5211ea8a4f393f14bc9ff0865cfe78cdaabfb6d04be38"}
Sep 17 11:14:41.816479 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.816378    2570 scope.go:117] "RemoveContainer" containerID="11a1e1d1221ec354d1af2a2ea5d659db5845e7c571f658a6c3ff82e840de7b3f"
Sep 17 11:14:41.827333 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.827311    2570 scope.go:117] "RemoveContainer" containerID="11a1e1d1221ec354d1af2a2ea5d659db5845e7c571f658a6c3ff82e840de7b3f"
Sep 17 11:14:41.827672 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:14:41.827653    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11a1e1d1221ec354d1af2a2ea5d659db5845e7c571f658a6c3ff82e840de7b3f\": container with ID starting with 11a1e1d1221ec354d1af2a2ea5d659db5845e7c571f658a6c3ff82e840de7b3f not found: ID does not exist" containerID="11a1e1d1221ec354d1af2a2ea5d659db5845e7c571f658a6c3ff82e840de7b3f"
Sep 17 11:14:41.827718 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.827680    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a1e1d1221ec354d1af2a2ea5d659db5845e7c571f658a6c3ff82e840de7b3f"} err="failed to get container status \"11a1e1d1221ec354d1af2a2ea5d659db5845e7c571f658a6c3ff82e840de7b3f\": rpc error: code = NotFound desc = could not find container \"11a1e1d1221ec354d1af2a2ea5d659db5845e7c571f658a6c3ff82e840de7b3f\": container with ID starting with 11a1e1d1221ec354d1af2a2ea5d659db5845e7c571f658a6c3ff82e840de7b3f not found: ID does not exist"
Sep 17 11:14:41.861867 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.861821    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"]
Sep 17 11:14:41.870542 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:41.870501    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-d7b97f/distinct-2-w0-d7b97f-kserve-7c568d869-r5j6d"]
Sep 17 11:14:42.691314 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:42.691277    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fb7cae8-44d1-47ad-bb42-6da56b1de345" path="/var/lib/kubelet/pods/9fb7cae8-44d1-47ad-bb42-6da56b1de345/volumes"
Sep 17 11:14:44.120105 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:44.120067    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"]
Sep 17 11:14:44.120592 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:44.120342    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z" podUID="6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" containerName="istio-proxy" containerID="cri-o://e4e5650725c0058d429d3b4b7508daed764b40c9ff3149028bfb697073d8b434" gracePeriod=30
Sep 17 11:14:44.387325 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:44.387214    2570 patch_prober.go:28] interesting pod/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 11:14:44.387325 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:44.387297    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z" podUID="6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 11:14:46.503288 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.503247    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97"]
Sep 17 11:14:46.503899 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.503547    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97" podUID="68c5e697-0e1d-4c96-bb25-1c45af99b312" containerName="payload-processing" containerID="cri-o://b74f376d984114db52e497cb5156aca635bace98857943413ba4cbb8f9e241c8" gracePeriod=30
Sep 17 11:14:46.517147 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.517114    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj"]
Sep 17 11:14:46.517390 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.517360    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj" podUID="d21e8d31-1a20-4957-a3d7-047cf2bc0bad" containerName="payload-pre-processing" containerID="cri-o://44cb1f8054f8c24ab771731b26c7ededf13aba6f6f6d24e8916d7fe4503fec40" gracePeriod=30
Sep 17 11:14:46.806357 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.806333    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97"
Sep 17 11:14:46.809633 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.809610    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj"
Sep 17 11:14:46.857310 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.857260    2570 generic.go:356] "Generic (PLEG): container finished" podID="d21e8d31-1a20-4957-a3d7-047cf2bc0bad" containerID="44cb1f8054f8c24ab771731b26c7ededf13aba6f6f6d24e8916d7fe4503fec40" exitCode=0
Sep 17 11:14:46.857492 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.857414    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj"
Sep 17 11:14:46.857854 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.857634    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj" event={"ID":"d21e8d31-1a20-4957-a3d7-047cf2bc0bad","Type":"ContainerDied","Data":"44cb1f8054f8c24ab771731b26c7ededf13aba6f6f6d24e8916d7fe4503fec40"}
Sep 17 11:14:46.857854 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.857698    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj" event={"ID":"d21e8d31-1a20-4957-a3d7-047cf2bc0bad","Type":"ContainerDied","Data":"0998099e9558999b19dbbccb409434c88428d8c7bd6b08ca046001b029831aff"}
Sep 17 11:14:46.857854 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.857730    2570 scope.go:117] "RemoveContainer" containerID="44cb1f8054f8c24ab771731b26c7ededf13aba6f6f6d24e8916d7fe4503fec40"
Sep 17 11:14:46.860333 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.860306    2570 generic.go:356] "Generic (PLEG): container finished" podID="68c5e697-0e1d-4c96-bb25-1c45af99b312" containerID="b74f376d984114db52e497cb5156aca635bace98857943413ba4cbb8f9e241c8" exitCode=0
Sep 17 11:14:46.860447 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.860348    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97" event={"ID":"68c5e697-0e1d-4c96-bb25-1c45af99b312","Type":"ContainerDied","Data":"b74f376d984114db52e497cb5156aca635bace98857943413ba4cbb8f9e241c8"}
Sep 17 11:14:46.860447 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.860387    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97" event={"ID":"68c5e697-0e1d-4c96-bb25-1c45af99b312","Type":"ContainerDied","Data":"cf098e0c81c14545a27e915f240f170523d426cdbb8965898cc607b36e082bff"}
Sep 17 11:14:46.860447 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.860352    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97"
Sep 17 11:14:46.869202 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.869181    2570 scope.go:117] "RemoveContainer" containerID="44cb1f8054f8c24ab771731b26c7ededf13aba6f6f6d24e8916d7fe4503fec40"
Sep 17 11:14:46.869573 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:14:46.869543    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44cb1f8054f8c24ab771731b26c7ededf13aba6f6f6d24e8916d7fe4503fec40\": container with ID starting with 44cb1f8054f8c24ab771731b26c7ededf13aba6f6f6d24e8916d7fe4503fec40 not found: ID does not exist" containerID="44cb1f8054f8c24ab771731b26c7ededf13aba6f6f6d24e8916d7fe4503fec40"
Sep 17 11:14:46.869715 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.869584    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44cb1f8054f8c24ab771731b26c7ededf13aba6f6f6d24e8916d7fe4503fec40"} err="failed to get container status \"44cb1f8054f8c24ab771731b26c7ededf13aba6f6f6d24e8916d7fe4503fec40\": rpc error: code = NotFound desc = could not find container \"44cb1f8054f8c24ab771731b26c7ededf13aba6f6f6d24e8916d7fe4503fec40\": container with ID starting with 44cb1f8054f8c24ab771731b26c7ededf13aba6f6f6d24e8916d7fe4503fec40 not found: ID does not exist"
Sep 17 11:14:46.869715 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.869607    2570 scope.go:117] "RemoveContainer" containerID="b74f376d984114db52e497cb5156aca635bace98857943413ba4cbb8f9e241c8"
Sep 17 11:14:46.878694 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.878615    2570 scope.go:117] "RemoveContainer" containerID="b74f376d984114db52e497cb5156aca635bace98857943413ba4cbb8f9e241c8"
Sep 17 11:14:46.878931 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:14:46.878902    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b74f376d984114db52e497cb5156aca635bace98857943413ba4cbb8f9e241c8\": container with ID starting with b74f376d984114db52e497cb5156aca635bace98857943413ba4cbb8f9e241c8 not found: ID does not exist" containerID="b74f376d984114db52e497cb5156aca635bace98857943413ba4cbb8f9e241c8"
Sep 17 11:14:46.879041 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.878929    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74f376d984114db52e497cb5156aca635bace98857943413ba4cbb8f9e241c8"} err="failed to get container status \"b74f376d984114db52e497cb5156aca635bace98857943413ba4cbb8f9e241c8\": rpc error: code = NotFound desc = could not find container \"b74f376d984114db52e497cb5156aca635bace98857943413ba4cbb8f9e241c8\": container with ID starting with b74f376d984114db52e497cb5156aca635bace98857943413ba4cbb8f9e241c8 not found: ID does not exist"
Sep 17 11:14:46.924032 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.923993    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5z4br\" (UniqueName: \"kubernetes.io/projected/d21e8d31-1a20-4957-a3d7-047cf2bc0bad-kube-api-access-5z4br\") pod \"d21e8d31-1a20-4957-a3d7-047cf2bc0bad\" (UID: \"d21e8d31-1a20-4957-a3d7-047cf2bc0bad\") "
Sep 17 11:14:46.924202 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.924051    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68c5e697-0e1d-4c96-bb25-1c45af99b312-plugins-config-volume\") pod \"68c5e697-0e1d-4c96-bb25-1c45af99b312\" (UID: \"68c5e697-0e1d-4c96-bb25-1c45af99b312\") "
Sep 17 11:14:46.924202 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.924150    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d21e8d31-1a20-4957-a3d7-047cf2bc0bad-plugins-config-volume\") pod \"d21e8d31-1a20-4957-a3d7-047cf2bc0bad\" (UID: \"d21e8d31-1a20-4957-a3d7-047cf2bc0bad\") "
Sep 17 11:14:46.924282 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.924217    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdlt7\" (UniqueName: \"kubernetes.io/projected/68c5e697-0e1d-4c96-bb25-1c45af99b312-kube-api-access-rdlt7\") pod \"68c5e697-0e1d-4c96-bb25-1c45af99b312\" (UID: \"68c5e697-0e1d-4c96-bb25-1c45af99b312\") "
Sep 17 11:14:46.924559 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.924533    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68c5e697-0e1d-4c96-bb25-1c45af99b312-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "68c5e697-0e1d-4c96-bb25-1c45af99b312" (UID: "68c5e697-0e1d-4c96-bb25-1c45af99b312"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:14:46.924633 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.924573    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d21e8d31-1a20-4957-a3d7-047cf2bc0bad-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d21e8d31-1a20-4957-a3d7-047cf2bc0bad" (UID: "d21e8d31-1a20-4957-a3d7-047cf2bc0bad"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:14:46.926228 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.926206    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68c5e697-0e1d-4c96-bb25-1c45af99b312-kube-api-access-rdlt7" (OuterVolumeSpecName: "kube-api-access-rdlt7") pod "68c5e697-0e1d-4c96-bb25-1c45af99b312" (UID: "68c5e697-0e1d-4c96-bb25-1c45af99b312"). InnerVolumeSpecName "kube-api-access-rdlt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:14:46.926302 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:46.926244    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d21e8d31-1a20-4957-a3d7-047cf2bc0bad-kube-api-access-5z4br" (OuterVolumeSpecName: "kube-api-access-5z4br") pod "d21e8d31-1a20-4957-a3d7-047cf2bc0bad" (UID: "d21e8d31-1a20-4957-a3d7-047cf2bc0bad"). InnerVolumeSpecName "kube-api-access-5z4br". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:14:47.025590 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:47.025549    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d21e8d31-1a20-4957-a3d7-047cf2bc0bad-plugins-config-volume\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:47.025590 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:47.025581    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdlt7\" (UniqueName: \"kubernetes.io/projected/68c5e697-0e1d-4c96-bb25-1c45af99b312-kube-api-access-rdlt7\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:47.025590 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:47.025591    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5z4br\" (UniqueName: \"kubernetes.io/projected/d21e8d31-1a20-4957-a3d7-047cf2bc0bad-kube-api-access-5z4br\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:47.025590 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:47.025600    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68c5e697-0e1d-4c96-bb25-1c45af99b312-plugins-config-volume\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:47.221422 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:47.221384    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj"]
Sep 17 11:14:47.232721 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:47.232688    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d078f791-668f96ccfd-7z2pj"]
Sep 17 11:14:47.261741 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:47.261702    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97"]
Sep 17 11:14:47.273394 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:47.273363    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d078f791-5cbb8464b5-x4h97"]
Sep 17 11:14:48.691063 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:48.691031    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68c5e697-0e1d-4c96-bb25-1c45af99b312" path="/var/lib/kubelet/pods/68c5e697-0e1d-4c96-bb25-1c45af99b312/volumes"
Sep 17 11:14:48.691470 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:48.691453    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d21e8d31-1a20-4957-a3d7-047cf2bc0bad" path="/var/lib/kubelet/pods/d21e8d31-1a20-4957-a3d7-047cf2bc0bad/volumes"
Sep 17 11:14:49.377902 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.377876    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:14:49.548790 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.548755    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-token\") pod \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") "
Sep 17 11:14:49.548790 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.548803    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-credential-socket\") pod \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") "
Sep 17 11:14:49.549050 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.548852    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-workload-certs\") pod \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") "
Sep 17 11:14:49.549050 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.548868    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-envoy\") pod \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") "
Sep 17 11:14:49.549050 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.548920    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkrgq\" (UniqueName: \"kubernetes.io/projected/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-kube-api-access-pkrgq\") pod \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") "
Sep 17 11:14:49.549050 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.548961    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-data\") pod \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") "
Sep 17 11:14:49.549050 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.548995    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-workload-socket\") pod \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") "
Sep 17 11:14:49.549429 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.549400    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istiod-ca-cert\") pod \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") "
Sep 17 11:14:49.549505 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.549155    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" (UID: "6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:14:49.549505 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.549446    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-podinfo\") pod \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\" (UID: \"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4\") "
Sep 17 11:14:49.549505 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.549252    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" (UID: "6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:14:49.549505 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.549292    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-data" (OuterVolumeSpecName: "istio-data") pod "6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" (UID: "6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:14:49.549505 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.549346    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" (UID: "6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:14:49.549862 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.549841    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-workload-socket\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:49.549933 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.549869    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-credential-socket\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:49.549933 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.549882    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-workload-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:49.549933 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.549894    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-data\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:49.550303 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.550276    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" (UID: "6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:14:49.551830 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.551790    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" (UID: "6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:14:49.552076 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.552054    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" (UID: "6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 11:14:49.552207 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.552179    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-kube-api-access-pkrgq" (OuterVolumeSpecName: "kube-api-access-pkrgq") pod "6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" (UID: "6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4"). InnerVolumeSpecName "kube-api-access-pkrgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:14:49.552392 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.552341    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-token" (OuterVolumeSpecName: "istio-token") pod "6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" (UID: "6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:14:49.651403 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.651367    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istiod-ca-cert\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:49.651403 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.651397    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-podinfo\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:49.651403 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.651406    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-token\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:49.651403 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.651414    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-istio-envoy\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:49.651700 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.651422    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkrgq\" (UniqueName: \"kubernetes.io/projected/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4-kube-api-access-pkrgq\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:14:49.880116 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.880017    2570 generic.go:356] "Generic (PLEG): container finished" podID="6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" containerID="e4e5650725c0058d429d3b4b7508daed764b40c9ff3149028bfb697073d8b434" exitCode=0
Sep 17 11:14:49.880116 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.880065    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"
Sep 17 11:14:49.880610 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.880112    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z" event={"ID":"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4","Type":"ContainerDied","Data":"e4e5650725c0058d429d3b4b7508daed764b40c9ff3149028bfb697073d8b434"}
Sep 17 11:14:49.880610 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.880177    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z" event={"ID":"6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4","Type":"ContainerDied","Data":"61fca212cec87bac90a8ac5ad5a312d35afb6523fe72cec1b18e230e730ec26c"}
Sep 17 11:14:49.880610 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.880200    2570 scope.go:117] "RemoveContainer" containerID="e4e5650725c0058d429d3b4b7508daed764b40c9ff3149028bfb697073d8b434"
Sep 17 11:14:49.891781 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.891757    2570 scope.go:117] "RemoveContainer" containerID="fdf2eb113e21d97ddf1e1a14b52565b624c30dfb97dd9199f89cd8d1f2005994"
Sep 17 11:14:49.901321 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.901301    2570 scope.go:117] "RemoveContainer" containerID="e4e5650725c0058d429d3b4b7508daed764b40c9ff3149028bfb697073d8b434"
Sep 17 11:14:49.901618 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:14:49.901597    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4e5650725c0058d429d3b4b7508daed764b40c9ff3149028bfb697073d8b434\": container with ID starting with e4e5650725c0058d429d3b4b7508daed764b40c9ff3149028bfb697073d8b434 not found: ID does not exist" containerID="e4e5650725c0058d429d3b4b7508daed764b40c9ff3149028bfb697073d8b434"
Sep 17 11:14:49.901677 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.901627    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4e5650725c0058d429d3b4b7508daed764b40c9ff3149028bfb697073d8b434"} err="failed to get container status \"e4e5650725c0058d429d3b4b7508daed764b40c9ff3149028bfb697073d8b434\": rpc error: code = NotFound desc = could not find container \"e4e5650725c0058d429d3b4b7508daed764b40c9ff3149028bfb697073d8b434\": container with ID starting with e4e5650725c0058d429d3b4b7508daed764b40c9ff3149028bfb697073d8b434 not found: ID does not exist"
Sep 17 11:14:49.901677 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.901644    2570 scope.go:117] "RemoveContainer" containerID="fdf2eb113e21d97ddf1e1a14b52565b624c30dfb97dd9199f89cd8d1f2005994"
Sep 17 11:14:49.901901 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:14:49.901884    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdf2eb113e21d97ddf1e1a14b52565b624c30dfb97dd9199f89cd8d1f2005994\": container with ID starting with fdf2eb113e21d97ddf1e1a14b52565b624c30dfb97dd9199f89cd8d1f2005994 not found: ID does not exist" containerID="fdf2eb113e21d97ddf1e1a14b52565b624c30dfb97dd9199f89cd8d1f2005994"
Sep 17 11:14:49.901944 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.901908    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdf2eb113e21d97ddf1e1a14b52565b624c30dfb97dd9199f89cd8d1f2005994"} err="failed to get container status \"fdf2eb113e21d97ddf1e1a14b52565b624c30dfb97dd9199f89cd8d1f2005994\": rpc error: code = NotFound desc = could not find container \"fdf2eb113e21d97ddf1e1a14b52565b624c30dfb97dd9199f89cd8d1f2005994\": container with ID starting with fdf2eb113e21d97ddf1e1a14b52565b624c30dfb97dd9199f89cd8d1f2005994 not found: ID does not exist"
Sep 17 11:14:49.910667 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.910642    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"]
Sep 17 11:14:49.913606 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:49.913583    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-d7b97f-openshift-default-67447b7f4-f2f2z"]
Sep 17 11:14:50.691529 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:14:50.691476    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" path="/var/lib/kubelet/pods/6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4/volumes"
Sep 17 11:15:00.149780 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.149746    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-b8287f-29827395-6776x"]
Sep 17 11:15:00.150255 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.150155    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de8267ad-49f7-4423-8ea9-d97a132cfc63" containerName="maas-api"
Sep 17 11:15:00.150255 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.150170    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="de8267ad-49f7-4423-8ea9-d97a132cfc63" containerName="maas-api"
Sep 17 11:15:00.150255 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.150179    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" containerName="istio-proxy"
Sep 17 11:15:00.150255 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.150185    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" containerName="istio-proxy"
Sep 17 11:15:00.150255 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.150199    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68c5e697-0e1d-4c96-bb25-1c45af99b312" containerName="payload-processing"
Sep 17 11:15:00.150255 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.150205    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="68c5e697-0e1d-4c96-bb25-1c45af99b312" containerName="payload-processing"
Sep 17 11:15:00.150255 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.150213    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" containerName="istio-proxy"
Sep 17 11:15:00.150255 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.150218    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" containerName="istio-proxy"
Sep 17 11:15:00.150255 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.150228    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d21e8d31-1a20-4957-a3d7-047cf2bc0bad" containerName="payload-pre-processing"
Sep 17 11:15:00.150255 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.150238    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d21e8d31-1a20-4957-a3d7-047cf2bc0bad" containerName="payload-pre-processing"
Sep 17 11:15:00.150255 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.150255    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fb7cae8-44d1-47ad-bb42-6da56b1de345" containerName="main"
Sep 17 11:15:00.150255 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.150261    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fb7cae8-44d1-47ad-bb42-6da56b1de345" containerName="main"
Sep 17 11:15:00.150881 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.150321    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" containerName="istio-proxy"
Sep 17 11:15:00.150881 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.150330    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="de8267ad-49f7-4423-8ea9-d97a132cfc63" containerName="maas-api"
Sep 17 11:15:00.150881 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.150336    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ad3ce73-73d6-4a5e-ae1c-83670b7abdf4" containerName="istio-proxy"
Sep 17 11:15:00.150881 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.150346    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fb7cae8-44d1-47ad-bb42-6da56b1de345" containerName="main"
Sep 17 11:15:00.150881 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.150350    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d21e8d31-1a20-4957-a3d7-047cf2bc0bad" containerName="payload-pre-processing"
Sep 17 11:15:00.150881 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.150357    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="68c5e697-0e1d-4c96-bb25-1c45af99b312" containerName="payload-processing"
Sep 17 11:15:00.153255 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.153232    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-b8287f-29827395-6776x"
Sep 17 11:15:00.158033 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.158011    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pnptl\""
Sep 17 11:15:00.163128 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.163107    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-b8287f-29827395-6776x"
Sep 17 11:15:00.169656 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.169632    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-b8287f-29827395-6776x"]
Sep 17 11:15:00.447052 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.446975    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-b8287f-29827395-6776x"]
Sep 17 11:15:00.450405 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:15:00.450364    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8781fac0_82e6_43a0_9899_c9ccce87c438.slice/crio-d1cca08d07c27bb8103aa49c1863ccea1070137f7e0132023b9b2e76a7413497 WatchSource:0}: Error finding container d1cca08d07c27bb8103aa49c1863ccea1070137f7e0132023b9b2e76a7413497: Status 404 returned error can't find the container with id d1cca08d07c27bb8103aa49c1863ccea1070137f7e0132023b9b2e76a7413497
Sep 17 11:15:00.945859 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:00.945814    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-b8287f-29827395-6776x" event={"ID":"8781fac0-82e6-43a0-9899-c9ccce87c438","Type":"ContainerStarted","Data":"d1cca08d07c27bb8103aa49c1863ccea1070137f7e0132023b9b2e76a7413497"}
Sep 17 11:15:03.966919 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:03.966822    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-b8287f-29827395-6776x" event={"ID":"8781fac0-82e6-43a0-9899-c9ccce87c438","Type":"ContainerStarted","Data":"e0abbf9772e62187e8f867e97332d101156455d01cdbd5c04b385bdf0aa0922d"}
Sep 17 11:15:03.993480 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:03.993431    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-b8287f-29827395-6776x" podStartSLOduration=1.216760708 podStartE2EDuration="3.99341727s" totalImagesPullingTime="2.776656562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:15:03.991802268 +0000 UTC m=+1293.787136707" watchObservedRunningTime="2026-09-17 11:15:03.99341727 +0000 UTC m=+1293.788751709"
Sep 17 11:15:04.973729 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:04.973696    2570 generic.go:356] "Generic (PLEG): container finished" podID="8781fac0-82e6-43a0-9899-c9ccce87c438" containerID="e0abbf9772e62187e8f867e97332d101156455d01cdbd5c04b385bdf0aa0922d" exitCode=0
Sep 17 11:15:04.974079 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:04.973781    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-b8287f-29827395-6776x" event={"ID":"8781fac0-82e6-43a0-9899-c9ccce87c438","Type":"ContainerDied","Data":"e0abbf9772e62187e8f867e97332d101156455d01cdbd5c04b385bdf0aa0922d"}
Sep 17 11:15:06.108751 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:06.108723    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-b8287f-29827395-6776x"
Sep 17 11:15:06.985532 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:06.985424    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-b8287f-29827395-6776x" event={"ID":"8781fac0-82e6-43a0-9899-c9ccce87c438","Type":"ContainerDied","Data":"d1cca08d07c27bb8103aa49c1863ccea1070137f7e0132023b9b2e76a7413497"}
Sep 17 11:15:06.985532 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:06.985455    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-b8287f-29827395-6776x"
Sep 17 11:15:06.985719 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:06.985531    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d1cca08d07c27bb8103aa49c1863ccea1070137f7e0132023b9b2e76a7413497"
Sep 17 11:15:12.630571 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:12.630539    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"]
Sep 17 11:15:12.631036 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:12.631014    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8781fac0-82e6-43a0-9899-c9ccce87c438" containerName="cleanup"
Sep 17 11:15:12.631036 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:12.631036    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8781fac0-82e6-43a0-9899-c9ccce87c438" containerName="cleanup"
Sep 17 11:15:12.631289 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:12.631156    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8781fac0-82e6-43a0-9899-c9ccce87c438" containerName="cleanup"
Sep 17 11:15:12.635263 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:12.635237    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"
Sep 17 11:15:12.638206 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:12.638184    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w1-7751cd-serving-cert\""
Sep 17 11:15:12.639147 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:12.639132    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gvplj\""
Sep 17 11:15:12.647003 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:12.646966    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"]
Sep 17 11:15:12.766950 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:12.766914    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/183d5dbf-4edc-4e8b-a1e8-253233b1a631-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq\" (UID: \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"
Sep 17 11:15:12.767141 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:12.766967    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/183d5dbf-4edc-4e8b-a1e8-253233b1a631-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq\" (UID: \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"
Sep 17 11:15:12.767141 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:12.767029    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqz8z\" (UniqueName: \"kubernetes.io/projected/183d5dbf-4edc-4e8b-a1e8-253233b1a631-kube-api-access-lqz8z\") pod \"maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq\" (UID: \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"
Sep 17 11:15:12.767141 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:12.767117    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/183d5dbf-4edc-4e8b-a1e8-253233b1a631-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq\" (UID: \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"
Sep 17 11:15:12.868140 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:12.868109    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/183d5dbf-4edc-4e8b-a1e8-253233b1a631-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq\" (UID: \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"
Sep 17 11:15:12.868140 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:12.868141    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/183d5dbf-4edc-4e8b-a1e8-253233b1a631-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq\" (UID: \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"
Sep 17 11:15:12.868347 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:12.868164    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqz8z\" (UniqueName: \"kubernetes.io/projected/183d5dbf-4edc-4e8b-a1e8-253233b1a631-kube-api-access-lqz8z\") pod \"maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq\" (UID: \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"
Sep 17 11:15:12.868347 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:12.868209    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/183d5dbf-4edc-4e8b-a1e8-253233b1a631-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq\" (UID: \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"
Sep 17 11:15:12.868347 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:15:12.868321    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-serving-cert: secret "maas-api-e2e-shared-a-w1-7751cd-serving-cert" not found
Sep 17 11:15:12.868501 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:15:12.868388    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/183d5dbf-4edc-4e8b-a1e8-253233b1a631-maas-api-tls podName:183d5dbf-4edc-4e8b-a1e8-253233b1a631 nodeName:}" failed. No retries permitted until 2026-09-17 11:15:13.368368346 +0000 UTC m=+1303.163702765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/183d5dbf-4edc-4e8b-a1e8-253233b1a631-maas-api-tls") pod "maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq" (UID: "183d5dbf-4edc-4e8b-a1e8-253233b1a631") : secret "maas-api-e2e-shared-a-w1-7751cd-serving-cert" not found
Sep 17 11:15:12.868808 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:12.868780    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/183d5dbf-4edc-4e8b-a1e8-253233b1a631-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq\" (UID: \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"
Sep 17 11:15:12.870758 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:12.870737    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/183d5dbf-4edc-4e8b-a1e8-253233b1a631-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq\" (UID: \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"
Sep 17 11:15:12.877254 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:12.877224    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqz8z\" (UniqueName: \"kubernetes.io/projected/183d5dbf-4edc-4e8b-a1e8-253233b1a631-kube-api-access-lqz8z\") pod \"maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq\" (UID: \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"
Sep 17 11:15:13.371938 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:13.371901    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/183d5dbf-4edc-4e8b-a1e8-253233b1a631-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq\" (UID: \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"
Sep 17 11:15:13.374341 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:13.374304    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/183d5dbf-4edc-4e8b-a1e8-253233b1a631-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq\" (UID: \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"
Sep 17 11:15:13.546982 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:13.546953    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"
Sep 17 11:15:13.829398 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:13.829369    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"]
Sep 17 11:15:13.831187 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:15:13.831161    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod183d5dbf_4edc_4e8b_a1e8_253233b1a631.slice/crio-d0c1a7e00da7b1bdb43d095808d7cdacfa406badd16e1da98255418cea498c9c WatchSource:0}: Error finding container d0c1a7e00da7b1bdb43d095808d7cdacfa406badd16e1da98255418cea498c9c: Status 404 returned error can't find the container with id d0c1a7e00da7b1bdb43d095808d7cdacfa406badd16e1da98255418cea498c9c
Sep 17 11:15:14.022061 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:14.022025    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq" event={"ID":"183d5dbf-4edc-4e8b-a1e8-253233b1a631","Type":"ContainerStarted","Data":"d0c1a7e00da7b1bdb43d095808d7cdacfa406badd16e1da98255418cea498c9c"}
Sep 17 11:15:15.028550 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:15.028503    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq" event={"ID":"183d5dbf-4edc-4e8b-a1e8-253233b1a631","Type":"ContainerStarted","Data":"4c100e6a7cbb393c0727cc84fc5dfdb8fb28dd359019afab95df7d5d2da3556d"}
Sep 17 11:15:15.028944 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:15.028701    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"
Sep 17 11:15:15.049573 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:15.049500    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq" podStartSLOduration=2.543844016 podStartE2EDuration="3.049487739s" totalImagesPullingTime="505.643723ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:15:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:15:15.047179652 +0000 UTC m=+1304.842514104" watchObservedRunningTime="2026-09-17 11:15:15.049487739 +0000 UTC m=+1304.844822178"
Sep 17 11:15:21.040130 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:21.040101    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"
Sep 17 11:15:36.927648 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:36.927609    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"]
Sep 17 11:15:36.932903 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:36.932878    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:36.935752 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:36.935732    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w1-947f83-openshift-default-dockercfg-j4v6v\""
Sep 17 11:15:36.945405 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:36.945383    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"]
Sep 17 11:15:36.986992 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:36.986957    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xghl7\" (UniqueName: \"kubernetes.io/projected/2d494458-0355-4bbf-964b-83587335abe4-kube-api-access-xghl7\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:36.987113 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:36.987000    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-credential-socket\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:36.987113 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:36.987027    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d494458-0355-4bbf-964b-83587335abe4-istio-podinfo\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:36.987113 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:36.987066    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-workload-certs\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:36.987223 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:36.987133    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d494458-0355-4bbf-964b-83587335abe4-istiod-ca-cert\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:36.987223 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:36.987160    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-istio-envoy\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:36.987223 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:36.987209    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d494458-0355-4bbf-964b-83587335abe4-istio-token\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:36.987318 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:36.987240    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-istio-data\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:36.987318 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:36.987283    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-workload-socket\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.088289 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.088258    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-workload-certs\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.088479 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.088312    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d494458-0355-4bbf-964b-83587335abe4-istiod-ca-cert\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.088479 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.088348    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-istio-envoy\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.088479 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.088403    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d494458-0355-4bbf-964b-83587335abe4-istio-token\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.088479 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.088435    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-istio-data\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.088717 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.088485    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-workload-socket\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.088717 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.088569    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xghl7\" (UniqueName: \"kubernetes.io/projected/2d494458-0355-4bbf-964b-83587335abe4-kube-api-access-xghl7\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.088717 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.088598    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-credential-socket\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.088717 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.088625    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d494458-0355-4bbf-964b-83587335abe4-istio-podinfo\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.088931 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.088860    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-istio-data\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.088987 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.088954    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-workload-socket\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.089141 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.089113    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-credential-socket\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.089282 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.089244    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-workload-certs\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.089616 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.089599    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d494458-0355-4bbf-964b-83587335abe4-istiod-ca-cert\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.091037 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.091020    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-istio-envoy\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.091121 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.091082    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d494458-0355-4bbf-964b-83587335abe4-istio-podinfo\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.098186 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.098163    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xghl7\" (UniqueName: \"kubernetes.io/projected/2d494458-0355-4bbf-964b-83587335abe4-kube-api-access-xghl7\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.098285 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.098227    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d494458-0355-4bbf-964b-83587335abe4-istio-token\") pod \"e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") " pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.244273 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.244194    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:37.524441 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.524326    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"]
Sep 17 11:15:37.527208 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:15:37.527179    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d494458_0355_4bbf_964b_83587335abe4.slice/crio-be6f22d6adb53f70f581b4640440754b962878e5de252f6da38431ab11e4d3cd WatchSource:0}: Error finding container be6f22d6adb53f70f581b4640440754b962878e5de252f6da38431ab11e4d3cd: Status 404 returned error can't find the container with id be6f22d6adb53f70f581b4640440754b962878e5de252f6da38431ab11e4d3cd
Sep 17 11:15:37.529773 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.529733    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:15:37.529897 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.529817    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:15:37.529897 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:37.529862    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:15:38.148156 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:38.148119    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz" event={"ID":"2d494458-0355-4bbf-964b-83587335abe4","Type":"ContainerStarted","Data":"c552f2595d62169fb6db02d18fe2e63913faf08043a9d683e1b6390535ae5ec9"}
Sep 17 11:15:38.148648 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:38.148173    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz" event={"ID":"2d494458-0355-4bbf-964b-83587335abe4","Type":"ContainerStarted","Data":"be6f22d6adb53f70f581b4640440754b962878e5de252f6da38431ab11e4d3cd"}
Sep 17 11:15:38.171188 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:38.171140    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz" podStartSLOduration=2.171124855 podStartE2EDuration="2.171124855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:15:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:15:38.169528669 +0000 UTC m=+1327.964863104" watchObservedRunningTime="2026-09-17 11:15:38.171124855 +0000 UTC m=+1327.966459293"
Sep 17 11:15:38.244691 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:38.244667    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:38.246113 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:38.246092    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 17 11:15:38.246196 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:38.246134    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz" podUID="2d494458-0355-4bbf-964b-83587335abe4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 17 11:15:39.248662 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:39.248630    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:40.161471 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:40.161436    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:40.162906 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:40.162883    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:43.557958 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:43.557920    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744"]
Sep 17 11:15:43.562768 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:43.562700    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744"
Sep 17 11:15:43.571034 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:43.571009    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w1-947f83\""
Sep 17 11:15:43.579748 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:43.579724    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744"]
Sep 17 11:15:43.647313 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:43.647289    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6vdj\" (UniqueName: \"kubernetes.io/projected/fc1839fc-8cad-4067-92d2-711338da2487-kube-api-access-k6vdj\") pod \"payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744\" (UID: \"fc1839fc-8cad-4067-92d2-711338da2487\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744"
Sep 17 11:15:43.647446 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:43.647346    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc1839fc-8cad-4067-92d2-711338da2487-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744\" (UID: \"fc1839fc-8cad-4067-92d2-711338da2487\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744"
Sep 17 11:15:43.748118 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:43.748083    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6vdj\" (UniqueName: \"kubernetes.io/projected/fc1839fc-8cad-4067-92d2-711338da2487-kube-api-access-k6vdj\") pod \"payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744\" (UID: \"fc1839fc-8cad-4067-92d2-711338da2487\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744"
Sep 17 11:15:43.748369 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:43.748342    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc1839fc-8cad-4067-92d2-711338da2487-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744\" (UID: \"fc1839fc-8cad-4067-92d2-711338da2487\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744"
Sep 17 11:15:43.749003 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:43.748985    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc1839fc-8cad-4067-92d2-711338da2487-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744\" (UID: \"fc1839fc-8cad-4067-92d2-711338da2487\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744"
Sep 17 11:15:43.757773 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:43.757749    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6vdj\" (UniqueName: \"kubernetes.io/projected/fc1839fc-8cad-4067-92d2-711338da2487-kube-api-access-k6vdj\") pod \"payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744\" (UID: \"fc1839fc-8cad-4067-92d2-711338da2487\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744"
Sep 17 11:15:43.875815 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:43.875721    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744"
Sep 17 11:15:44.149313 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:44.149283    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744"]
Sep 17 11:15:44.151480 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:15:44.151442    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1839fc_8cad_4067_92d2_711338da2487.slice/crio-213d0b26217dc88727f512d51294a69475e70fd5ab33c8bfbc550c0d49701f62 WatchSource:0}: Error finding container 213d0b26217dc88727f512d51294a69475e70fd5ab33c8bfbc550c0d49701f62: Status 404 returned error can't find the container with id 213d0b26217dc88727f512d51294a69475e70fd5ab33c8bfbc550c0d49701f62
Sep 17 11:15:44.183067 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:44.183042    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744" event={"ID":"fc1839fc-8cad-4067-92d2-711338da2487","Type":"ContainerStarted","Data":"213d0b26217dc88727f512d51294a69475e70fd5ab33c8bfbc550c0d49701f62"}
Sep 17 11:15:45.192252 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:45.192204    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744" event={"ID":"fc1839fc-8cad-4067-92d2-711338da2487","Type":"ContainerStarted","Data":"5308ba175d15401cfc017628824a400704c8a0e6da2e00c9c031103905c768d9"}
Sep 17 11:15:45.192712 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:45.192298    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744"
Sep 17 11:15:45.236060 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:45.236010    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744" podStartSLOduration=2.235992993 podStartE2EDuration="2.235992993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:15:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:15:45.234241636 +0000 UTC m=+1335.029576088" watchObservedRunningTime="2026-09-17 11:15:45.235992993 +0000 UTC m=+1335.031327432"
Sep 17 11:15:56.199638 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:56.199606    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744"
Sep 17 11:15:56.202651 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:56.202623    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 11:15:56.202784 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:56.202688    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz" podUID="2d494458-0355-4bbf-964b-83587335abe4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 11:15:57.258044 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:57.258003    2570 generic.go:356] "Generic (PLEG): container finished" podID="2d494458-0355-4bbf-964b-83587335abe4" containerID="c552f2595d62169fb6db02d18fe2e63913faf08043a9d683e1b6390535ae5ec9" exitCode=0
Sep 17 11:15:57.258457 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:57.258058    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz" event={"ID":"2d494458-0355-4bbf-964b-83587335abe4","Type":"ContainerDied","Data":"c552f2595d62169fb6db02d18fe2e63913faf08043a9d683e1b6390535ae5ec9"}
Sep 17 11:15:57.258581 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:57.258564    2570 scope.go:117] "RemoveContainer" containerID="c552f2595d62169fb6db02d18fe2e63913faf08043a9d683e1b6390535ae5ec9"
Sep 17 11:15:57.259677 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:57.259645    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:15:57.259800 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:57.259729    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:15:57.259800 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:57.259778    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:15:58.268535 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:58.268479    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz" event={"ID":"2d494458-0355-4bbf-964b-83587335abe4","Type":"ContainerStarted","Data":"b8c4f2e3f84d4359201d49d09f82509545ae386cffac8cd5c6efa6a011cd0cb9"}
Sep 17 11:15:59.244866 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:59.244835    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:15:59.245088 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:59.245029    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 17 11:15:59.245088 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:15:59.245076    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz" podUID="2d494458-0355-4bbf-964b-83587335abe4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 17 11:16:00.244815 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:00.244767    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 17 11:16:00.245266 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:00.244839    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz" podUID="2d494458-0355-4bbf-964b-83587335abe4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 17 11:16:01.244941 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:01.244900    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 17 11:16:01.245393 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:01.244978    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz" podUID="2d494458-0355-4bbf-964b-83587335abe4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 17 11:16:02.244554 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:02.244496    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 17 11:16:02.244727 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:02.244580    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz" podUID="2d494458-0355-4bbf-964b-83587335abe4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 17 11:16:03.245036 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:03.245002    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 17 11:16:03.245399 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:03.245057    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz" podUID="2d494458-0355-4bbf-964b-83587335abe4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 17 11:16:04.248739 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:04.248706    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:16:04.249207 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:04.249114    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:16:04.249836 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:04.249817    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:16:21.674438 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.674403    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h"]
Sep 17 11:16:21.677164 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.677144    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h"
Sep 17 11:16:21.681413 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.681389    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-d727624f\""
Sep 17 11:16:21.682732 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.682716    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-d727624f-dockercfg-vtpxk\""
Sep 17 11:16:21.698132 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.698086    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h"]
Sep 17 11:16:21.700998 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.700977    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g"]
Sep 17 11:16:21.703372 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.703353    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g"
Sep 17 11:16:21.714109 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.714085    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g"]
Sep 17 11:16:21.719767 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.719742    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hz96\" (UniqueName: \"kubernetes.io/projected/c5ee9ad8-dffc-4266-8578-2ef6c53d09fc-kube-api-access-2hz96\") pod \"payload-processing-e2e-mt-d727624f-f946f8585-6fr4g\" (UID: \"c5ee9ad8-dffc-4266-8578-2ef6c53d09fc\") " pod="openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g"
Sep 17 11:16:21.719882 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.719822    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n65h6\" (UniqueName: \"kubernetes.io/projected/5345abbb-49fd-42b7-9735-d57b85a42104-kube-api-access-n65h6\") pod \"payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h\" (UID: \"5345abbb-49fd-42b7-9735-d57b85a42104\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h"
Sep 17 11:16:21.719882 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.719853    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5ee9ad8-dffc-4266-8578-2ef6c53d09fc-plugins-config-volume\") pod \"payload-processing-e2e-mt-d727624f-f946f8585-6fr4g\" (UID: \"c5ee9ad8-dffc-4266-8578-2ef6c53d09fc\") " pod="openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g"
Sep 17 11:16:21.720003 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.719900    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5345abbb-49fd-42b7-9735-d57b85a42104-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h\" (UID: \"5345abbb-49fd-42b7-9735-d57b85a42104\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h"
Sep 17 11:16:21.821303 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.821266    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n65h6\" (UniqueName: \"kubernetes.io/projected/5345abbb-49fd-42b7-9735-d57b85a42104-kube-api-access-n65h6\") pod \"payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h\" (UID: \"5345abbb-49fd-42b7-9735-d57b85a42104\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h"
Sep 17 11:16:21.821303 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.821309    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5ee9ad8-dffc-4266-8578-2ef6c53d09fc-plugins-config-volume\") pod \"payload-processing-e2e-mt-d727624f-f946f8585-6fr4g\" (UID: \"c5ee9ad8-dffc-4266-8578-2ef6c53d09fc\") " pod="openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g"
Sep 17 11:16:21.821587 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.821335    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5345abbb-49fd-42b7-9735-d57b85a42104-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h\" (UID: \"5345abbb-49fd-42b7-9735-d57b85a42104\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h"
Sep 17 11:16:21.821587 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.821453    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hz96\" (UniqueName: \"kubernetes.io/projected/c5ee9ad8-dffc-4266-8578-2ef6c53d09fc-kube-api-access-2hz96\") pod \"payload-processing-e2e-mt-d727624f-f946f8585-6fr4g\" (UID: \"c5ee9ad8-dffc-4266-8578-2ef6c53d09fc\") " pod="openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g"
Sep 17 11:16:21.822100 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.822082    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5ee9ad8-dffc-4266-8578-2ef6c53d09fc-plugins-config-volume\") pod \"payload-processing-e2e-mt-d727624f-f946f8585-6fr4g\" (UID: \"c5ee9ad8-dffc-4266-8578-2ef6c53d09fc\") " pod="openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g"
Sep 17 11:16:21.822144 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.822128    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5345abbb-49fd-42b7-9735-d57b85a42104-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h\" (UID: \"5345abbb-49fd-42b7-9735-d57b85a42104\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h"
Sep 17 11:16:21.831818 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.831794    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hz96\" (UniqueName: \"kubernetes.io/projected/c5ee9ad8-dffc-4266-8578-2ef6c53d09fc-kube-api-access-2hz96\") pod \"payload-processing-e2e-mt-d727624f-f946f8585-6fr4g\" (UID: \"c5ee9ad8-dffc-4266-8578-2ef6c53d09fc\") " pod="openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g"
Sep 17 11:16:21.831930 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.831908    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n65h6\" (UniqueName: \"kubernetes.io/projected/5345abbb-49fd-42b7-9735-d57b85a42104-kube-api-access-n65h6\") pod \"payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h\" (UID: \"5345abbb-49fd-42b7-9735-d57b85a42104\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h"
Sep 17 11:16:21.988156 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:21.988087    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h"
Sep 17 11:16:22.015311 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:22.015288    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g"
Sep 17 11:16:22.271192 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:22.271164    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h"]
Sep 17 11:16:22.272609 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:16:22.272573    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5345abbb_49fd_42b7_9735_d57b85a42104.slice/crio-5d2bcb3bf395448e5506043497a6ec9678748b894bb3ba249a9fd912a18578f2 WatchSource:0}: Error finding container 5d2bcb3bf395448e5506043497a6ec9678748b894bb3ba249a9fd912a18578f2: Status 404 returned error can't find the container with id 5d2bcb3bf395448e5506043497a6ec9678748b894bb3ba249a9fd912a18578f2
Sep 17 11:16:22.306961 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:22.306936    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g"]
Sep 17 11:16:22.308638 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:16:22.308616    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ee9ad8_dffc_4266_8578_2ef6c53d09fc.slice/crio-5c923bfc9d9c8b1dfa4e06d1bd16e0fc176266731c0e422ea06f2cf3c55f7578 WatchSource:0}: Error finding container 5c923bfc9d9c8b1dfa4e06d1bd16e0fc176266731c0e422ea06f2cf3c55f7578: Status 404 returned error can't find the container with id 5c923bfc9d9c8b1dfa4e06d1bd16e0fc176266731c0e422ea06f2cf3c55f7578
Sep 17 11:16:22.403554 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:22.403491    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g" event={"ID":"c5ee9ad8-dffc-4266-8578-2ef6c53d09fc","Type":"ContainerStarted","Data":"70d022982cb14fbd44ed21051b33c9ee01fff4b8cf3ccb5c46d773f9fdd2220c"}
Sep 17 11:16:22.403729 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:22.403564    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g" event={"ID":"c5ee9ad8-dffc-4266-8578-2ef6c53d09fc","Type":"ContainerStarted","Data":"5c923bfc9d9c8b1dfa4e06d1bd16e0fc176266731c0e422ea06f2cf3c55f7578"}
Sep 17 11:16:22.403729 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:22.403594    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g"
Sep 17 11:16:22.405320 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:22.405292    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h" event={"ID":"5345abbb-49fd-42b7-9735-d57b85a42104","Type":"ContainerStarted","Data":"0a80212d761c2ca32915e935402ad692e0cfb29591f2bed4f75c219145dc5ab4"}
Sep 17 11:16:22.405435 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:22.405343    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h" event={"ID":"5345abbb-49fd-42b7-9735-d57b85a42104","Type":"ContainerStarted","Data":"5d2bcb3bf395448e5506043497a6ec9678748b894bb3ba249a9fd912a18578f2"}
Sep 17 11:16:22.405435 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:22.405381    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h"
Sep 17 11:16:22.420872 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:22.420823    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g" podStartSLOduration=1.420803709 podStartE2EDuration="1.420803709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:16:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:16:22.42045719 +0000 UTC m=+1372.215791631" watchObservedRunningTime="2026-09-17 11:16:22.420803709 +0000 UTC m=+1372.216138146"
Sep 17 11:16:22.438037 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:22.437984    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h" podStartSLOduration=1.4379664079999999 podStartE2EDuration="1.437966408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:16:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:16:22.437184701 +0000 UTC m=+1372.232519141" watchObservedRunningTime="2026-09-17 11:16:22.437966408 +0000 UTC m=+1372.233300865"
Sep 17 11:16:33.414628 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:33.414597    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h"
Sep 17 11:16:33.415074 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:16:33.414768    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g"
Sep 17 11:17:09.579165 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:09.579131    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"]
Sep 17 11:17:24.598817 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:24.598725    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r" podUID="b3e66371-b7d1-47cc-828d-f8456ab134ed" containerName="main" containerID="cri-o://5d7833e9a7677c9ba06effefb75e454e9984ecefd00b8c4192cd0afde7962bd4" gracePeriod=45
Sep 17 11:17:24.734396 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:24.734366    2570 generic.go:356] "Generic (PLEG): container finished" podID="b3e66371-b7d1-47cc-828d-f8456ab134ed" containerID="5d7833e9a7677c9ba06effefb75e454e9984ecefd00b8c4192cd0afde7962bd4" exitCode=0
Sep 17 11:17:24.734551 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:24.734413    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r" event={"ID":"b3e66371-b7d1-47cc-828d-f8456ab134ed","Type":"ContainerDied","Data":"5d7833e9a7677c9ba06effefb75e454e9984ecefd00b8c4192cd0afde7962bd4"}
Sep 17 11:17:24.850366 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:24.850304    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:17:24.909325 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:24.909290    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-tmp-dir\") pod \"b3e66371-b7d1-47cc-828d-f8456ab134ed\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") "
Sep 17 11:17:24.909325 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:24.909329    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-model-cache\") pod \"b3e66371-b7d1-47cc-828d-f8456ab134ed\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") "
Sep 17 11:17:24.909588 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:24.909397    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgm5p\" (UniqueName: \"kubernetes.io/projected/b3e66371-b7d1-47cc-828d-f8456ab134ed-kube-api-access-vgm5p\") pod \"b3e66371-b7d1-47cc-828d-f8456ab134ed\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") "
Sep 17 11:17:24.909588 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:24.909436    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3e66371-b7d1-47cc-828d-f8456ab134ed-tls-certs\") pod \"b3e66371-b7d1-47cc-828d-f8456ab134ed\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") "
Sep 17 11:17:24.909588 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:24.909479    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-dshm\") pod \"b3e66371-b7d1-47cc-828d-f8456ab134ed\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") "
Sep 17 11:17:24.909588 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:24.909502    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-home\") pod \"b3e66371-b7d1-47cc-828d-f8456ab134ed\" (UID: \"b3e66371-b7d1-47cc-828d-f8456ab134ed\") "
Sep 17 11:17:24.909588 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:24.909547    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b3e66371-b7d1-47cc-828d-f8456ab134ed" (UID: "b3e66371-b7d1-47cc-828d-f8456ab134ed"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:17:24.909832 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:24.909606    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-model-cache" (OuterVolumeSpecName: "model-cache") pod "b3e66371-b7d1-47cc-828d-f8456ab134ed" (UID: "b3e66371-b7d1-47cc-828d-f8456ab134ed"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:17:24.909832 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:24.909785    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-home" (OuterVolumeSpecName: "home") pod "b3e66371-b7d1-47cc-828d-f8456ab134ed" (UID: "b3e66371-b7d1-47cc-828d-f8456ab134ed"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:17:24.909916 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:24.909880    2570 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-tmp-dir\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:17:24.909916 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:24.909899    2570 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-model-cache\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:17:24.909916 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:24.909908    2570 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-home\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:17:24.911729 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:24.911706    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-dshm" (OuterVolumeSpecName: "dshm") pod "b3e66371-b7d1-47cc-828d-f8456ab134ed" (UID: "b3e66371-b7d1-47cc-828d-f8456ab134ed"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:17:24.911803 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:24.911729    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3e66371-b7d1-47cc-828d-f8456ab134ed-kube-api-access-vgm5p" (OuterVolumeSpecName: "kube-api-access-vgm5p") pod "b3e66371-b7d1-47cc-828d-f8456ab134ed" (UID: "b3e66371-b7d1-47cc-828d-f8456ab134ed"). InnerVolumeSpecName "kube-api-access-vgm5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:17:24.911803 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:24.911789    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3e66371-b7d1-47cc-828d-f8456ab134ed-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b3e66371-b7d1-47cc-828d-f8456ab134ed" (UID: "b3e66371-b7d1-47cc-828d-f8456ab134ed"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:17:25.010680 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:25.010651    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgm5p\" (UniqueName: \"kubernetes.io/projected/b3e66371-b7d1-47cc-828d-f8456ab134ed-kube-api-access-vgm5p\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:17:25.010680 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:25.010676    2570 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3e66371-b7d1-47cc-828d-f8456ab134ed-tls-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:17:25.010680 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:25.010685    2570 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3e66371-b7d1-47cc-828d-f8456ab134ed-dshm\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:17:25.741442 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:25.741407    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r" event={"ID":"b3e66371-b7d1-47cc-828d-f8456ab134ed","Type":"ContainerDied","Data":"9e9b7a4f322e08c3fb9327252935232720ad6e766e4f8bc25bf6b67937ed46b8"}
Sep 17 11:17:25.741874 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:25.741460    2570 scope.go:117] "RemoveContainer" containerID="5d7833e9a7677c9ba06effefb75e454e9984ecefd00b8c4192cd0afde7962bd4"
Sep 17 11:17:25.741874 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:25.741426    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"
Sep 17 11:17:25.764915 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:25.764891    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"]
Sep 17 11:17:25.771080 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:25.771059    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r"]
Sep 17 11:17:26.691837 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:26.691801    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3e66371-b7d1-47cc-828d-f8456ab134ed" path="/var/lib/kubelet/pods/b3e66371-b7d1-47cc-828d-f8456ab134ed/volumes"
Sep 17 11:17:29.774378 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:29.774342    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-w2-b8287f/auth-test-model-b8287f-kserve-5dcc4d7475-vrz9r" podUID="b3e66371-b7d1-47cc-828d-f8456ab134ed" containerName="main" probeResult="failure" output="Get \"https://10.134.0.56:8000/ready\": context deadline exceeded"
Sep 17 11:17:38.788263 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:38.788231    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g"]
Sep 17 11:17:38.788829 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:38.788415    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g" podUID="c5ee9ad8-dffc-4266-8578-2ef6c53d09fc" containerName="payload-processing" containerID="cri-o://70d022982cb14fbd44ed21051b33c9ee01fff4b8cf3ccb5c46d773f9fdd2220c" gracePeriod=30
Sep 17 11:17:38.798106 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:38.798080    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h"]
Sep 17 11:17:38.798331 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:38.798295    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h" podUID="5345abbb-49fd-42b7-9735-d57b85a42104" containerName="payload-pre-processing" containerID="cri-o://0a80212d761c2ca32915e935402ad692e0cfb29591f2bed4f75c219145dc5ab4" gracePeriod=30
Sep 17 11:17:39.084045 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.084021    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g"
Sep 17 11:17:39.087117 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.087100    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h"
Sep 17 11:17:39.238491 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.238456    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hz96\" (UniqueName: \"kubernetes.io/projected/c5ee9ad8-dffc-4266-8578-2ef6c53d09fc-kube-api-access-2hz96\") pod \"c5ee9ad8-dffc-4266-8578-2ef6c53d09fc\" (UID: \"c5ee9ad8-dffc-4266-8578-2ef6c53d09fc\") "
Sep 17 11:17:39.238701 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.238591    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5ee9ad8-dffc-4266-8578-2ef6c53d09fc-plugins-config-volume\") pod \"c5ee9ad8-dffc-4266-8578-2ef6c53d09fc\" (UID: \"c5ee9ad8-dffc-4266-8578-2ef6c53d09fc\") "
Sep 17 11:17:39.238701 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.238623    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5345abbb-49fd-42b7-9735-d57b85a42104-plugins-config-volume\") pod \"5345abbb-49fd-42b7-9735-d57b85a42104\" (UID: \"5345abbb-49fd-42b7-9735-d57b85a42104\") "
Sep 17 11:17:39.238701 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.238639    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n65h6\" (UniqueName: \"kubernetes.io/projected/5345abbb-49fd-42b7-9735-d57b85a42104-kube-api-access-n65h6\") pod \"5345abbb-49fd-42b7-9735-d57b85a42104\" (UID: \"5345abbb-49fd-42b7-9735-d57b85a42104\") "
Sep 17 11:17:39.239012 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.238982    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5345abbb-49fd-42b7-9735-d57b85a42104-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5345abbb-49fd-42b7-9735-d57b85a42104" (UID: "5345abbb-49fd-42b7-9735-d57b85a42104"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:17:39.239094 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.238982    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5ee9ad8-dffc-4266-8578-2ef6c53d09fc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c5ee9ad8-dffc-4266-8578-2ef6c53d09fc" (UID: "c5ee9ad8-dffc-4266-8578-2ef6c53d09fc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:17:39.240772 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.240742    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5ee9ad8-dffc-4266-8578-2ef6c53d09fc-kube-api-access-2hz96" (OuterVolumeSpecName: "kube-api-access-2hz96") pod "c5ee9ad8-dffc-4266-8578-2ef6c53d09fc" (UID: "c5ee9ad8-dffc-4266-8578-2ef6c53d09fc"). InnerVolumeSpecName "kube-api-access-2hz96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:17:39.240896 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.240866    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5345abbb-49fd-42b7-9735-d57b85a42104-kube-api-access-n65h6" (OuterVolumeSpecName: "kube-api-access-n65h6") pod "5345abbb-49fd-42b7-9735-d57b85a42104" (UID: "5345abbb-49fd-42b7-9735-d57b85a42104"). InnerVolumeSpecName "kube-api-access-n65h6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:17:39.340043 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.339964    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hz96\" (UniqueName: \"kubernetes.io/projected/c5ee9ad8-dffc-4266-8578-2ef6c53d09fc-kube-api-access-2hz96\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:17:39.340043 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.339991    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5ee9ad8-dffc-4266-8578-2ef6c53d09fc-plugins-config-volume\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:17:39.340043 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.339999    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5345abbb-49fd-42b7-9735-d57b85a42104-plugins-config-volume\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:17:39.340043 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.340008    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n65h6\" (UniqueName: \"kubernetes.io/projected/5345abbb-49fd-42b7-9735-d57b85a42104-kube-api-access-n65h6\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:17:39.821275 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.821241    2570 generic.go:356] "Generic (PLEG): container finished" podID="c5ee9ad8-dffc-4266-8578-2ef6c53d09fc" containerID="70d022982cb14fbd44ed21051b33c9ee01fff4b8cf3ccb5c46d773f9fdd2220c" exitCode=0
Sep 17 11:17:39.821675 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.821296    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g"
Sep 17 11:17:39.821675 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.821327    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g" event={"ID":"c5ee9ad8-dffc-4266-8578-2ef6c53d09fc","Type":"ContainerDied","Data":"70d022982cb14fbd44ed21051b33c9ee01fff4b8cf3ccb5c46d773f9fdd2220c"}
Sep 17 11:17:39.821675 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.821409    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g" event={"ID":"c5ee9ad8-dffc-4266-8578-2ef6c53d09fc","Type":"ContainerDied","Data":"5c923bfc9d9c8b1dfa4e06d1bd16e0fc176266731c0e422ea06f2cf3c55f7578"}
Sep 17 11:17:39.821675 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.821437    2570 scope.go:117] "RemoveContainer" containerID="70d022982cb14fbd44ed21051b33c9ee01fff4b8cf3ccb5c46d773f9fdd2220c"
Sep 17 11:17:39.822791 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.822697    2570 generic.go:356] "Generic (PLEG): container finished" podID="5345abbb-49fd-42b7-9735-d57b85a42104" containerID="0a80212d761c2ca32915e935402ad692e0cfb29591f2bed4f75c219145dc5ab4" exitCode=0
Sep 17 11:17:39.822791 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.822756    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h"
Sep 17 11:17:39.822791 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.822780    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h" event={"ID":"5345abbb-49fd-42b7-9735-d57b85a42104","Type":"ContainerDied","Data":"0a80212d761c2ca32915e935402ad692e0cfb29591f2bed4f75c219145dc5ab4"}
Sep 17 11:17:39.822925 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.822821    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h" event={"ID":"5345abbb-49fd-42b7-9735-d57b85a42104","Type":"ContainerDied","Data":"5d2bcb3bf395448e5506043497a6ec9678748b894bb3ba249a9fd912a18578f2"}
Sep 17 11:17:39.832585 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.832565    2570 scope.go:117] "RemoveContainer" containerID="70d022982cb14fbd44ed21051b33c9ee01fff4b8cf3ccb5c46d773f9fdd2220c"
Sep 17 11:17:39.832893 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:17:39.832871    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70d022982cb14fbd44ed21051b33c9ee01fff4b8cf3ccb5c46d773f9fdd2220c\": container with ID starting with 70d022982cb14fbd44ed21051b33c9ee01fff4b8cf3ccb5c46d773f9fdd2220c not found: ID does not exist" containerID="70d022982cb14fbd44ed21051b33c9ee01fff4b8cf3ccb5c46d773f9fdd2220c"
Sep 17 11:17:39.832989 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.832903    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70d022982cb14fbd44ed21051b33c9ee01fff4b8cf3ccb5c46d773f9fdd2220c"} err="failed to get container status \"70d022982cb14fbd44ed21051b33c9ee01fff4b8cf3ccb5c46d773f9fdd2220c\": rpc error: code = NotFound desc = could not find container \"70d022982cb14fbd44ed21051b33c9ee01fff4b8cf3ccb5c46d773f9fdd2220c\": container with ID starting with 70d022982cb14fbd44ed21051b33c9ee01fff4b8cf3ccb5c46d773f9fdd2220c not found: ID does not exist"
Sep 17 11:17:39.832989 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.832923    2570 scope.go:117] "RemoveContainer" containerID="0a80212d761c2ca32915e935402ad692e0cfb29591f2bed4f75c219145dc5ab4"
Sep 17 11:17:39.840651 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.840634    2570 scope.go:117] "RemoveContainer" containerID="0a80212d761c2ca32915e935402ad692e0cfb29591f2bed4f75c219145dc5ab4"
Sep 17 11:17:39.840925 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:17:39.840907    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a80212d761c2ca32915e935402ad692e0cfb29591f2bed4f75c219145dc5ab4\": container with ID starting with 0a80212d761c2ca32915e935402ad692e0cfb29591f2bed4f75c219145dc5ab4 not found: ID does not exist" containerID="0a80212d761c2ca32915e935402ad692e0cfb29591f2bed4f75c219145dc5ab4"
Sep 17 11:17:39.840978 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.840930    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a80212d761c2ca32915e935402ad692e0cfb29591f2bed4f75c219145dc5ab4"} err="failed to get container status \"0a80212d761c2ca32915e935402ad692e0cfb29591f2bed4f75c219145dc5ab4\": rpc error: code = NotFound desc = could not find container \"0a80212d761c2ca32915e935402ad692e0cfb29591f2bed4f75c219145dc5ab4\": container with ID starting with 0a80212d761c2ca32915e935402ad692e0cfb29591f2bed4f75c219145dc5ab4 not found: ID does not exist"
Sep 17 11:17:39.848424 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.848397    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g"]
Sep 17 11:17:39.854349 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.854324    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-d727624f-f946f8585-6fr4g"]
Sep 17 11:17:39.865890 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.865871    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h"]
Sep 17 11:17:39.873009 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:39.872992    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-d727624f-744ffb78f4-zn58h"]
Sep 17 11:17:40.690241 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:40.690211    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5345abbb-49fd-42b7-9735-d57b85a42104" path="/var/lib/kubelet/pods/5345abbb-49fd-42b7-9735-d57b85a42104/volumes"
Sep 17 11:17:40.690603 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:17:40.690585    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5ee9ad8-dffc-4266-8578-2ef6c53d09fc" path="/var/lib/kubelet/pods/c5ee9ad8-dffc-4266-8578-2ef6c53d09fc/volumes"
Sep 17 11:18:30.738549 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:18:30.738519    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 11:18:30.743291 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:18:30.743267    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 11:19:27.588788 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.588749    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"]
Sep 17 11:19:27.589246 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.589213    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5ee9ad8-dffc-4266-8578-2ef6c53d09fc" containerName="payload-processing"
Sep 17 11:19:27.589246 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.589229    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5ee9ad8-dffc-4266-8578-2ef6c53d09fc" containerName="payload-processing"
Sep 17 11:19:27.589327 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.589247    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5345abbb-49fd-42b7-9735-d57b85a42104" containerName="payload-pre-processing"
Sep 17 11:19:27.589327 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.589253    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5345abbb-49fd-42b7-9735-d57b85a42104" containerName="payload-pre-processing"
Sep 17 11:19:27.589327 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.589262    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3e66371-b7d1-47cc-828d-f8456ab134ed" containerName="main"
Sep 17 11:19:27.589327 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.589268    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3e66371-b7d1-47cc-828d-f8456ab134ed" containerName="main"
Sep 17 11:19:27.589448 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.589353    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5345abbb-49fd-42b7-9735-d57b85a42104" containerName="payload-pre-processing"
Sep 17 11:19:27.589448 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.589360    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5ee9ad8-dffc-4266-8578-2ef6c53d09fc" containerName="payload-processing"
Sep 17 11:19:27.589448 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.589371    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3e66371-b7d1-47cc-828d-f8456ab134ed" containerName="main"
Sep 17 11:19:27.592777 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.592750    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.605862 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.605843    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c6abf3-openshift-default-dockercfg-lmd99\""
Sep 17 11:19:27.620321 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.620289    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-envoy\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.620438 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.620347    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-data\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.620438 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.620388    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-token\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.620586 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.620440    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-credential-socket\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.620586 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.620466    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-workload-certs\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.620586 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.620499    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-workload-socket\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.620749 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.620641    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbk9v\" (UniqueName: \"kubernetes.io/projected/8c2b27ff-3d5f-4e16-819e-461758340f13-kube-api-access-sbk9v\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.620749 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.620670    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-podinfo\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.620749 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.620705    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c2b27ff-3d5f-4e16-819e-461758340f13-istiod-ca-cert\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.621349 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.621328    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"]
Sep 17 11:19:27.721759 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.721723    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbk9v\" (UniqueName: \"kubernetes.io/projected/8c2b27ff-3d5f-4e16-819e-461758340f13-kube-api-access-sbk9v\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.721759 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.721761    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-podinfo\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.722004 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.721794    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c2b27ff-3d5f-4e16-819e-461758340f13-istiod-ca-cert\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.722004 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.721819    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-envoy\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.722004 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.721850    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-data\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.722004 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.721889    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-token\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.722004 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.721932    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-credential-socket\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.722004 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.721955    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-workload-certs\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.722004 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.721988    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-workload-socket\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.722442 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.722423    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-data\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.722505 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.722474    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-workload-certs\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.722588 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.722552    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c2b27ff-3d5f-4e16-819e-461758340f13-istiod-ca-cert\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.722756 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.722736    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-workload-socket\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.722845 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.722755    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-credential-socket\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.724602 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.724583    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-envoy\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.724831 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.724812    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-podinfo\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.732251 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.732218    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbk9v\" (UniqueName: \"kubernetes.io/projected/8c2b27ff-3d5f-4e16-819e-461758340f13-kube-api-access-sbk9v\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.732357 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.732264    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-token\") pod \"e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") " pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:27.905796 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:27.905720    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:28.185414 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:28.185388    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"]
Sep 17 11:19:28.186877 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:19:28.186836    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c2b27ff_3d5f_4e16_819e_461758340f13.slice/crio-617b3c14eebf7951bdddb19cb0423a4a71271be053d2e6ed93673e210e3d9f0f WatchSource:0}: Error finding container 617b3c14eebf7951bdddb19cb0423a4a71271be053d2e6ed93673e210e3d9f0f: Status 404 returned error can't find the container with id 617b3c14eebf7951bdddb19cb0423a4a71271be053d2e6ed93673e210e3d9f0f
Sep 17 11:19:28.189104 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:28.189063    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:19:28.189192 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:28.189140    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:19:28.189192 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:28.189170    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:19:28.388712 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:28.388669    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6" event={"ID":"8c2b27ff-3d5f-4e16-819e-461758340f13","Type":"ContainerStarted","Data":"afea06c42a077aba063369b0099156231dc505e977c3b73a167991dd867be491"}
Sep 17 11:19:28.388904 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:28.388735    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6" event={"ID":"8c2b27ff-3d5f-4e16-819e-461758340f13","Type":"ContainerStarted","Data":"617b3c14eebf7951bdddb19cb0423a4a71271be053d2e6ed93673e210e3d9f0f"}
Sep 17 11:19:28.411325 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:28.411274    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6" podStartSLOduration=1.411256153 podStartE2EDuration="1.411256153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:19:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:19:28.409919443 +0000 UTC m=+1558.205253882" watchObservedRunningTime="2026-09-17 11:19:28.411256153 +0000 UTC m=+1558.206590592"
Sep 17 11:19:28.906352 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:28.906321    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:29.911642 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:29.911618    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:30.399157 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:30.399116    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:30.400490 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:30.400470    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:34.373156 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:34.373119    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws"]
Sep 17 11:19:34.376885 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:34.376865    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws"
Sep 17 11:19:34.380087 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:34.380069    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-c6abf3-dockercfg-dg2xg\""
Sep 17 11:19:34.380351 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:34.380337    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-c6abf3\""
Sep 17 11:19:34.390828 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:34.390804    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws"]
Sep 17 11:19:34.491924 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:34.491896    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7svq5\" (UniqueName: \"kubernetes.io/projected/3169bac7-adc7-459e-9ed3-7dbb9fc225fa-kube-api-access-7svq5\") pod \"payload-processing-e2e-api-a-c6abf3-748645869c-8dqws\" (UID: \"3169bac7-adc7-459e-9ed3-7dbb9fc225fa\") " pod="openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws"
Sep 17 11:19:34.492075 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:34.491953    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3169bac7-adc7-459e-9ed3-7dbb9fc225fa-plugins-config-volume\") pod \"payload-processing-e2e-api-a-c6abf3-748645869c-8dqws\" (UID: \"3169bac7-adc7-459e-9ed3-7dbb9fc225fa\") " pod="openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws"
Sep 17 11:19:34.592901 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:34.592865    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7svq5\" (UniqueName: \"kubernetes.io/projected/3169bac7-adc7-459e-9ed3-7dbb9fc225fa-kube-api-access-7svq5\") pod \"payload-processing-e2e-api-a-c6abf3-748645869c-8dqws\" (UID: \"3169bac7-adc7-459e-9ed3-7dbb9fc225fa\") " pod="openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws"
Sep 17 11:19:34.593062 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:34.592936    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3169bac7-adc7-459e-9ed3-7dbb9fc225fa-plugins-config-volume\") pod \"payload-processing-e2e-api-a-c6abf3-748645869c-8dqws\" (UID: \"3169bac7-adc7-459e-9ed3-7dbb9fc225fa\") " pod="openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws"
Sep 17 11:19:34.593662 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:34.593642    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3169bac7-adc7-459e-9ed3-7dbb9fc225fa-plugins-config-volume\") pod \"payload-processing-e2e-api-a-c6abf3-748645869c-8dqws\" (UID: \"3169bac7-adc7-459e-9ed3-7dbb9fc225fa\") " pod="openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws"
Sep 17 11:19:34.601448 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:34.601413    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7svq5\" (UniqueName: \"kubernetes.io/projected/3169bac7-adc7-459e-9ed3-7dbb9fc225fa-kube-api-access-7svq5\") pod \"payload-processing-e2e-api-a-c6abf3-748645869c-8dqws\" (UID: \"3169bac7-adc7-459e-9ed3-7dbb9fc225fa\") " pod="openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws"
Sep 17 11:19:34.687321 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:34.687255    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws"
Sep 17 11:19:34.957766 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:34.957733    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws"]
Sep 17 11:19:34.960596 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:19:34.960564    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3169bac7_adc7_459e_9ed3_7dbb9fc225fa.slice/crio-d91e8ac0e2b95806ea3f0e6b48483814b8ec0b5dfc5889942d7310058d508a42 WatchSource:0}: Error finding container d91e8ac0e2b95806ea3f0e6b48483814b8ec0b5dfc5889942d7310058d508a42: Status 404 returned error can't find the container with id d91e8ac0e2b95806ea3f0e6b48483814b8ec0b5dfc5889942d7310058d508a42
Sep 17 11:19:35.425693 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:35.425649    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws" event={"ID":"3169bac7-adc7-459e-9ed3-7dbb9fc225fa","Type":"ContainerStarted","Data":"7907e6f9ec24e2d9194c722b6201fa89dfe4cbb3f3e383aa3794d5009ea19087"}
Sep 17 11:19:35.426105 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:35.425722    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws" event={"ID":"3169bac7-adc7-459e-9ed3-7dbb9fc225fa","Type":"ContainerStarted","Data":"d91e8ac0e2b95806ea3f0e6b48483814b8ec0b5dfc5889942d7310058d508a42"}
Sep 17 11:19:35.426105 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:35.425827    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws"
Sep 17 11:19:35.443750 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:35.443710    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws" podStartSLOduration=1.443695826 podStartE2EDuration="1.443695826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:19:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:19:35.442593632 +0000 UTC m=+1565.237928069" watchObservedRunningTime="2026-09-17 11:19:35.443695826 +0000 UTC m=+1565.239030264"
Sep 17 11:19:46.432918 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:46.432884    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws"
Sep 17 11:19:50.519169 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:50.519132    2570 generic.go:356] "Generic (PLEG): container finished" podID="8c2b27ff-3d5f-4e16-819e-461758340f13" containerID="afea06c42a077aba063369b0099156231dc505e977c3b73a167991dd867be491" exitCode=0
Sep 17 11:19:50.519689 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:50.519207    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6" event={"ID":"8c2b27ff-3d5f-4e16-819e-461758340f13","Type":"ContainerDied","Data":"afea06c42a077aba063369b0099156231dc505e977c3b73a167991dd867be491"}
Sep 17 11:19:50.519759 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:50.519726    2570 scope.go:117] "RemoveContainer" containerID="afea06c42a077aba063369b0099156231dc505e977c3b73a167991dd867be491"
Sep 17 11:19:50.520840 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:50.520813    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:19:50.520933 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:50.520877    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:19:50.520933 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:50.520907    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:19:51.526499 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:51.526458    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6" event={"ID":"8c2b27ff-3d5f-4e16-819e-461758340f13","Type":"ContainerStarted","Data":"2f84014361200c689bf1a58ac18313f507ff9332ed364081eaa97874bb0e254f"}
Sep 17 11:19:51.906808 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:51.906725    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:51.907032 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:51.907010    2570 patch_prober.go:28] interesting pod/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 17 11:19:51.907077 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:51.907060    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6" podUID="8c2b27ff-3d5f-4e16-819e-461758340f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 17 11:19:52.906256 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:52.906218    2570 patch_prober.go:28] interesting pod/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 17 11:19:52.906647 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:52.906273    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6" podUID="8c2b27ff-3d5f-4e16-819e-461758340f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 17 11:19:53.906906 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:53.906870    2570 patch_prober.go:28] interesting pod/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 17 11:19:53.907296 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:53.906938    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6" podUID="8c2b27ff-3d5f-4e16-819e-461758340f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 17 11:19:54.906101 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:54.906065    2570 patch_prober.go:28] interesting pod/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 17 11:19:54.906281 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:54.906134    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6" podUID="8c2b27ff-3d5f-4e16-819e-461758340f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 17 11:19:55.906174 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:55.906140    2570 patch_prober.go:28] interesting pod/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 17 11:19:55.906615 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:55.906199    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6" podUID="8c2b27ff-3d5f-4e16-819e-461758340f13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 17 11:19:56.910274 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:56.910245    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:56.910704 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:56.910637    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:19:56.911445 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:19:56.911426    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:20:08.590314 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.590280    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf"]
Sep 17 11:20:08.593074 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.593049    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf"
Sep 17 11:20:08.595874 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.595851    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-9f97d7-dockercfg-wx7fl\""
Sep 17 11:20:08.596025 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.595871    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-9f97d7\""
Sep 17 11:20:08.603711 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.603689    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf"]
Sep 17 11:20:08.633392 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.633365    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw2kx\" (UniqueName: \"kubernetes.io/projected/76975559-e971-43ee-863b-b38301dde4db-kube-api-access-mw2kx\") pod \"payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf\" (UID: \"76975559-e971-43ee-863b-b38301dde4db\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf"
Sep 17 11:20:08.633527 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.633455    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76975559-e971-43ee-863b-b38301dde4db-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf\" (UID: \"76975559-e971-43ee-863b-b38301dde4db\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf"
Sep 17 11:20:08.701112 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.701077    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z"]
Sep 17 11:20:08.704580 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.704557    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z"
Sep 17 11:20:08.716382 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.716359    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z"]
Sep 17 11:20:08.734939 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.734878    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76975559-e971-43ee-863b-b38301dde4db-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf\" (UID: \"76975559-e971-43ee-863b-b38301dde4db\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf"
Sep 17 11:20:08.735065 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.735050    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw2kx\" (UniqueName: \"kubernetes.io/projected/76975559-e971-43ee-863b-b38301dde4db-kube-api-access-mw2kx\") pod \"payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf\" (UID: \"76975559-e971-43ee-863b-b38301dde4db\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf"
Sep 17 11:20:08.735851 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.735815    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76975559-e971-43ee-863b-b38301dde4db-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf\" (UID: \"76975559-e971-43ee-863b-b38301dde4db\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf"
Sep 17 11:20:08.744167 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.744140    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw2kx\" (UniqueName: \"kubernetes.io/projected/76975559-e971-43ee-863b-b38301dde4db-kube-api-access-mw2kx\") pod \"payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf\" (UID: \"76975559-e971-43ee-863b-b38301dde4db\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf"
Sep 17 11:20:08.835951 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.835902    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e-plugins-config-volume\") pod \"payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z\" (UID: \"ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e\") " pod="openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z"
Sep 17 11:20:08.836240 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.836057    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g2nm\" (UniqueName: \"kubernetes.io/projected/ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e-kube-api-access-4g2nm\") pod \"payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z\" (UID: \"ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e\") " pod="openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z"
Sep 17 11:20:08.905296 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.905212    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf"
Sep 17 11:20:08.936620 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.936592    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e-plugins-config-volume\") pod \"payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z\" (UID: \"ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e\") " pod="openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z"
Sep 17 11:20:08.936743 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.936688    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g2nm\" (UniqueName: \"kubernetes.io/projected/ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e-kube-api-access-4g2nm\") pod \"payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z\" (UID: \"ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e\") " pod="openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z"
Sep 17 11:20:08.937548 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.937503    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e-plugins-config-volume\") pod \"payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z\" (UID: \"ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e\") " pod="openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z"
Sep 17 11:20:08.945338 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:08.945308    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g2nm\" (UniqueName: \"kubernetes.io/projected/ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e-kube-api-access-4g2nm\") pod \"payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z\" (UID: \"ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e\") " pod="openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z"
Sep 17 11:20:09.016057 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:09.016020    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z"
Sep 17 11:20:09.179611 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:09.179582    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf"]
Sep 17 11:20:09.180949 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:20:09.180919    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76975559_e971_43ee_863b_b38301dde4db.slice/crio-918ff96d11e0ed259123c0eb8ea452ca73c255746292503c088522d9502d89cd WatchSource:0}: Error finding container 918ff96d11e0ed259123c0eb8ea452ca73c255746292503c088522d9502d89cd: Status 404 returned error can't find the container with id 918ff96d11e0ed259123c0eb8ea452ca73c255746292503c088522d9502d89cd
Sep 17 11:20:09.295167 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:09.295137    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z"]
Sep 17 11:20:09.295447 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:20:09.295425    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff07a71f_c9cd_4951_927b_dfbf9b3e0d9e.slice/crio-d066e46ffdf6d7e1065b0ee6442bebe196db1632fe20f544f7bab593a004b8f6 WatchSource:0}: Error finding container d066e46ffdf6d7e1065b0ee6442bebe196db1632fe20f544f7bab593a004b8f6: Status 404 returned error can't find the container with id d066e46ffdf6d7e1065b0ee6442bebe196db1632fe20f544f7bab593a004b8f6
Sep 17 11:20:09.634553 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:09.634481    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z" event={"ID":"ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e","Type":"ContainerStarted","Data":"4405bf3f8918d4e77d815a550451b0c4cd8fa7e55c89a1fd8b5d0bf2f3366265"}
Sep 17 11:20:09.634994 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:09.634578    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z" event={"ID":"ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e","Type":"ContainerStarted","Data":"d066e46ffdf6d7e1065b0ee6442bebe196db1632fe20f544f7bab593a004b8f6"}
Sep 17 11:20:09.634994 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:09.634700    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z"
Sep 17 11:20:09.636240 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:09.636214    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf" event={"ID":"76975559-e971-43ee-863b-b38301dde4db","Type":"ContainerStarted","Data":"085d28da501333e97d776ef3ba56c8762c2441835bcfbb2c1eea9e2ada3d20c1"}
Sep 17 11:20:09.636373 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:09.636267    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf" event={"ID":"76975559-e971-43ee-863b-b38301dde4db","Type":"ContainerStarted","Data":"918ff96d11e0ed259123c0eb8ea452ca73c255746292503c088522d9502d89cd"}
Sep 17 11:20:09.636373 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:09.636296    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf"
Sep 17 11:20:09.654050 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:09.654000    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z" podStartSLOduration=1.6539819900000001 podStartE2EDuration="1.65398199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:20:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:20:09.652475825 +0000 UTC m=+1599.447810265" watchObservedRunningTime="2026-09-17 11:20:09.65398199 +0000 UTC m=+1599.449316430"
Sep 17 11:20:09.675218 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:09.675176    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf" podStartSLOduration=1.6751655140000001 podStartE2EDuration="1.675165514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:20:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:20:09.674279523 +0000 UTC m=+1599.469613968" watchObservedRunningTime="2026-09-17 11:20:09.675165514 +0000 UTC m=+1599.470499953"
Sep 17 11:20:20.644377 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:20.644347    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z"
Sep 17 11:20:20.644929 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:20.644414    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf"
Sep 17 11:20:24.931622 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:24.931551    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46"]
Sep 17 11:20:24.934286 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:24.934269    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46"
Sep 17 11:20:24.939803 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:24.939780    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-31fca0-dockercfg-lws7g\""
Sep 17 11:20:24.939930 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:24.939827    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-31fca0\""
Sep 17 11:20:24.961291 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:24.961262    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46"]
Sep 17 11:20:25.091707 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:25.091676    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7p4h\" (UniqueName: \"kubernetes.io/projected/48a6c3aa-880c-4bd8-a313-7bf743f1fda7-kube-api-access-x7p4h\") pod \"payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46\" (UID: \"48a6c3aa-880c-4bd8-a313-7bf743f1fda7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46"
Sep 17 11:20:25.091873 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:25.091723    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48a6c3aa-880c-4bd8-a313-7bf743f1fda7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46\" (UID: \"48a6c3aa-880c-4bd8-a313-7bf743f1fda7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46"
Sep 17 11:20:25.193299 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:25.193219    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7p4h\" (UniqueName: \"kubernetes.io/projected/48a6c3aa-880c-4bd8-a313-7bf743f1fda7-kube-api-access-x7p4h\") pod \"payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46\" (UID: \"48a6c3aa-880c-4bd8-a313-7bf743f1fda7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46"
Sep 17 11:20:25.193299 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:25.193267    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48a6c3aa-880c-4bd8-a313-7bf743f1fda7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46\" (UID: \"48a6c3aa-880c-4bd8-a313-7bf743f1fda7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46"
Sep 17 11:20:25.193984 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:25.193963    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48a6c3aa-880c-4bd8-a313-7bf743f1fda7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46\" (UID: \"48a6c3aa-880c-4bd8-a313-7bf743f1fda7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46"
Sep 17 11:20:25.203449 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:25.203421    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7p4h\" (UniqueName: \"kubernetes.io/projected/48a6c3aa-880c-4bd8-a313-7bf743f1fda7-kube-api-access-x7p4h\") pod \"payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46\" (UID: \"48a6c3aa-880c-4bd8-a313-7bf743f1fda7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46"
Sep 17 11:20:25.244865 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:25.244842    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46"
Sep 17 11:20:25.520705 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:25.520675    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46"]
Sep 17 11:20:25.521814 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:20:25.521785    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a6c3aa_880c_4bd8_a313_7bf743f1fda7.slice/crio-6b182a9b89755e2f0e71477bd6e6e5af2d4800ae339e2aa6d43681266ce16a94 WatchSource:0}: Error finding container 6b182a9b89755e2f0e71477bd6e6e5af2d4800ae339e2aa6d43681266ce16a94: Status 404 returned error can't find the container with id 6b182a9b89755e2f0e71477bd6e6e5af2d4800ae339e2aa6d43681266ce16a94
Sep 17 11:20:25.723914 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:25.723878    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46" event={"ID":"48a6c3aa-880c-4bd8-a313-7bf743f1fda7","Type":"ContainerStarted","Data":"afb2bff21e634bb4e9cf88d046a6282054907992dca94fee9698dc07c2c72b99"}
Sep 17 11:20:25.724069 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:25.723937    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46" event={"ID":"48a6c3aa-880c-4bd8-a313-7bf743f1fda7","Type":"ContainerStarted","Data":"6b182a9b89755e2f0e71477bd6e6e5af2d4800ae339e2aa6d43681266ce16a94"}
Sep 17 11:20:25.724069 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:25.723963    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46"
Sep 17 11:20:25.744534 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:25.744459    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46" podStartSLOduration=1.7444451239999998 podStartE2EDuration="1.744445124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:20:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:20:25.741922669 +0000 UTC m=+1615.537257105" watchObservedRunningTime="2026-09-17 11:20:25.744445124 +0000 UTC m=+1615.539779588"
Sep 17 11:20:36.730905 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:36.730874    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46"
Sep 17 11:20:42.858349 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:42.857458    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws"]
Sep 17 11:20:42.858349 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:42.857716    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws" podUID="3169bac7-adc7-459e-9ed3-7dbb9fc225fa" containerName="payload-processing" containerID="cri-o://7907e6f9ec24e2d9194c722b6201fa89dfe4cbb3f3e383aa3794d5009ea19087" gracePeriod=30
Sep 17 11:20:43.118990 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:43.118933    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws"
Sep 17 11:20:43.163170 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:43.163140    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3169bac7-adc7-459e-9ed3-7dbb9fc225fa-plugins-config-volume\") pod \"3169bac7-adc7-459e-9ed3-7dbb9fc225fa\" (UID: \"3169bac7-adc7-459e-9ed3-7dbb9fc225fa\") "
Sep 17 11:20:43.163306 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:43.163247    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7svq5\" (UniqueName: \"kubernetes.io/projected/3169bac7-adc7-459e-9ed3-7dbb9fc225fa-kube-api-access-7svq5\") pod \"3169bac7-adc7-459e-9ed3-7dbb9fc225fa\" (UID: \"3169bac7-adc7-459e-9ed3-7dbb9fc225fa\") "
Sep 17 11:20:43.163463 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:43.163441    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3169bac7-adc7-459e-9ed3-7dbb9fc225fa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3169bac7-adc7-459e-9ed3-7dbb9fc225fa" (UID: "3169bac7-adc7-459e-9ed3-7dbb9fc225fa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:20:43.163672 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:43.163656    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3169bac7-adc7-459e-9ed3-7dbb9fc225fa-plugins-config-volume\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:20:43.165275 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:43.165252    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3169bac7-adc7-459e-9ed3-7dbb9fc225fa-kube-api-access-7svq5" (OuterVolumeSpecName: "kube-api-access-7svq5") pod "3169bac7-adc7-459e-9ed3-7dbb9fc225fa" (UID: "3169bac7-adc7-459e-9ed3-7dbb9fc225fa"). InnerVolumeSpecName "kube-api-access-7svq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:20:43.265055 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:43.265027    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7svq5\" (UniqueName: \"kubernetes.io/projected/3169bac7-adc7-459e-9ed3-7dbb9fc225fa-kube-api-access-7svq5\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:20:43.819212 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:43.819173    2570 generic.go:356] "Generic (PLEG): container finished" podID="3169bac7-adc7-459e-9ed3-7dbb9fc225fa" containerID="7907e6f9ec24e2d9194c722b6201fa89dfe4cbb3f3e383aa3794d5009ea19087" exitCode=0
Sep 17 11:20:43.819386 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:43.819237    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws"
Sep 17 11:20:43.819386 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:43.819259    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws" event={"ID":"3169bac7-adc7-459e-9ed3-7dbb9fc225fa","Type":"ContainerDied","Data":"7907e6f9ec24e2d9194c722b6201fa89dfe4cbb3f3e383aa3794d5009ea19087"}
Sep 17 11:20:43.819386 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:43.819316    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws" event={"ID":"3169bac7-adc7-459e-9ed3-7dbb9fc225fa","Type":"ContainerDied","Data":"d91e8ac0e2b95806ea3f0e6b48483814b8ec0b5dfc5889942d7310058d508a42"}
Sep 17 11:20:43.819386 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:43.819338    2570 scope.go:117] "RemoveContainer" containerID="7907e6f9ec24e2d9194c722b6201fa89dfe4cbb3f3e383aa3794d5009ea19087"
Sep 17 11:20:43.828569 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:43.828553    2570 scope.go:117] "RemoveContainer" containerID="7907e6f9ec24e2d9194c722b6201fa89dfe4cbb3f3e383aa3794d5009ea19087"
Sep 17 11:20:43.828863 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:20:43.828842    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7907e6f9ec24e2d9194c722b6201fa89dfe4cbb3f3e383aa3794d5009ea19087\": container with ID starting with 7907e6f9ec24e2d9194c722b6201fa89dfe4cbb3f3e383aa3794d5009ea19087 not found: ID does not exist" containerID="7907e6f9ec24e2d9194c722b6201fa89dfe4cbb3f3e383aa3794d5009ea19087"
Sep 17 11:20:43.828923 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:43.828870    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7907e6f9ec24e2d9194c722b6201fa89dfe4cbb3f3e383aa3794d5009ea19087"} err="failed to get container status \"7907e6f9ec24e2d9194c722b6201fa89dfe4cbb3f3e383aa3794d5009ea19087\": rpc error: code = NotFound desc = could not find container \"7907e6f9ec24e2d9194c722b6201fa89dfe4cbb3f3e383aa3794d5009ea19087\": container with ID starting with 7907e6f9ec24e2d9194c722b6201fa89dfe4cbb3f3e383aa3794d5009ea19087 not found: ID does not exist"
Sep 17 11:20:43.871079 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:43.871055    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws"]
Sep 17 11:20:43.873123 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:43.873102    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-c6abf3-748645869c-8dqws"]
Sep 17 11:20:44.691684 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:44.691647    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3169bac7-adc7-459e-9ed3-7dbb9fc225fa" path="/var/lib/kubelet/pods/3169bac7-adc7-459e-9ed3-7dbb9fc225fa/volumes"
Sep 17 11:20:50.386162 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.386128    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"]
Sep 17 11:20:50.386821 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.386799    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3169bac7-adc7-459e-9ed3-7dbb9fc225fa" containerName="payload-processing"
Sep 17 11:20:50.386897 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.386824    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3169bac7-adc7-459e-9ed3-7dbb9fc225fa" containerName="payload-processing"
Sep 17 11:20:50.386954 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.386925    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3169bac7-adc7-459e-9ed3-7dbb9fc225fa" containerName="payload-processing"
Sep 17 11:20:50.390009 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.389990    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.394212 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.394185    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-23a45b-openshift-default-dockercfg-szx2z\""
Sep 17 11:20:50.405820 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.405798    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"]
Sep 17 11:20:50.432651 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.432625    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-workload-certs\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.432778 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.432672    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-workload-socket\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.432778 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.432730    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-istio-envoy\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.432884 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.432787    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acd3f492-353a-4b32-914f-f35e33a17b26-istiod-ca-cert\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.432884 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.432807    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acd3f492-353a-4b32-914f-f35e33a17b26-istio-podinfo\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.432884 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.432826    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acd3f492-353a-4b32-914f-f35e33a17b26-istio-token\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.433038 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.432924    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-credential-socket\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.433038 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.433010    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-istio-data\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.433141 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.433060    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfxgn\" (UniqueName: \"kubernetes.io/projected/acd3f492-353a-4b32-914f-f35e33a17b26-kube-api-access-sfxgn\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.534391 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.534354    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acd3f492-353a-4b32-914f-f35e33a17b26-istio-token\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.534621 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.534410    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-credential-socket\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.534621 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.534472    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-istio-data\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.534621 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.534544    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfxgn\" (UniqueName: \"kubernetes.io/projected/acd3f492-353a-4b32-914f-f35e33a17b26-kube-api-access-sfxgn\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.534812 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.534625    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-workload-certs\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.534812 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.534675    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-workload-socket\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.534812 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.534704    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-istio-envoy\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.534812 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.534751    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acd3f492-353a-4b32-914f-f35e33a17b26-istiod-ca-cert\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.534812 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.534779    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acd3f492-353a-4b32-914f-f35e33a17b26-istio-podinfo\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.535072 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.534908    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-credential-socket\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.535072 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.534991    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-istio-data\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.535177 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.535098    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-workload-certs\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.535361 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.535343    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acd3f492-353a-4b32-914f-f35e33a17b26-istiod-ca-cert\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.535441 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.535357    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-workload-socket\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.537052 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.537026    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-istio-envoy\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.537215 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.537196    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acd3f492-353a-4b32-914f-f35e33a17b26-istio-podinfo\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.547066 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.547041    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfxgn\" (UniqueName: \"kubernetes.io/projected/acd3f492-353a-4b32-914f-f35e33a17b26-kube-api-access-sfxgn\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.548725 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.548703    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acd3f492-353a-4b32-914f-f35e33a17b26-istio-token\") pod \"e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") " pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.702100 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.701776    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:50.991924 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.991896    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"]
Sep 17 11:20:50.994419 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:20:50.994395    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd3f492_353a_4b32_914f_f35e33a17b26.slice/crio-1a2fe1453c5e60d417b482243afe728c495330cd3b335bc9a24f0ff6c1c5ad16 WatchSource:0}: Error finding container 1a2fe1453c5e60d417b482243afe728c495330cd3b335bc9a24f0ff6c1c5ad16: Status 404 returned error can't find the container with id 1a2fe1453c5e60d417b482243afe728c495330cd3b335bc9a24f0ff6c1c5ad16
Sep 17 11:20:50.996971 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.996936    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:20:50.997050 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.997007    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:20:50.997050 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:50.997038    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:20:51.055580 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:51.055554    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"]
Sep 17 11:20:51.055905 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:51.055857    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6" podUID="8c2b27ff-3d5f-4e16-819e-461758340f13" containerName="istio-proxy" containerID="cri-o://2f84014361200c689bf1a58ac18313f507ff9332ed364081eaa97874bb0e254f" gracePeriod=30
Sep 17 11:20:51.864427 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:51.864391    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d" event={"ID":"acd3f492-353a-4b32-914f-f35e33a17b26","Type":"ContainerStarted","Data":"33efd3d61205e618733b6e0c6071221fd1bf96dffc9417e2da61888cce6f1cd5"}
Sep 17 11:20:51.864911 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:51.864445    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d" event={"ID":"acd3f492-353a-4b32-914f-f35e33a17b26","Type":"ContainerStarted","Data":"1a2fe1453c5e60d417b482243afe728c495330cd3b335bc9a24f0ff6c1c5ad16"}
Sep 17 11:20:51.902901 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:51.902850    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d" podStartSLOduration=1.902832503 podStartE2EDuration="1.902832503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:20:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:20:51.901764606 +0000 UTC m=+1641.697099058" watchObservedRunningTime="2026-09-17 11:20:51.902832503 +0000 UTC m=+1641.698166943"
Sep 17 11:20:52.703035 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:52.703003    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:52.708419 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:52.708396    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:52.870455 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:52.870410    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:52.871401 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:52.871381    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:20:56.316944 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.316920    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:20:56.405676 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.405601    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-credential-socket\") pod \"8c2b27ff-3d5f-4e16-819e-461758340f13\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") "
Sep 17 11:20:56.405676 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.405635    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-data\") pod \"8c2b27ff-3d5f-4e16-819e-461758340f13\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") "
Sep 17 11:20:56.405915 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.405681    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-workload-socket\") pod \"8c2b27ff-3d5f-4e16-819e-461758340f13\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") "
Sep 17 11:20:56.405915 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.405732    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-envoy\") pod \"8c2b27ff-3d5f-4e16-819e-461758340f13\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") "
Sep 17 11:20:56.405915 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.405781    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-workload-certs\") pod \"8c2b27ff-3d5f-4e16-819e-461758340f13\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") "
Sep 17 11:20:56.405915 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.405807    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c2b27ff-3d5f-4e16-819e-461758340f13-istiod-ca-cert\") pod \"8c2b27ff-3d5f-4e16-819e-461758340f13\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") "
Sep 17 11:20:56.405915 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.405829    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbk9v\" (UniqueName: \"kubernetes.io/projected/8c2b27ff-3d5f-4e16-819e-461758340f13-kube-api-access-sbk9v\") pod \"8c2b27ff-3d5f-4e16-819e-461758340f13\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") "
Sep 17 11:20:56.405915 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.405859    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-token\") pod \"8c2b27ff-3d5f-4e16-819e-461758340f13\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") "
Sep 17 11:20:56.405915 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.405870    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8c2b27ff-3d5f-4e16-819e-461758340f13" (UID: "8c2b27ff-3d5f-4e16-819e-461758340f13"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:20:56.406283 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.405939    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-podinfo\") pod \"8c2b27ff-3d5f-4e16-819e-461758340f13\" (UID: \"8c2b27ff-3d5f-4e16-819e-461758340f13\") "
Sep 17 11:20:56.406283 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.405953    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8c2b27ff-3d5f-4e16-819e-461758340f13" (UID: "8c2b27ff-3d5f-4e16-819e-461758340f13"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:20:56.406283 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.405973    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-data" (OuterVolumeSpecName: "istio-data") pod "8c2b27ff-3d5f-4e16-819e-461758340f13" (UID: "8c2b27ff-3d5f-4e16-819e-461758340f13"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:20:56.406283 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.406025    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8c2b27ff-3d5f-4e16-819e-461758340f13" (UID: "8c2b27ff-3d5f-4e16-819e-461758340f13"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:20:56.406283 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.406256    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c2b27ff-3d5f-4e16-819e-461758340f13-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8c2b27ff-3d5f-4e16-819e-461758340f13" (UID: "8c2b27ff-3d5f-4e16-819e-461758340f13"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:20:56.406610 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.406591    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-workload-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:20:56.406657 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.406614    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c2b27ff-3d5f-4e16-819e-461758340f13-istiod-ca-cert\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:20:56.406657 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.406623    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-credential-socket\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:20:56.406657 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.406631    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-data\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:20:56.406657 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.406640    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-workload-socket\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:20:56.408497 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.408470    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8c2b27ff-3d5f-4e16-819e-461758340f13" (UID: "8c2b27ff-3d5f-4e16-819e-461758340f13"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:20:56.408627 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.408498    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-token" (OuterVolumeSpecName: "istio-token") pod "8c2b27ff-3d5f-4e16-819e-461758340f13" (UID: "8c2b27ff-3d5f-4e16-819e-461758340f13"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:20:56.408627 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.408561    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8c2b27ff-3d5f-4e16-819e-461758340f13" (UID: "8c2b27ff-3d5f-4e16-819e-461758340f13"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 11:20:56.408627 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.408575    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c2b27ff-3d5f-4e16-819e-461758340f13-kube-api-access-sbk9v" (OuterVolumeSpecName: "kube-api-access-sbk9v") pod "8c2b27ff-3d5f-4e16-819e-461758340f13" (UID: "8c2b27ff-3d5f-4e16-819e-461758340f13"). InnerVolumeSpecName "kube-api-access-sbk9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:20:56.508079 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.508043    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbk9v\" (UniqueName: \"kubernetes.io/projected/8c2b27ff-3d5f-4e16-819e-461758340f13-kube-api-access-sbk9v\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:20:56.508079 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.508075    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-token\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:20:56.508079 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.508084    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-podinfo\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:20:56.508307 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.508092    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c2b27ff-3d5f-4e16-819e-461758340f13-istio-envoy\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:20:56.896203 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.896172    2570 generic.go:356] "Generic (PLEG): container finished" podID="8c2b27ff-3d5f-4e16-819e-461758340f13" containerID="2f84014361200c689bf1a58ac18313f507ff9332ed364081eaa97874bb0e254f" exitCode=0
Sep 17 11:20:56.896402 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.896223    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"
Sep 17 11:20:56.896402 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.896252    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6" event={"ID":"8c2b27ff-3d5f-4e16-819e-461758340f13","Type":"ContainerDied","Data":"2f84014361200c689bf1a58ac18313f507ff9332ed364081eaa97874bb0e254f"}
Sep 17 11:20:56.896402 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.896311    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6" event={"ID":"8c2b27ff-3d5f-4e16-819e-461758340f13","Type":"ContainerDied","Data":"617b3c14eebf7951bdddb19cb0423a4a71271be053d2e6ed93673e210e3d9f0f"}
Sep 17 11:20:56.896402 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.896339    2570 scope.go:117] "RemoveContainer" containerID="2f84014361200c689bf1a58ac18313f507ff9332ed364081eaa97874bb0e254f"
Sep 17 11:20:56.910680 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.910659    2570 scope.go:117] "RemoveContainer" containerID="afea06c42a077aba063369b0099156231dc505e977c3b73a167991dd867be491"
Sep 17 11:20:56.917429 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.917404    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"]
Sep 17 11:20:56.919854 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.919822    2570 scope.go:117] "RemoveContainer" containerID="2f84014361200c689bf1a58ac18313f507ff9332ed364081eaa97874bb0e254f"
Sep 17 11:20:56.920154 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:20:56.920131    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f84014361200c689bf1a58ac18313f507ff9332ed364081eaa97874bb0e254f\": container with ID starting with 2f84014361200c689bf1a58ac18313f507ff9332ed364081eaa97874bb0e254f not found: ID does not exist" containerID="2f84014361200c689bf1a58ac18313f507ff9332ed364081eaa97874bb0e254f"
Sep 17 11:20:56.920246 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.920160    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f84014361200c689bf1a58ac18313f507ff9332ed364081eaa97874bb0e254f"} err="failed to get container status \"2f84014361200c689bf1a58ac18313f507ff9332ed364081eaa97874bb0e254f\": rpc error: code = NotFound desc = could not find container \"2f84014361200c689bf1a58ac18313f507ff9332ed364081eaa97874bb0e254f\": container with ID starting with 2f84014361200c689bf1a58ac18313f507ff9332ed364081eaa97874bb0e254f not found: ID does not exist"
Sep 17 11:20:56.920246 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.920176    2570 scope.go:117] "RemoveContainer" containerID="afea06c42a077aba063369b0099156231dc505e977c3b73a167991dd867be491"
Sep 17 11:20:56.920464 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:20:56.920446    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afea06c42a077aba063369b0099156231dc505e977c3b73a167991dd867be491\": container with ID starting with afea06c42a077aba063369b0099156231dc505e977c3b73a167991dd867be491 not found: ID does not exist" containerID="afea06c42a077aba063369b0099156231dc505e977c3b73a167991dd867be491"
Sep 17 11:20:56.920526 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.920467    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afea06c42a077aba063369b0099156231dc505e977c3b73a167991dd867be491"} err="failed to get container status \"afea06c42a077aba063369b0099156231dc505e977c3b73a167991dd867be491\": rpc error: code = NotFound desc = could not find container \"afea06c42a077aba063369b0099156231dc505e977c3b73a167991dd867be491\": container with ID starting with afea06c42a077aba063369b0099156231dc505e977c3b73a167991dd867be491 not found: ID does not exist"
Sep 17 11:20:56.921475 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:56.921458    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c6abf3-openshift-default-6989fd5b4b-x75t6"]
Sep 17 11:20:58.691182 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:58.691152    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c2b27ff-3d5f-4e16-819e-461758340f13" path="/var/lib/kubelet/pods/8c2b27ff-3d5f-4e16-819e-461758340f13/volumes"
Sep 17 11:20:59.029469 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.029435    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f"]
Sep 17 11:20:59.029908 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.029895    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c2b27ff-3d5f-4e16-819e-461758340f13" containerName="istio-proxy"
Sep 17 11:20:59.029967 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.029909    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c2b27ff-3d5f-4e16-819e-461758340f13" containerName="istio-proxy"
Sep 17 11:20:59.029967 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.029921    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c2b27ff-3d5f-4e16-819e-461758340f13" containerName="istio-proxy"
Sep 17 11:20:59.029967 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.029926    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c2b27ff-3d5f-4e16-819e-461758340f13" containerName="istio-proxy"
Sep 17 11:20:59.030059 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.029991    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c2b27ff-3d5f-4e16-819e-461758340f13" containerName="istio-proxy"
Sep 17 11:20:59.030059 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.030000    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c2b27ff-3d5f-4e16-819e-461758340f13" containerName="istio-proxy"
Sep 17 11:20:59.033131 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.033113    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f"
Sep 17 11:20:59.035837 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.035794    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-23a45b\""
Sep 17 11:20:59.035960 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.035907    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-23a45b-dockercfg-xlcsw\""
Sep 17 11:20:59.044442 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.044421    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f"]
Sep 17 11:20:59.055442 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.055407    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx"]
Sep 17 11:20:59.058773 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.058753    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx"
Sep 17 11:20:59.073294 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.073269    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx"]
Sep 17 11:20:59.134888 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.134854    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gqhv\" (UniqueName: \"kubernetes.io/projected/5e81370d-9111-483a-a234-270f80ea5dbf-kube-api-access-5gqhv\") pod \"payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx\" (UID: \"5e81370d-9111-483a-a234-270f80ea5dbf\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx"
Sep 17 11:20:59.135080 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.134965    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/625516fc-92e1-4d8e-adaa-f8a502096204-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f\" (UID: \"625516fc-92e1-4d8e-adaa-f8a502096204\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f"
Sep 17 11:20:59.135160 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.135084    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e81370d-9111-483a-a234-270f80ea5dbf-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx\" (UID: \"5e81370d-9111-483a-a234-270f80ea5dbf\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx"
Sep 17 11:20:59.135160 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.135129    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgcjl\" (UniqueName: \"kubernetes.io/projected/625516fc-92e1-4d8e-adaa-f8a502096204-kube-api-access-dgcjl\") pod \"payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f\" (UID: \"625516fc-92e1-4d8e-adaa-f8a502096204\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f"
Sep 17 11:20:59.236281 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.236244    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/625516fc-92e1-4d8e-adaa-f8a502096204-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f\" (UID: \"625516fc-92e1-4d8e-adaa-f8a502096204\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f"
Sep 17 11:20:59.236444 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.236318    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e81370d-9111-483a-a234-270f80ea5dbf-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx\" (UID: \"5e81370d-9111-483a-a234-270f80ea5dbf\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx"
Sep 17 11:20:59.236444 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.236356    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgcjl\" (UniqueName: \"kubernetes.io/projected/625516fc-92e1-4d8e-adaa-f8a502096204-kube-api-access-dgcjl\") pod \"payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f\" (UID: \"625516fc-92e1-4d8e-adaa-f8a502096204\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f"
Sep 17 11:20:59.236444 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.236395    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gqhv\" (UniqueName: \"kubernetes.io/projected/5e81370d-9111-483a-a234-270f80ea5dbf-kube-api-access-5gqhv\") pod \"payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx\" (UID: \"5e81370d-9111-483a-a234-270f80ea5dbf\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx"
Sep 17 11:20:59.236996 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.236975    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/625516fc-92e1-4d8e-adaa-f8a502096204-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f\" (UID: \"625516fc-92e1-4d8e-adaa-f8a502096204\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f"
Sep 17 11:20:59.237087 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.237070    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e81370d-9111-483a-a234-270f80ea5dbf-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx\" (UID: \"5e81370d-9111-483a-a234-270f80ea5dbf\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx"
Sep 17 11:20:59.244969 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.244945    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgcjl\" (UniqueName: \"kubernetes.io/projected/625516fc-92e1-4d8e-adaa-f8a502096204-kube-api-access-dgcjl\") pod \"payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f\" (UID: \"625516fc-92e1-4d8e-adaa-f8a502096204\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f"
Sep 17 11:20:59.245094 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.244974    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gqhv\" (UniqueName: \"kubernetes.io/projected/5e81370d-9111-483a-a234-270f80ea5dbf-kube-api-access-5gqhv\") pod \"payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx\" (UID: \"5e81370d-9111-483a-a234-270f80ea5dbf\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx"
Sep 17 11:20:59.344763 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.344673    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f"
Sep 17 11:20:59.372089 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.372062    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx"
Sep 17 11:20:59.624005 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.623979    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f"]
Sep 17 11:20:59.626035 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:20:59.626006    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625516fc_92e1_4d8e_adaa_f8a502096204.slice/crio-78b7ab5dc9ca43f7cd9f59158edff4865e1c4a7ca4a6a6ccaf54446a1b7da134 WatchSource:0}: Error finding container 78b7ab5dc9ca43f7cd9f59158edff4865e1c4a7ca4a6a6ccaf54446a1b7da134: Status 404 returned error can't find the container with id 78b7ab5dc9ca43f7cd9f59158edff4865e1c4a7ca4a6a6ccaf54446a1b7da134
Sep 17 11:20:59.660207 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.660186    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx"]
Sep 17 11:20:59.662108 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:20:59.662080    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e81370d_9111_483a_a234_270f80ea5dbf.slice/crio-1da825f1a89194fdc183b790721db712bc0726c0c24e5e0d2846fc9d4b5a281b WatchSource:0}: Error finding container 1da825f1a89194fdc183b790721db712bc0726c0c24e5e0d2846fc9d4b5a281b: Status 404 returned error can't find the container with id 1da825f1a89194fdc183b790721db712bc0726c0c24e5e0d2846fc9d4b5a281b
Sep 17 11:20:59.916548 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.916444    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f" event={"ID":"625516fc-92e1-4d8e-adaa-f8a502096204","Type":"ContainerStarted","Data":"10ff08cc1ca96c64c3638684c77d6e90943b28c1aa1720cbb01bedbb4be30557"}
Sep 17 11:20:59.916548 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.916504    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f" event={"ID":"625516fc-92e1-4d8e-adaa-f8a502096204","Type":"ContainerStarted","Data":"78b7ab5dc9ca43f7cd9f59158edff4865e1c4a7ca4a6a6ccaf54446a1b7da134"}
Sep 17 11:20:59.917027 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.916560    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f"
Sep 17 11:20:59.918060 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.918036    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx" event={"ID":"5e81370d-9111-483a-a234-270f80ea5dbf","Type":"ContainerStarted","Data":"3d0ef5878cab926288acebca2154ce9f5a28df4bb59a7bb3e0417134dfb429c8"}
Sep 17 11:20:59.918178 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.918073    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx" event={"ID":"5e81370d-9111-483a-a234-270f80ea5dbf","Type":"ContainerStarted","Data":"1da825f1a89194fdc183b790721db712bc0726c0c24e5e0d2846fc9d4b5a281b"}
Sep 17 11:20:59.918178 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.918171    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx"
Sep 17 11:20:59.939186 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.939144    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f" podStartSLOduration=0.939131477 podStartE2EDuration="939.131477ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:20:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:20:59.935781976 +0000 UTC m=+1649.731116414" watchObservedRunningTime="2026-09-17 11:20:59.939131477 +0000 UTC m=+1649.734465916"
Sep 17 11:20:59.957969 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:20:59.957923    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx" podStartSLOduration=0.957906327 podStartE2EDuration="957.906327ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:20:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:20:59.956441203 +0000 UTC m=+1649.751775635" watchObservedRunningTime="2026-09-17 11:20:59.957906327 +0000 UTC m=+1649.753240768"
Sep 17 11:21:07.583357 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:07.583296    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z"]
Sep 17 11:21:07.583850 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:07.583585    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z" podUID="ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e" containerName="payload-processing" containerID="cri-o://4405bf3f8918d4e77d815a550451b0c4cd8fa7e55c89a1fd8b5d0bf2f3366265" gracePeriod=30
Sep 17 11:21:07.589262 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:07.589179    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf"]
Sep 17 11:21:07.589427 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:07.589398    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf" podUID="76975559-e971-43ee-863b-b38301dde4db" containerName="payload-pre-processing" containerID="cri-o://085d28da501333e97d776ef3ba56c8762c2441835bcfbb2c1eea9e2ada3d20c1" gracePeriod=30
Sep 17 11:21:07.899286 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:07.899256    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z"
Sep 17 11:21:07.929196 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:07.928171    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e-plugins-config-volume\") pod \"ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e\" (UID: \"ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e\") "
Sep 17 11:21:07.929196 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:07.929064    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e" (UID: "ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:21:07.932570 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:07.932540    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf"
Sep 17 11:21:08.001281 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.000980    2570 generic.go:356] "Generic (PLEG): container finished" podID="76975559-e971-43ee-863b-b38301dde4db" containerID="085d28da501333e97d776ef3ba56c8762c2441835bcfbb2c1eea9e2ada3d20c1" exitCode=0
Sep 17 11:21:08.001281 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.001056    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf"
Sep 17 11:21:08.001281 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.001128    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf" event={"ID":"76975559-e971-43ee-863b-b38301dde4db","Type":"ContainerDied","Data":"085d28da501333e97d776ef3ba56c8762c2441835bcfbb2c1eea9e2ada3d20c1"}
Sep 17 11:21:08.001281 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.001175    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf" event={"ID":"76975559-e971-43ee-863b-b38301dde4db","Type":"ContainerDied","Data":"918ff96d11e0ed259123c0eb8ea452ca73c255746292503c088522d9502d89cd"}
Sep 17 11:21:08.001281 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.001204    2570 scope.go:117] "RemoveContainer" containerID="085d28da501333e97d776ef3ba56c8762c2441835bcfbb2c1eea9e2ada3d20c1"
Sep 17 11:21:08.003462 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.003437    2570 generic.go:356] "Generic (PLEG): container finished" podID="ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e" containerID="4405bf3f8918d4e77d815a550451b0c4cd8fa7e55c89a1fd8b5d0bf2f3366265" exitCode=0
Sep 17 11:21:08.003579 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.003486    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z" event={"ID":"ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e","Type":"ContainerDied","Data":"4405bf3f8918d4e77d815a550451b0c4cd8fa7e55c89a1fd8b5d0bf2f3366265"}
Sep 17 11:21:08.003681 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.003666    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z"
Sep 17 11:21:08.003903 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.003885    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z" event={"ID":"ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e","Type":"ContainerDied","Data":"d066e46ffdf6d7e1065b0ee6442bebe196db1632fe20f544f7bab593a004b8f6"}
Sep 17 11:21:08.010993 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.010972    2570 scope.go:117] "RemoveContainer" containerID="085d28da501333e97d776ef3ba56c8762c2441835bcfbb2c1eea9e2ada3d20c1"
Sep 17 11:21:08.011297 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:21:08.011248    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"085d28da501333e97d776ef3ba56c8762c2441835bcfbb2c1eea9e2ada3d20c1\": container with ID starting with 085d28da501333e97d776ef3ba56c8762c2441835bcfbb2c1eea9e2ada3d20c1 not found: ID does not exist" containerID="085d28da501333e97d776ef3ba56c8762c2441835bcfbb2c1eea9e2ada3d20c1"
Sep 17 11:21:08.011297 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.011285    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"085d28da501333e97d776ef3ba56c8762c2441835bcfbb2c1eea9e2ada3d20c1"} err="failed to get container status \"085d28da501333e97d776ef3ba56c8762c2441835bcfbb2c1eea9e2ada3d20c1\": rpc error: code = NotFound desc = could not find container \"085d28da501333e97d776ef3ba56c8762c2441835bcfbb2c1eea9e2ada3d20c1\": container with ID starting with 085d28da501333e97d776ef3ba56c8762c2441835bcfbb2c1eea9e2ada3d20c1 not found: ID does not exist"
Sep 17 11:21:08.011457 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.011309    2570 scope.go:117] "RemoveContainer" containerID="4405bf3f8918d4e77d815a550451b0c4cd8fa7e55c89a1fd8b5d0bf2f3366265"
Sep 17 11:21:08.019618 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.019600    2570 scope.go:117] "RemoveContainer" containerID="4405bf3f8918d4e77d815a550451b0c4cd8fa7e55c89a1fd8b5d0bf2f3366265"
Sep 17 11:21:08.019910 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:21:08.019888    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4405bf3f8918d4e77d815a550451b0c4cd8fa7e55c89a1fd8b5d0bf2f3366265\": container with ID starting with 4405bf3f8918d4e77d815a550451b0c4cd8fa7e55c89a1fd8b5d0bf2f3366265 not found: ID does not exist" containerID="4405bf3f8918d4e77d815a550451b0c4cd8fa7e55c89a1fd8b5d0bf2f3366265"
Sep 17 11:21:08.019963 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.019912    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4405bf3f8918d4e77d815a550451b0c4cd8fa7e55c89a1fd8b5d0bf2f3366265"} err="failed to get container status \"4405bf3f8918d4e77d815a550451b0c4cd8fa7e55c89a1fd8b5d0bf2f3366265\": rpc error: code = NotFound desc = could not find container \"4405bf3f8918d4e77d815a550451b0c4cd8fa7e55c89a1fd8b5d0bf2f3366265\": container with ID starting with 4405bf3f8918d4e77d815a550451b0c4cd8fa7e55c89a1fd8b5d0bf2f3366265 not found: ID does not exist"
Sep 17 11:21:08.029553 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.029364    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g2nm\" (UniqueName: \"kubernetes.io/projected/ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e-kube-api-access-4g2nm\") pod \"ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e\" (UID: \"ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e\") "
Sep 17 11:21:08.029553 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.029440    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mw2kx\" (UniqueName: \"kubernetes.io/projected/76975559-e971-43ee-863b-b38301dde4db-kube-api-access-mw2kx\") pod \"76975559-e971-43ee-863b-b38301dde4db\" (UID: \"76975559-e971-43ee-863b-b38301dde4db\") "
Sep 17 11:21:08.029553 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.029504    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76975559-e971-43ee-863b-b38301dde4db-plugins-config-volume\") pod \"76975559-e971-43ee-863b-b38301dde4db\" (UID: \"76975559-e971-43ee-863b-b38301dde4db\") "
Sep 17 11:21:08.029767 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.029728    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e-plugins-config-volume\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:21:08.029981 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.029963    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76975559-e971-43ee-863b-b38301dde4db-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "76975559-e971-43ee-863b-b38301dde4db" (UID: "76975559-e971-43ee-863b-b38301dde4db"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:21:08.031310 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.031288    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e-kube-api-access-4g2nm" (OuterVolumeSpecName: "kube-api-access-4g2nm") pod "ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e" (UID: "ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e"). InnerVolumeSpecName "kube-api-access-4g2nm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:21:08.031366 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.031336    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76975559-e971-43ee-863b-b38301dde4db-kube-api-access-mw2kx" (OuterVolumeSpecName: "kube-api-access-mw2kx") pod "76975559-e971-43ee-863b-b38301dde4db" (UID: "76975559-e971-43ee-863b-b38301dde4db"). InnerVolumeSpecName "kube-api-access-mw2kx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:21:08.130489 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.130393    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw2kx\" (UniqueName: \"kubernetes.io/projected/76975559-e971-43ee-863b-b38301dde4db-kube-api-access-mw2kx\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:21:08.130489 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.130427    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76975559-e971-43ee-863b-b38301dde4db-plugins-config-volume\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:21:08.130489 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.130436    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g2nm\" (UniqueName: \"kubernetes.io/projected/ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e-kube-api-access-4g2nm\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:21:08.328576 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.328548    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf"]
Sep 17 11:21:08.334855 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.334831    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9f97d7-84c94f876b-flfmf"]
Sep 17 11:21:08.347492 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.347461    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z"]
Sep 17 11:21:08.355531 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.350799    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-9f97d7-55f6f6fd4f-v2w9z"]
Sep 17 11:21:08.690813 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.690781    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76975559-e971-43ee-863b-b38301dde4db" path="/var/lib/kubelet/pods/76975559-e971-43ee-863b-b38301dde4db/volumes"
Sep 17 11:21:08.691182 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:08.691160    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e" path="/var/lib/kubelet/pods/ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e/volumes"
Sep 17 11:21:10.925712 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:10.925680    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f"
Sep 17 11:21:10.926190 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:10.926099    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx"
Sep 17 11:21:15.047130 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:15.047087    2570 generic.go:356] "Generic (PLEG): container finished" podID="acd3f492-353a-4b32-914f-f35e33a17b26" containerID="33efd3d61205e618733b6e0c6071221fd1bf96dffc9417e2da61888cce6f1cd5" exitCode=0
Sep 17 11:21:15.047710 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:15.047227    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d" event={"ID":"acd3f492-353a-4b32-914f-f35e33a17b26","Type":"ContainerDied","Data":"33efd3d61205e618733b6e0c6071221fd1bf96dffc9417e2da61888cce6f1cd5"}
Sep 17 11:21:15.047785 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:15.047713    2570 scope.go:117] "RemoveContainer" containerID="33efd3d61205e618733b6e0c6071221fd1bf96dffc9417e2da61888cce6f1cd5"
Sep 17 11:21:15.049170 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:15.049130    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:21:15.049276 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:15.049222    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:21:15.049344 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:15.049274    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 17 11:21:16.055492 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:16.055443    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d" event={"ID":"acd3f492-353a-4b32-914f-f35e33a17b26","Type":"ContainerStarted","Data":"224b31a6f902f19f907df4ec865a20013320ad26c6f422bbd1884f539a4fa296"}
Sep 17 11:21:16.702707 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:16.702677    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:21:16.702883 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:16.702855    2570 patch_prober.go:28] interesting pod/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 17 11:21:16.702927 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:16.702898    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d" podUID="acd3f492-353a-4b32-914f-f35e33a17b26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 17 11:21:17.703149 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:17.703116    2570 patch_prober.go:28] interesting pod/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 17 11:21:17.703562 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:17.703190    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d" podUID="acd3f492-353a-4b32-914f-f35e33a17b26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 17 11:21:18.703346 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:18.703309    2570 patch_prober.go:28] interesting pod/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 17 11:21:18.703784 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:18.703367    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d" podUID="acd3f492-353a-4b32-914f-f35e33a17b26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 17 11:21:19.703611 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:19.703575    2570 patch_prober.go:28] interesting pod/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 17 11:21:19.703982 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:19.703633    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d" podUID="acd3f492-353a-4b32-914f-f35e33a17b26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 17 11:21:20.703758 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:20.703725    2570 patch_prober.go:28] interesting pod/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 17 11:21:20.704162 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:20.703779    2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d" podUID="acd3f492-353a-4b32-914f-f35e33a17b26" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 17 11:21:21.706630 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:21.706599    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:21:21.707184 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:21.706947    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:21:21.707674 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:21.707653    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:21:24.323803 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:24.323774    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx_5e81370d-9111-483a-a234-270f80ea5dbf/payload-processing/0.log"
Sep 17 11:21:26.120617 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:26.120580    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"]
Sep 17 11:21:26.121084 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:26.120827    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq" podUID="183d5dbf-4edc-4e8b-a1e8-253233b1a631" containerName="maas-api" containerID="cri-o://4c100e6a7cbb393c0727cc84fc5dfdb8fb28dd359019afab95df7d5d2da3556d" gracePeriod=30
Sep 17 11:21:26.383400 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:26.383342    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"
Sep 17 11:21:26.529480 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:26.529441    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/183d5dbf-4edc-4e8b-a1e8-253233b1a631-openshift-service-ca\") pod \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\" (UID: \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\") "
Sep 17 11:21:26.529669 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:26.529535    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/183d5dbf-4edc-4e8b-a1e8-253233b1a631-maas-api-tls\") pod \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\" (UID: \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\") "
Sep 17 11:21:26.529669 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:26.529654    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/183d5dbf-4edc-4e8b-a1e8-253233b1a631-metrics-certs\") pod \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\" (UID: \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\") "
Sep 17 11:21:26.529757 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:26.529685    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqz8z\" (UniqueName: \"kubernetes.io/projected/183d5dbf-4edc-4e8b-a1e8-253233b1a631-kube-api-access-lqz8z\") pod \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\" (UID: \"183d5dbf-4edc-4e8b-a1e8-253233b1a631\") "
Sep 17 11:21:26.529822 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:26.529791    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/183d5dbf-4edc-4e8b-a1e8-253233b1a631-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "183d5dbf-4edc-4e8b-a1e8-253233b1a631" (UID: "183d5dbf-4edc-4e8b-a1e8-253233b1a631"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:21:26.529984 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:26.529967    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/183d5dbf-4edc-4e8b-a1e8-253233b1a631-openshift-service-ca\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:21:26.531659 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:26.531623    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/183d5dbf-4edc-4e8b-a1e8-253233b1a631-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "183d5dbf-4edc-4e8b-a1e8-253233b1a631" (UID: "183d5dbf-4edc-4e8b-a1e8-253233b1a631"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:21:26.531778 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:26.531665    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/183d5dbf-4edc-4e8b-a1e8-253233b1a631-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "183d5dbf-4edc-4e8b-a1e8-253233b1a631" (UID: "183d5dbf-4edc-4e8b-a1e8-253233b1a631"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:21:26.531778 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:26.531723    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/183d5dbf-4edc-4e8b-a1e8-253233b1a631-kube-api-access-lqz8z" (OuterVolumeSpecName: "kube-api-access-lqz8z") pod "183d5dbf-4edc-4e8b-a1e8-253233b1a631" (UID: "183d5dbf-4edc-4e8b-a1e8-253233b1a631"). InnerVolumeSpecName "kube-api-access-lqz8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:21:26.630795 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:26.630749    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqz8z\" (UniqueName: \"kubernetes.io/projected/183d5dbf-4edc-4e8b-a1e8-253233b1a631-kube-api-access-lqz8z\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:21:26.630795 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:26.630790    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/183d5dbf-4edc-4e8b-a1e8-253233b1a631-maas-api-tls\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:21:26.630795 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:26.630802    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/183d5dbf-4edc-4e8b-a1e8-253233b1a631-metrics-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:21:27.132845 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:27.132811    2570 generic.go:356] "Generic (PLEG): container finished" podID="183d5dbf-4edc-4e8b-a1e8-253233b1a631" containerID="4c100e6a7cbb393c0727cc84fc5dfdb8fb28dd359019afab95df7d5d2da3556d" exitCode=0
Sep 17 11:21:27.133251 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:27.132862    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"
Sep 17 11:21:27.133251 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:27.132879    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq" event={"ID":"183d5dbf-4edc-4e8b-a1e8-253233b1a631","Type":"ContainerDied","Data":"4c100e6a7cbb393c0727cc84fc5dfdb8fb28dd359019afab95df7d5d2da3556d"}
Sep 17 11:21:27.133251 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:27.132919    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq" event={"ID":"183d5dbf-4edc-4e8b-a1e8-253233b1a631","Type":"ContainerDied","Data":"d0c1a7e00da7b1bdb43d095808d7cdacfa406badd16e1da98255418cea498c9c"}
Sep 17 11:21:27.133251 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:27.132942    2570 scope.go:117] "RemoveContainer" containerID="4c100e6a7cbb393c0727cc84fc5dfdb8fb28dd359019afab95df7d5d2da3556d"
Sep 17 11:21:27.142312 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:27.142296    2570 scope.go:117] "RemoveContainer" containerID="4c100e6a7cbb393c0727cc84fc5dfdb8fb28dd359019afab95df7d5d2da3556d"
Sep 17 11:21:27.142603 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:21:27.142584    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c100e6a7cbb393c0727cc84fc5dfdb8fb28dd359019afab95df7d5d2da3556d\": container with ID starting with 4c100e6a7cbb393c0727cc84fc5dfdb8fb28dd359019afab95df7d5d2da3556d not found: ID does not exist" containerID="4c100e6a7cbb393c0727cc84fc5dfdb8fb28dd359019afab95df7d5d2da3556d"
Sep 17 11:21:27.142663 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:27.142611    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c100e6a7cbb393c0727cc84fc5dfdb8fb28dd359019afab95df7d5d2da3556d"} err="failed to get container status \"4c100e6a7cbb393c0727cc84fc5dfdb8fb28dd359019afab95df7d5d2da3556d\": rpc error: code = NotFound desc = could not find container \"4c100e6a7cbb393c0727cc84fc5dfdb8fb28dd359019afab95df7d5d2da3556d\": container with ID starting with 4c100e6a7cbb393c0727cc84fc5dfdb8fb28dd359019afab95df7d5d2da3556d not found: ID does not exist"
Sep 17 11:21:27.154690 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:27.154664    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"]
Sep 17 11:21:27.156645 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:27.156626    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-7751cd-597cdb5f9f-s8jqq"]
Sep 17 11:21:28.691229 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:28.691194    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="183d5dbf-4edc-4e8b-a1e8-253233b1a631" path="/var/lib/kubelet/pods/183d5dbf-4edc-4e8b-a1e8-253233b1a631/volumes"
Sep 17 11:21:44.592835 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:44.592801    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744"]
Sep 17 11:21:44.593346 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:44.593028    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744" podUID="fc1839fc-8cad-4067-92d2-711338da2487" containerName="payload-pre-processing" containerID="cri-o://5308ba175d15401cfc017628824a400704c8a0e6da2e00c9c031103905c768d9" gracePeriod=30
Sep 17 11:21:44.891884 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:44.891857    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744"
Sep 17 11:21:44.917363 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:44.916709    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6vdj\" (UniqueName: \"kubernetes.io/projected/fc1839fc-8cad-4067-92d2-711338da2487-kube-api-access-k6vdj\") pod \"fc1839fc-8cad-4067-92d2-711338da2487\" (UID: \"fc1839fc-8cad-4067-92d2-711338da2487\") "
Sep 17 11:21:44.917363 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:44.916825    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc1839fc-8cad-4067-92d2-711338da2487-plugins-config-volume\") pod \"fc1839fc-8cad-4067-92d2-711338da2487\" (UID: \"fc1839fc-8cad-4067-92d2-711338da2487\") "
Sep 17 11:21:44.917845 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:44.917801    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc1839fc-8cad-4067-92d2-711338da2487-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fc1839fc-8cad-4067-92d2-711338da2487" (UID: "fc1839fc-8cad-4067-92d2-711338da2487"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:21:44.921734 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:44.921675    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc1839fc-8cad-4067-92d2-711338da2487-kube-api-access-k6vdj" (OuterVolumeSpecName: "kube-api-access-k6vdj") pod "fc1839fc-8cad-4067-92d2-711338da2487" (UID: "fc1839fc-8cad-4067-92d2-711338da2487"). InnerVolumeSpecName "kube-api-access-k6vdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:21:45.017884 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:45.017849    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fc1839fc-8cad-4067-92d2-711338da2487-plugins-config-volume\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:21:45.017884 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:45.017877    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6vdj\" (UniqueName: \"kubernetes.io/projected/fc1839fc-8cad-4067-92d2-711338da2487-kube-api-access-k6vdj\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:21:45.237431 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:45.237339    2570 generic.go:356] "Generic (PLEG): container finished" podID="fc1839fc-8cad-4067-92d2-711338da2487" containerID="5308ba175d15401cfc017628824a400704c8a0e6da2e00c9c031103905c768d9" exitCode=0
Sep 17 11:21:45.237431 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:45.237387    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744"
Sep 17 11:21:45.237699 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:45.237439    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744" event={"ID":"fc1839fc-8cad-4067-92d2-711338da2487","Type":"ContainerDied","Data":"5308ba175d15401cfc017628824a400704c8a0e6da2e00c9c031103905c768d9"}
Sep 17 11:21:45.237699 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:45.237494    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744" event={"ID":"fc1839fc-8cad-4067-92d2-711338da2487","Type":"ContainerDied","Data":"213d0b26217dc88727f512d51294a69475e70fd5ab33c8bfbc550c0d49701f62"}
Sep 17 11:21:45.237699 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:45.237548    2570 scope.go:117] "RemoveContainer" containerID="5308ba175d15401cfc017628824a400704c8a0e6da2e00c9c031103905c768d9"
Sep 17 11:21:45.248008 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:45.247989    2570 scope.go:117] "RemoveContainer" containerID="5308ba175d15401cfc017628824a400704c8a0e6da2e00c9c031103905c768d9"
Sep 17 11:21:45.248283 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:21:45.248263    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5308ba175d15401cfc017628824a400704c8a0e6da2e00c9c031103905c768d9\": container with ID starting with 5308ba175d15401cfc017628824a400704c8a0e6da2e00c9c031103905c768d9 not found: ID does not exist" containerID="5308ba175d15401cfc017628824a400704c8a0e6da2e00c9c031103905c768d9"
Sep 17 11:21:45.248347 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:45.248296    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5308ba175d15401cfc017628824a400704c8a0e6da2e00c9c031103905c768d9"} err="failed to get container status \"5308ba175d15401cfc017628824a400704c8a0e6da2e00c9c031103905c768d9\": rpc error: code = NotFound desc = could not find container \"5308ba175d15401cfc017628824a400704c8a0e6da2e00c9c031103905c768d9\": container with ID starting with 5308ba175d15401cfc017628824a400704c8a0e6da2e00c9c031103905c768d9 not found: ID does not exist"
Sep 17 11:21:45.260972 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:45.260947    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744"]
Sep 17 11:21:45.266057 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:45.266034    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w1-947f83-7cbd46c66-d6744"]
Sep 17 11:21:46.690411 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:46.690376    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc1839fc-8cad-4067-92d2-711338da2487" path="/var/lib/kubelet/pods/fc1839fc-8cad-4067-92d2-711338da2487/volumes"
Sep 17 11:21:51.464277 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:51.464240    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"]
Sep 17 11:21:51.464712 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:51.464453    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz" podUID="2d494458-0355-4bbf-964b-83587335abe4" containerName="istio-proxy" containerID="cri-o://b8c4f2e3f84d4359201d49d09f82509545ae386cffac8cd5c6efa6a011cd0cb9" gracePeriod=30
Sep 17 11:21:56.712757 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.712719    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:21:56.831248 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.831217    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-workload-certs\") pod \"2d494458-0355-4bbf-964b-83587335abe4\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") "
Sep 17 11:21:56.831434 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.831277    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xghl7\" (UniqueName: \"kubernetes.io/projected/2d494458-0355-4bbf-964b-83587335abe4-kube-api-access-xghl7\") pod \"2d494458-0355-4bbf-964b-83587335abe4\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") "
Sep 17 11:21:56.831434 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.831303    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-credential-socket\") pod \"2d494458-0355-4bbf-964b-83587335abe4\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") "
Sep 17 11:21:56.831434 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.831324    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d494458-0355-4bbf-964b-83587335abe4-istio-podinfo\") pod \"2d494458-0355-4bbf-964b-83587335abe4\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") "
Sep 17 11:21:56.831434 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.831358    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-istio-data\") pod \"2d494458-0355-4bbf-964b-83587335abe4\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") "
Sep 17 11:21:56.831434 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.831384    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d494458-0355-4bbf-964b-83587335abe4-istio-token\") pod \"2d494458-0355-4bbf-964b-83587335abe4\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") "
Sep 17 11:21:56.831434 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.831409    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d494458-0355-4bbf-964b-83587335abe4-istiod-ca-cert\") pod \"2d494458-0355-4bbf-964b-83587335abe4\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") "
Sep 17 11:21:56.831788 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.831448    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-workload-socket\") pod \"2d494458-0355-4bbf-964b-83587335abe4\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") "
Sep 17 11:21:56.831788 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.831488    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2d494458-0355-4bbf-964b-83587335abe4" (UID: "2d494458-0355-4bbf-964b-83587335abe4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:21:56.831788 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.831533    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-istio-envoy\") pod \"2d494458-0355-4bbf-964b-83587335abe4\" (UID: \"2d494458-0355-4bbf-964b-83587335abe4\") "
Sep 17 11:21:56.831788 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.831689    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2d494458-0355-4bbf-964b-83587335abe4" (UID: "2d494458-0355-4bbf-964b-83587335abe4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:21:56.831788 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.831701    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-istio-data" (OuterVolumeSpecName: "istio-data") pod "2d494458-0355-4bbf-964b-83587335abe4" (UID: "2d494458-0355-4bbf-964b-83587335abe4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:21:56.832056 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.831929    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-workload-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:21:56.832056 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.831950    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-credential-socket\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:21:56.832056 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.831935    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2d494458-0355-4bbf-964b-83587335abe4" (UID: "2d494458-0355-4bbf-964b-83587335abe4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:21:56.832056 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.831966    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-istio-data\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:21:56.832224 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.832154    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d494458-0355-4bbf-964b-83587335abe4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2d494458-0355-4bbf-964b-83587335abe4" (UID: "2d494458-0355-4bbf-964b-83587335abe4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:21:56.833773 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.833744    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d494458-0355-4bbf-964b-83587335abe4-istio-token" (OuterVolumeSpecName: "istio-token") pod "2d494458-0355-4bbf-964b-83587335abe4" (UID: "2d494458-0355-4bbf-964b-83587335abe4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:21:56.833878 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.833787    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2d494458-0355-4bbf-964b-83587335abe4" (UID: "2d494458-0355-4bbf-964b-83587335abe4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:21:56.833969 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.833944    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d494458-0355-4bbf-964b-83587335abe4-kube-api-access-xghl7" (OuterVolumeSpecName: "kube-api-access-xghl7") pod "2d494458-0355-4bbf-964b-83587335abe4" (UID: "2d494458-0355-4bbf-964b-83587335abe4"). InnerVolumeSpecName "kube-api-access-xghl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:21:56.834033 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.833992    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d494458-0355-4bbf-964b-83587335abe4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2d494458-0355-4bbf-964b-83587335abe4" (UID: "2d494458-0355-4bbf-964b-83587335abe4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 11:21:56.933416 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.933381    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-workload-socket\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:21:56.933416 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.933411    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d494458-0355-4bbf-964b-83587335abe4-istio-envoy\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:21:56.933640 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.933424    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xghl7\" (UniqueName: \"kubernetes.io/projected/2d494458-0355-4bbf-964b-83587335abe4-kube-api-access-xghl7\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:21:56.933640 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.933437    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d494458-0355-4bbf-964b-83587335abe4-istio-podinfo\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:21:56.933640 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.933448    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d494458-0355-4bbf-964b-83587335abe4-istio-token\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:21:56.933640 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:56.933460    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d494458-0355-4bbf-964b-83587335abe4-istiod-ca-cert\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:21:57.310622 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:57.310580    2570 generic.go:356] "Generic (PLEG): container finished" podID="2d494458-0355-4bbf-964b-83587335abe4" containerID="b8c4f2e3f84d4359201d49d09f82509545ae386cffac8cd5c6efa6a011cd0cb9" exitCode=0
Sep 17 11:21:57.310842 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:57.310674    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"
Sep 17 11:21:57.310842 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:57.310717    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz" event={"ID":"2d494458-0355-4bbf-964b-83587335abe4","Type":"ContainerDied","Data":"b8c4f2e3f84d4359201d49d09f82509545ae386cffac8cd5c6efa6a011cd0cb9"}
Sep 17 11:21:57.310842 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:57.310822    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz" event={"ID":"2d494458-0355-4bbf-964b-83587335abe4","Type":"ContainerDied","Data":"be6f22d6adb53f70f581b4640440754b962878e5de252f6da38431ab11e4d3cd"}
Sep 17 11:21:57.311037 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:57.310856    2570 scope.go:117] "RemoveContainer" containerID="b8c4f2e3f84d4359201d49d09f82509545ae386cffac8cd5c6efa6a011cd0cb9"
Sep 17 11:21:57.320245 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:57.320223    2570 scope.go:117] "RemoveContainer" containerID="c552f2595d62169fb6db02d18fe2e63913faf08043a9d683e1b6390535ae5ec9"
Sep 17 11:21:57.327881 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:57.327865    2570 scope.go:117] "RemoveContainer" containerID="b8c4f2e3f84d4359201d49d09f82509545ae386cffac8cd5c6efa6a011cd0cb9"
Sep 17 11:21:57.328139 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:21:57.328119    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8c4f2e3f84d4359201d49d09f82509545ae386cffac8cd5c6efa6a011cd0cb9\": container with ID starting with b8c4f2e3f84d4359201d49d09f82509545ae386cffac8cd5c6efa6a011cd0cb9 not found: ID does not exist" containerID="b8c4f2e3f84d4359201d49d09f82509545ae386cffac8cd5c6efa6a011cd0cb9"
Sep 17 11:21:57.328194 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:57.328146    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8c4f2e3f84d4359201d49d09f82509545ae386cffac8cd5c6efa6a011cd0cb9"} err="failed to get container status \"b8c4f2e3f84d4359201d49d09f82509545ae386cffac8cd5c6efa6a011cd0cb9\": rpc error: code = NotFound desc = could not find container \"b8c4f2e3f84d4359201d49d09f82509545ae386cffac8cd5c6efa6a011cd0cb9\": container with ID starting with b8c4f2e3f84d4359201d49d09f82509545ae386cffac8cd5c6efa6a011cd0cb9 not found: ID does not exist"
Sep 17 11:21:57.328194 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:57.328162    2570 scope.go:117] "RemoveContainer" containerID="c552f2595d62169fb6db02d18fe2e63913faf08043a9d683e1b6390535ae5ec9"
Sep 17 11:21:57.328417 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:21:57.328401    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c552f2595d62169fb6db02d18fe2e63913faf08043a9d683e1b6390535ae5ec9\": container with ID starting with c552f2595d62169fb6db02d18fe2e63913faf08043a9d683e1b6390535ae5ec9 not found: ID does not exist" containerID="c552f2595d62169fb6db02d18fe2e63913faf08043a9d683e1b6390535ae5ec9"
Sep 17 11:21:57.328458 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:57.328424    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c552f2595d62169fb6db02d18fe2e63913faf08043a9d683e1b6390535ae5ec9"} err="failed to get container status \"c552f2595d62169fb6db02d18fe2e63913faf08043a9d683e1b6390535ae5ec9\": rpc error: code = NotFound desc = could not find container \"c552f2595d62169fb6db02d18fe2e63913faf08043a9d683e1b6390535ae5ec9\": container with ID starting with c552f2595d62169fb6db02d18fe2e63913faf08043a9d683e1b6390535ae5ec9 not found: ID does not exist"
Sep 17 11:21:57.337197 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:57.337176    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"]
Sep 17 11:21:57.343879 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:57.343858    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-947f83-openshift-default-58f85bb848-kmsfz"]
Sep 17 11:21:58.690291 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:21:58.690248    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d494458-0355-4bbf-964b-83587335abe4" path="/var/lib/kubelet/pods/2d494458-0355-4bbf-964b-83587335abe4/volumes"
Sep 17 11:22:21.017725 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:21.017694    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx_5e81370d-9111-483a-a234-270f80ea5dbf/payload-processing/0.log"
Sep 17 11:22:28.731595 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.731558    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6"]
Sep 17 11:22:28.732011 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.731950    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc1839fc-8cad-4067-92d2-711338da2487" containerName="payload-pre-processing"
Sep 17 11:22:28.732011 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.731960    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc1839fc-8cad-4067-92d2-711338da2487" containerName="payload-pre-processing"
Sep 17 11:22:28.732011 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.731976    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e" containerName="payload-processing"
Sep 17 11:22:28.732011 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.731992    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e" containerName="payload-processing"
Sep 17 11:22:28.732011 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.732004    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76975559-e971-43ee-863b-b38301dde4db" containerName="payload-pre-processing"
Sep 17 11:22:28.732011 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.732010    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="76975559-e971-43ee-863b-b38301dde4db" containerName="payload-pre-processing"
Sep 17 11:22:28.732266 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.732019    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d494458-0355-4bbf-964b-83587335abe4" containerName="istio-proxy"
Sep 17 11:22:28.732266 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.732024    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d494458-0355-4bbf-964b-83587335abe4" containerName="istio-proxy"
Sep 17 11:22:28.732266 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.732032    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="183d5dbf-4edc-4e8b-a1e8-253233b1a631" containerName="maas-api"
Sep 17 11:22:28.732266 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.732037    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="183d5dbf-4edc-4e8b-a1e8-253233b1a631" containerName="maas-api"
Sep 17 11:22:28.732266 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.732044    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d494458-0355-4bbf-964b-83587335abe4" containerName="istio-proxy"
Sep 17 11:22:28.732266 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.732049    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d494458-0355-4bbf-964b-83587335abe4" containerName="istio-proxy"
Sep 17 11:22:28.732266 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.732109    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff07a71f-c9cd-4951-927b-dfbf9b3e0d9e" containerName="payload-processing"
Sep 17 11:22:28.732266 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.732118    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d494458-0355-4bbf-964b-83587335abe4" containerName="istio-proxy"
Sep 17 11:22:28.732266 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.732123    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="183d5dbf-4edc-4e8b-a1e8-253233b1a631" containerName="maas-api"
Sep 17 11:22:28.732266 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.732129    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc1839fc-8cad-4067-92d2-711338da2487" containerName="payload-pre-processing"
Sep 17 11:22:28.732266 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.732135    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="76975559-e971-43ee-863b-b38301dde4db" containerName="payload-pre-processing"
Sep 17 11:22:28.735286 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.735266    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6"
Sep 17 11:22:28.738044 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.738020    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-fd3842\""
Sep 17 11:22:28.738140 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.738056    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-fd3842-dockercfg-wjzxh\""
Sep 17 11:22:28.745282 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.745258    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6"]
Sep 17 11:22:28.839209 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.839170    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75a1e3a3-883d-498b-9f04-a91ee315334d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6\" (UID: \"75a1e3a3-883d-498b-9f04-a91ee315334d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6"
Sep 17 11:22:28.839373 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.839312    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhkzz\" (UniqueName: \"kubernetes.io/projected/75a1e3a3-883d-498b-9f04-a91ee315334d-kube-api-access-lhkzz\") pod \"payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6\" (UID: \"75a1e3a3-883d-498b-9f04-a91ee315334d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6"
Sep 17 11:22:28.940068 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.940034    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhkzz\" (UniqueName: \"kubernetes.io/projected/75a1e3a3-883d-498b-9f04-a91ee315334d-kube-api-access-lhkzz\") pod \"payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6\" (UID: \"75a1e3a3-883d-498b-9f04-a91ee315334d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6"
Sep 17 11:22:28.940253 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.940103    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75a1e3a3-883d-498b-9f04-a91ee315334d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6\" (UID: \"75a1e3a3-883d-498b-9f04-a91ee315334d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6"
Sep 17 11:22:28.940863 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.940838    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75a1e3a3-883d-498b-9f04-a91ee315334d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6\" (UID: \"75a1e3a3-883d-498b-9f04-a91ee315334d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6"
Sep 17 11:22:28.948599 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:28.948578    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhkzz\" (UniqueName: \"kubernetes.io/projected/75a1e3a3-883d-498b-9f04-a91ee315334d-kube-api-access-lhkzz\") pod \"payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6\" (UID: \"75a1e3a3-883d-498b-9f04-a91ee315334d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6"
Sep 17 11:22:29.046564 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:29.046535    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6"
Sep 17 11:22:29.326235 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:29.326207    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6"]
Sep 17 11:22:29.328121 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:22:29.328099    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a1e3a3_883d_498b_9f04_a91ee315334d.slice/crio-286c51b12d081e0a3d80def0dcd9fd8e4a9e3bf0ff4cfee746f7e1b227afe362 WatchSource:0}: Error finding container 286c51b12d081e0a3d80def0dcd9fd8e4a9e3bf0ff4cfee746f7e1b227afe362: Status 404 returned error can't find the container with id 286c51b12d081e0a3d80def0dcd9fd8e4a9e3bf0ff4cfee746f7e1b227afe362
Sep 17 11:22:29.484350 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:29.484314    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6" event={"ID":"75a1e3a3-883d-498b-9f04-a91ee315334d","Type":"ContainerStarted","Data":"fe03e52fe88fd36a5186548ed46b299ec37ad7eb7922ad96d468d00a92403db9"}
Sep 17 11:22:29.484557 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:29.484363    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6" event={"ID":"75a1e3a3-883d-498b-9f04-a91ee315334d","Type":"ContainerStarted","Data":"286c51b12d081e0a3d80def0dcd9fd8e4a9e3bf0ff4cfee746f7e1b227afe362"}
Sep 17 11:22:29.484557 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:29.484394    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6"
Sep 17 11:22:29.504176 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:29.504131    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6" podStartSLOduration=1.504118267 podStartE2EDuration="1.504118267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:22:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:22:29.503387962 +0000 UTC m=+1739.298722402" watchObservedRunningTime="2026-09-17 11:22:29.504118267 +0000 UTC m=+1739.299452715"
Sep 17 11:22:40.493457 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:22:40.493428    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6"
Sep 17 11:23:06.909492 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:06.909461    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6"]
Sep 17 11:23:06.910095 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:06.909708    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6" podUID="75a1e3a3-883d-498b-9f04-a91ee315334d" containerName="payload-pre-processing" containerID="cri-o://fe03e52fe88fd36a5186548ed46b299ec37ad7eb7922ad96d468d00a92403db9" gracePeriod=30
Sep 17 11:23:07.173235 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:07.173178    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6"
Sep 17 11:23:07.182753 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:07.182727    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75a1e3a3-883d-498b-9f04-a91ee315334d-plugins-config-volume\") pod \"75a1e3a3-883d-498b-9f04-a91ee315334d\" (UID: \"75a1e3a3-883d-498b-9f04-a91ee315334d\") "
Sep 17 11:23:07.182907 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:07.182786    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhkzz\" (UniqueName: \"kubernetes.io/projected/75a1e3a3-883d-498b-9f04-a91ee315334d-kube-api-access-lhkzz\") pod \"75a1e3a3-883d-498b-9f04-a91ee315334d\" (UID: \"75a1e3a3-883d-498b-9f04-a91ee315334d\") "
Sep 17 11:23:07.183073 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:07.183050    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75a1e3a3-883d-498b-9f04-a91ee315334d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "75a1e3a3-883d-498b-9f04-a91ee315334d" (UID: "75a1e3a3-883d-498b-9f04-a91ee315334d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:23:07.184806 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:07.184788    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75a1e3a3-883d-498b-9f04-a91ee315334d-kube-api-access-lhkzz" (OuterVolumeSpecName: "kube-api-access-lhkzz") pod "75a1e3a3-883d-498b-9f04-a91ee315334d" (UID: "75a1e3a3-883d-498b-9f04-a91ee315334d"). InnerVolumeSpecName "kube-api-access-lhkzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:23:07.284095 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:07.284064    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75a1e3a3-883d-498b-9f04-a91ee315334d-plugins-config-volume\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:23:07.284095 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:07.284092    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhkzz\" (UniqueName: \"kubernetes.io/projected/75a1e3a3-883d-498b-9f04-a91ee315334d-kube-api-access-lhkzz\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:23:07.681252 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:07.681214    2570 generic.go:356] "Generic (PLEG): container finished" podID="75a1e3a3-883d-498b-9f04-a91ee315334d" containerID="fe03e52fe88fd36a5186548ed46b299ec37ad7eb7922ad96d468d00a92403db9" exitCode=0
Sep 17 11:23:07.681421 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:07.681264    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6"
Sep 17 11:23:07.681421 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:07.681296    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6" event={"ID":"75a1e3a3-883d-498b-9f04-a91ee315334d","Type":"ContainerDied","Data":"fe03e52fe88fd36a5186548ed46b299ec37ad7eb7922ad96d468d00a92403db9"}
Sep 17 11:23:07.681421 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:07.681369    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6" event={"ID":"75a1e3a3-883d-498b-9f04-a91ee315334d","Type":"ContainerDied","Data":"286c51b12d081e0a3d80def0dcd9fd8e4a9e3bf0ff4cfee746f7e1b227afe362"}
Sep 17 11:23:07.681421 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:07.681391    2570 scope.go:117] "RemoveContainer" containerID="fe03e52fe88fd36a5186548ed46b299ec37ad7eb7922ad96d468d00a92403db9"
Sep 17 11:23:07.690441 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:07.690418    2570 scope.go:117] "RemoveContainer" containerID="fe03e52fe88fd36a5186548ed46b299ec37ad7eb7922ad96d468d00a92403db9"
Sep 17 11:23:07.690736 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:23:07.690717    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe03e52fe88fd36a5186548ed46b299ec37ad7eb7922ad96d468d00a92403db9\": container with ID starting with fe03e52fe88fd36a5186548ed46b299ec37ad7eb7922ad96d468d00a92403db9 not found: ID does not exist" containerID="fe03e52fe88fd36a5186548ed46b299ec37ad7eb7922ad96d468d00a92403db9"
Sep 17 11:23:07.690791 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:07.690745    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe03e52fe88fd36a5186548ed46b299ec37ad7eb7922ad96d468d00a92403db9"} err="failed to get container status \"fe03e52fe88fd36a5186548ed46b299ec37ad7eb7922ad96d468d00a92403db9\": rpc error: code = NotFound desc = could not find container \"fe03e52fe88fd36a5186548ed46b299ec37ad7eb7922ad96d468d00a92403db9\": container with ID starting with fe03e52fe88fd36a5186548ed46b299ec37ad7eb7922ad96d468d00a92403db9 not found: ID does not exist"
Sep 17 11:23:07.705708 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:07.705689    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6"]
Sep 17 11:23:07.708026 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:07.708000    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fd3842-78748b5598-fmln6"]
Sep 17 11:23:08.690332 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:08.690301    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75a1e3a3-883d-498b-9f04-a91ee315334d" path="/var/lib/kubelet/pods/75a1e3a3-883d-498b-9f04-a91ee315334d/volumes"
Sep 17 11:23:30.770472 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:30.770441    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 11:23:30.779850 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:30.779824    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 11:23:33.794751 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:33.794716    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46"]
Sep 17 11:23:33.795203 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:33.794948    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46" podUID="48a6c3aa-880c-4bd8-a313-7bf743f1fda7" containerName="payload-pre-processing" containerID="cri-o://afb2bff21e634bb4e9cf88d046a6282054907992dca94fee9698dc07c2c72b99" gracePeriod=30
Sep 17 11:23:34.091021 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:34.090994    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46"
Sep 17 11:23:34.226956 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:34.226923    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48a6c3aa-880c-4bd8-a313-7bf743f1fda7-plugins-config-volume\") pod \"48a6c3aa-880c-4bd8-a313-7bf743f1fda7\" (UID: \"48a6c3aa-880c-4bd8-a313-7bf743f1fda7\") "
Sep 17 11:23:34.227170 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:34.226979    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7p4h\" (UniqueName: \"kubernetes.io/projected/48a6c3aa-880c-4bd8-a313-7bf743f1fda7-kube-api-access-x7p4h\") pod \"48a6c3aa-880c-4bd8-a313-7bf743f1fda7\" (UID: \"48a6c3aa-880c-4bd8-a313-7bf743f1fda7\") "
Sep 17 11:23:34.227363 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:34.227341    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48a6c3aa-880c-4bd8-a313-7bf743f1fda7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "48a6c3aa-880c-4bd8-a313-7bf743f1fda7" (UID: "48a6c3aa-880c-4bd8-a313-7bf743f1fda7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:23:34.229059 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:34.229030    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48a6c3aa-880c-4bd8-a313-7bf743f1fda7-kube-api-access-x7p4h" (OuterVolumeSpecName: "kube-api-access-x7p4h") pod "48a6c3aa-880c-4bd8-a313-7bf743f1fda7" (UID: "48a6c3aa-880c-4bd8-a313-7bf743f1fda7"). InnerVolumeSpecName "kube-api-access-x7p4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:23:34.328547 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:34.328466    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48a6c3aa-880c-4bd8-a313-7bf743f1fda7-plugins-config-volume\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:23:34.328547 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:34.328492    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7p4h\" (UniqueName: \"kubernetes.io/projected/48a6c3aa-880c-4bd8-a313-7bf743f1fda7-kube-api-access-x7p4h\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:23:34.813421 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:34.813388    2570 generic.go:356] "Generic (PLEG): container finished" podID="48a6c3aa-880c-4bd8-a313-7bf743f1fda7" containerID="afb2bff21e634bb4e9cf88d046a6282054907992dca94fee9698dc07c2c72b99" exitCode=0
Sep 17 11:23:34.813802 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:34.813430    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46"
Sep 17 11:23:34.813802 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:34.813481    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46" event={"ID":"48a6c3aa-880c-4bd8-a313-7bf743f1fda7","Type":"ContainerDied","Data":"afb2bff21e634bb4e9cf88d046a6282054907992dca94fee9698dc07c2c72b99"}
Sep 17 11:23:34.813802 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:34.813550    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46" event={"ID":"48a6c3aa-880c-4bd8-a313-7bf743f1fda7","Type":"ContainerDied","Data":"6b182a9b89755e2f0e71477bd6e6e5af2d4800ae339e2aa6d43681266ce16a94"}
Sep 17 11:23:34.813802 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:34.813573    2570 scope.go:117] "RemoveContainer" containerID="afb2bff21e634bb4e9cf88d046a6282054907992dca94fee9698dc07c2c72b99"
Sep 17 11:23:34.822062 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:34.822047    2570 scope.go:117] "RemoveContainer" containerID="afb2bff21e634bb4e9cf88d046a6282054907992dca94fee9698dc07c2c72b99"
Sep 17 11:23:34.822330 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:23:34.822308    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afb2bff21e634bb4e9cf88d046a6282054907992dca94fee9698dc07c2c72b99\": container with ID starting with afb2bff21e634bb4e9cf88d046a6282054907992dca94fee9698dc07c2c72b99 not found: ID does not exist" containerID="afb2bff21e634bb4e9cf88d046a6282054907992dca94fee9698dc07c2c72b99"
Sep 17 11:23:34.822381 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:34.822340    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afb2bff21e634bb4e9cf88d046a6282054907992dca94fee9698dc07c2c72b99"} err="failed to get container status \"afb2bff21e634bb4e9cf88d046a6282054907992dca94fee9698dc07c2c72b99\": rpc error: code = NotFound desc = could not find container \"afb2bff21e634bb4e9cf88d046a6282054907992dca94fee9698dc07c2c72b99\": container with ID starting with afb2bff21e634bb4e9cf88d046a6282054907992dca94fee9698dc07c2c72b99 not found: ID does not exist"
Sep 17 11:23:34.846787 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:34.846755    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46"]
Sep 17 11:23:34.861069 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:34.861033    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-31fca0-7879894f7d-lnj46"]
Sep 17 11:23:36.690463 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:23:36.690430    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48a6c3aa-880c-4bd8-a313-7bf743f1fda7" path="/var/lib/kubelet/pods/48a6c3aa-880c-4bd8-a313-7bf743f1fda7/volumes"
Sep 17 11:24:36.052360 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:36.052325    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx"]
Sep 17 11:24:36.053888 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:36.053850    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx" podUID="5e81370d-9111-483a-a234-270f80ea5dbf" containerName="payload-processing" containerID="cri-o://3d0ef5878cab926288acebca2154ce9f5a28df4bb59a7bb3e0417134dfb429c8" gracePeriod=30
Sep 17 11:24:36.057173 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:36.057145    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f"]
Sep 17 11:24:36.057409 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:36.057364    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f" podUID="625516fc-92e1-4d8e-adaa-f8a502096204" containerName="payload-pre-processing" containerID="cri-o://10ff08cc1ca96c64c3638684c77d6e90943b28c1aa1720cbb01bedbb4be30557" gracePeriod=30
Sep 17 11:24:36.306652 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:36.306589    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f"
Sep 17 11:24:36.346810 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:36.346784    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx"
Sep 17 11:24:36.484431 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:36.484397    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gqhv\" (UniqueName: \"kubernetes.io/projected/5e81370d-9111-483a-a234-270f80ea5dbf-kube-api-access-5gqhv\") pod \"5e81370d-9111-483a-a234-270f80ea5dbf\" (UID: \"5e81370d-9111-483a-a234-270f80ea5dbf\") "
Sep 17 11:24:36.484431 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:36.484440    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgcjl\" (UniqueName: \"kubernetes.io/projected/625516fc-92e1-4d8e-adaa-f8a502096204-kube-api-access-dgcjl\") pod \"625516fc-92e1-4d8e-adaa-f8a502096204\" (UID: \"625516fc-92e1-4d8e-adaa-f8a502096204\") "
Sep 17 11:24:36.484722 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:36.484487    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e81370d-9111-483a-a234-270f80ea5dbf-plugins-config-volume\") pod \"5e81370d-9111-483a-a234-270f80ea5dbf\" (UID: \"5e81370d-9111-483a-a234-270f80ea5dbf\") "
Sep 17 11:24:36.484722 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:36.484627    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/625516fc-92e1-4d8e-adaa-f8a502096204-plugins-config-volume\") pod \"625516fc-92e1-4d8e-adaa-f8a502096204\" (UID: \"625516fc-92e1-4d8e-adaa-f8a502096204\") "
Sep 17 11:24:36.485173 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:36.485138    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e81370d-9111-483a-a234-270f80ea5dbf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5e81370d-9111-483a-a234-270f80ea5dbf" (UID: "5e81370d-9111-483a-a234-270f80ea5dbf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:24:36.485173 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:36.485167    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/625516fc-92e1-4d8e-adaa-f8a502096204-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "625516fc-92e1-4d8e-adaa-f8a502096204" (UID: "625516fc-92e1-4d8e-adaa-f8a502096204"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:24:36.486641 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:36.486619    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e81370d-9111-483a-a234-270f80ea5dbf-kube-api-access-5gqhv" (OuterVolumeSpecName: "kube-api-access-5gqhv") pod "5e81370d-9111-483a-a234-270f80ea5dbf" (UID: "5e81370d-9111-483a-a234-270f80ea5dbf"). InnerVolumeSpecName "kube-api-access-5gqhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:24:36.487197 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:36.487171    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/625516fc-92e1-4d8e-adaa-f8a502096204-kube-api-access-dgcjl" (OuterVolumeSpecName: "kube-api-access-dgcjl") pod "625516fc-92e1-4d8e-adaa-f8a502096204" (UID: "625516fc-92e1-4d8e-adaa-f8a502096204"). InnerVolumeSpecName "kube-api-access-dgcjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:24:36.586183 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:36.586098    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/625516fc-92e1-4d8e-adaa-f8a502096204-plugins-config-volume\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:24:36.586183 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:36.586131    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gqhv\" (UniqueName: \"kubernetes.io/projected/5e81370d-9111-483a-a234-270f80ea5dbf-kube-api-access-5gqhv\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:24:36.586183 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:36.586141    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgcjl\" (UniqueName: \"kubernetes.io/projected/625516fc-92e1-4d8e-adaa-f8a502096204-kube-api-access-dgcjl\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:24:36.586183 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:36.586149    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e81370d-9111-483a-a234-270f80ea5dbf-plugins-config-volume\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:24:37.137354 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:37.137317    2570 generic.go:356] "Generic (PLEG): container finished" podID="625516fc-92e1-4d8e-adaa-f8a502096204" containerID="10ff08cc1ca96c64c3638684c77d6e90943b28c1aa1720cbb01bedbb4be30557" exitCode=0
Sep 17 11:24:37.137827 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:37.137360    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f"
Sep 17 11:24:37.137827 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:37.137398    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f" event={"ID":"625516fc-92e1-4d8e-adaa-f8a502096204","Type":"ContainerDied","Data":"10ff08cc1ca96c64c3638684c77d6e90943b28c1aa1720cbb01bedbb4be30557"}
Sep 17 11:24:37.137827 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:37.137449    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f" event={"ID":"625516fc-92e1-4d8e-adaa-f8a502096204","Type":"ContainerDied","Data":"78b7ab5dc9ca43f7cd9f59158edff4865e1c4a7ca4a6a6ccaf54446a1b7da134"}
Sep 17 11:24:37.137827 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:37.137470    2570 scope.go:117] "RemoveContainer" containerID="10ff08cc1ca96c64c3638684c77d6e90943b28c1aa1720cbb01bedbb4be30557"
Sep 17 11:24:37.138888 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:37.138791    2570 generic.go:356] "Generic (PLEG): container finished" podID="5e81370d-9111-483a-a234-270f80ea5dbf" containerID="3d0ef5878cab926288acebca2154ce9f5a28df4bb59a7bb3e0417134dfb429c8" exitCode=0
Sep 17 11:24:37.138888 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:37.138831    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx"
Sep 17 11:24:37.138888 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:37.138873    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx" event={"ID":"5e81370d-9111-483a-a234-270f80ea5dbf","Type":"ContainerDied","Data":"3d0ef5878cab926288acebca2154ce9f5a28df4bb59a7bb3e0417134dfb429c8"}
Sep 17 11:24:37.139014 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:37.138916    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx" event={"ID":"5e81370d-9111-483a-a234-270f80ea5dbf","Type":"ContainerDied","Data":"1da825f1a89194fdc183b790721db712bc0726c0c24e5e0d2846fc9d4b5a281b"}
Sep 17 11:24:37.146167 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:37.146150    2570 scope.go:117] "RemoveContainer" containerID="10ff08cc1ca96c64c3638684c77d6e90943b28c1aa1720cbb01bedbb4be30557"
Sep 17 11:24:37.146462 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:24:37.146436    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10ff08cc1ca96c64c3638684c77d6e90943b28c1aa1720cbb01bedbb4be30557\": container with ID starting with 10ff08cc1ca96c64c3638684c77d6e90943b28c1aa1720cbb01bedbb4be30557 not found: ID does not exist" containerID="10ff08cc1ca96c64c3638684c77d6e90943b28c1aa1720cbb01bedbb4be30557"
Sep 17 11:24:37.146537 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:37.146470    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10ff08cc1ca96c64c3638684c77d6e90943b28c1aa1720cbb01bedbb4be30557"} err="failed to get container status \"10ff08cc1ca96c64c3638684c77d6e90943b28c1aa1720cbb01bedbb4be30557\": rpc error: code = NotFound desc = could not find container \"10ff08cc1ca96c64c3638684c77d6e90943b28c1aa1720cbb01bedbb4be30557\": container with ID starting with 10ff08cc1ca96c64c3638684c77d6e90943b28c1aa1720cbb01bedbb4be30557 not found: ID does not exist"
Sep 17 11:24:37.146537 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:37.146485    2570 scope.go:117] "RemoveContainer" containerID="3d0ef5878cab926288acebca2154ce9f5a28df4bb59a7bb3e0417134dfb429c8"
Sep 17 11:24:37.155616 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:37.155597    2570 scope.go:117] "RemoveContainer" containerID="3d0ef5878cab926288acebca2154ce9f5a28df4bb59a7bb3e0417134dfb429c8"
Sep 17 11:24:37.155919 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:24:37.155886    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d0ef5878cab926288acebca2154ce9f5a28df4bb59a7bb3e0417134dfb429c8\": container with ID starting with 3d0ef5878cab926288acebca2154ce9f5a28df4bb59a7bb3e0417134dfb429c8 not found: ID does not exist" containerID="3d0ef5878cab926288acebca2154ce9f5a28df4bb59a7bb3e0417134dfb429c8"
Sep 17 11:24:37.155987 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:37.155927    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d0ef5878cab926288acebca2154ce9f5a28df4bb59a7bb3e0417134dfb429c8"} err="failed to get container status \"3d0ef5878cab926288acebca2154ce9f5a28df4bb59a7bb3e0417134dfb429c8\": rpc error: code = NotFound desc = could not find container \"3d0ef5878cab926288acebca2154ce9f5a28df4bb59a7bb3e0417134dfb429c8\": container with ID starting with 3d0ef5878cab926288acebca2154ce9f5a28df4bb59a7bb3e0417134dfb429c8 not found: ID does not exist"
Sep 17 11:24:37.198306 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:37.198278    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f"]
Sep 17 11:24:37.206298 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:37.206274    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-23a45b-844fd746d6-2pm8f"]
Sep 17 11:24:37.223361 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:37.223338    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx"]
Sep 17 11:24:37.228947 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:37.228927    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-23a45b-69c69b9769-6dllx"]
Sep 17 11:24:38.691218 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:38.691182    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e81370d-9111-483a-a234-270f80ea5dbf" path="/var/lib/kubelet/pods/5e81370d-9111-483a-a234-270f80ea5dbf/volumes"
Sep 17 11:24:38.691607 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:38.691574    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="625516fc-92e1-4d8e-adaa-f8a502096204" path="/var/lib/kubelet/pods/625516fc-92e1-4d8e-adaa-f8a502096204/volumes"
Sep 17 11:24:42.792692 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:42.792658    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"]
Sep 17 11:24:42.793250 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:42.792948    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d" podUID="acd3f492-353a-4b32-914f-f35e33a17b26" containerName="istio-proxy" containerID="cri-o://224b31a6f902f19f907df4ec865a20013320ad26c6f422bbd1884f539a4fa296" gracePeriod=30
Sep 17 11:24:48.040099 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.040072    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:24:48.081858 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.081773    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-istio-envoy\") pod \"acd3f492-353a-4b32-914f-f35e33a17b26\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") "
Sep 17 11:24:48.082062 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.081857    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-workload-certs\") pod \"acd3f492-353a-4b32-914f-f35e33a17b26\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") "
Sep 17 11:24:48.082062 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.081910    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acd3f492-353a-4b32-914f-f35e33a17b26-istio-token\") pod \"acd3f492-353a-4b32-914f-f35e33a17b26\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") "
Sep 17 11:24:48.082062 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.081947    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-istio-data\") pod \"acd3f492-353a-4b32-914f-f35e33a17b26\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") "
Sep 17 11:24:48.082062 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.081972    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfxgn\" (UniqueName: \"kubernetes.io/projected/acd3f492-353a-4b32-914f-f35e33a17b26-kube-api-access-sfxgn\") pod \"acd3f492-353a-4b32-914f-f35e33a17b26\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") "
Sep 17 11:24:48.082062 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.082011    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-workload-socket\") pod \"acd3f492-353a-4b32-914f-f35e33a17b26\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") "
Sep 17 11:24:48.082062 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.082040    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-credential-socket\") pod \"acd3f492-353a-4b32-914f-f35e33a17b26\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") "
Sep 17 11:24:48.082476 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.082111    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acd3f492-353a-4b32-914f-f35e33a17b26-istio-podinfo\") pod \"acd3f492-353a-4b32-914f-f35e33a17b26\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") "
Sep 17 11:24:48.082476 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.082169    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acd3f492-353a-4b32-914f-f35e33a17b26-istiod-ca-cert\") pod \"acd3f492-353a-4b32-914f-f35e33a17b26\" (UID: \"acd3f492-353a-4b32-914f-f35e33a17b26\") "
Sep 17 11:24:48.083033 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.083000    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acd3f492-353a-4b32-914f-f35e33a17b26-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "acd3f492-353a-4b32-914f-f35e33a17b26" (UID: "acd3f492-353a-4b32-914f-f35e33a17b26"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:24:48.085749 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.085569    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "acd3f492-353a-4b32-914f-f35e33a17b26" (UID: "acd3f492-353a-4b32-914f-f35e33a17b26"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:24:48.086049 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.085894    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "acd3f492-353a-4b32-914f-f35e33a17b26" (UID: "acd3f492-353a-4b32-914f-f35e33a17b26"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:24:48.086799 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.086156    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "acd3f492-353a-4b32-914f-f35e33a17b26" (UID: "acd3f492-353a-4b32-914f-f35e33a17b26"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:24:48.089159 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.089126    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acd3f492-353a-4b32-914f-f35e33a17b26-kube-api-access-sfxgn" (OuterVolumeSpecName: "kube-api-access-sfxgn") pod "acd3f492-353a-4b32-914f-f35e33a17b26" (UID: "acd3f492-353a-4b32-914f-f35e33a17b26"). InnerVolumeSpecName "kube-api-access-sfxgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:24:48.089676 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.089375    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "acd3f492-353a-4b32-914f-f35e33a17b26" (UID: "acd3f492-353a-4b32-914f-f35e33a17b26"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:24:48.089676 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.089453    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/acd3f492-353a-4b32-914f-f35e33a17b26-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "acd3f492-353a-4b32-914f-f35e33a17b26" (UID: "acd3f492-353a-4b32-914f-f35e33a17b26"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 11:24:48.090567 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.089866    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-istio-data" (OuterVolumeSpecName: "istio-data") pod "acd3f492-353a-4b32-914f-f35e33a17b26" (UID: "acd3f492-353a-4b32-914f-f35e33a17b26"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:24:48.092193 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.092172    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acd3f492-353a-4b32-914f-f35e33a17b26-istio-token" (OuterVolumeSpecName: "istio-token") pod "acd3f492-353a-4b32-914f-f35e33a17b26" (UID: "acd3f492-353a-4b32-914f-f35e33a17b26"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:24:48.184084 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.184054    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acd3f492-353a-4b32-914f-f35e33a17b26-istio-podinfo\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:24:48.184191 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.184085    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acd3f492-353a-4b32-914f-f35e33a17b26-istiod-ca-cert\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:24:48.184191 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.184099    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-istio-envoy\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:24:48.184191 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.184113    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-workload-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:24:48.184191 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.184125    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acd3f492-353a-4b32-914f-f35e33a17b26-istio-token\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:24:48.184191 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.184135    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-istio-data\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:24:48.184191 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.184147    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfxgn\" (UniqueName: \"kubernetes.io/projected/acd3f492-353a-4b32-914f-f35e33a17b26-kube-api-access-sfxgn\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:24:48.184191 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.184159    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-workload-socket\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:24:48.184191 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.184178    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acd3f492-353a-4b32-914f-f35e33a17b26-credential-socket\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:24:48.200923 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.200891    2570 generic.go:356] "Generic (PLEG): container finished" podID="acd3f492-353a-4b32-914f-f35e33a17b26" containerID="224b31a6f902f19f907df4ec865a20013320ad26c6f422bbd1884f539a4fa296" exitCode=0
Sep 17 11:24:48.201029 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.200956    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"
Sep 17 11:24:48.201029 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.200969    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d" event={"ID":"acd3f492-353a-4b32-914f-f35e33a17b26","Type":"ContainerDied","Data":"224b31a6f902f19f907df4ec865a20013320ad26c6f422bbd1884f539a4fa296"}
Sep 17 11:24:48.201143 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.201065    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d" event={"ID":"acd3f492-353a-4b32-914f-f35e33a17b26","Type":"ContainerDied","Data":"1a2fe1453c5e60d417b482243afe728c495330cd3b335bc9a24f0ff6c1c5ad16"}
Sep 17 11:24:48.201143 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.201091    2570 scope.go:117] "RemoveContainer" containerID="224b31a6f902f19f907df4ec865a20013320ad26c6f422bbd1884f539a4fa296"
Sep 17 11:24:48.210351 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.210328    2570 scope.go:117] "RemoveContainer" containerID="33efd3d61205e618733b6e0c6071221fd1bf96dffc9417e2da61888cce6f1cd5"
Sep 17 11:24:48.219352 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.219330    2570 scope.go:117] "RemoveContainer" containerID="224b31a6f902f19f907df4ec865a20013320ad26c6f422bbd1884f539a4fa296"
Sep 17 11:24:48.219623 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:24:48.219605    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"224b31a6f902f19f907df4ec865a20013320ad26c6f422bbd1884f539a4fa296\": container with ID starting with 224b31a6f902f19f907df4ec865a20013320ad26c6f422bbd1884f539a4fa296 not found: ID does not exist" containerID="224b31a6f902f19f907df4ec865a20013320ad26c6f422bbd1884f539a4fa296"
Sep 17 11:24:48.219728 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.219631    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"224b31a6f902f19f907df4ec865a20013320ad26c6f422bbd1884f539a4fa296"} err="failed to get container status \"224b31a6f902f19f907df4ec865a20013320ad26c6f422bbd1884f539a4fa296\": rpc error: code = NotFound desc = could not find container \"224b31a6f902f19f907df4ec865a20013320ad26c6f422bbd1884f539a4fa296\": container with ID starting with 224b31a6f902f19f907df4ec865a20013320ad26c6f422bbd1884f539a4fa296 not found: ID does not exist"
Sep 17 11:24:48.219728 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.219647    2570 scope.go:117] "RemoveContainer" containerID="33efd3d61205e618733b6e0c6071221fd1bf96dffc9417e2da61888cce6f1cd5"
Sep 17 11:24:48.219879 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:24:48.219859    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33efd3d61205e618733b6e0c6071221fd1bf96dffc9417e2da61888cce6f1cd5\": container with ID starting with 33efd3d61205e618733b6e0c6071221fd1bf96dffc9417e2da61888cce6f1cd5 not found: ID does not exist" containerID="33efd3d61205e618733b6e0c6071221fd1bf96dffc9417e2da61888cce6f1cd5"
Sep 17 11:24:48.219920 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.219883    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33efd3d61205e618733b6e0c6071221fd1bf96dffc9417e2da61888cce6f1cd5"} err="failed to get container status \"33efd3d61205e618733b6e0c6071221fd1bf96dffc9417e2da61888cce6f1cd5\": rpc error: code = NotFound desc = could not find container \"33efd3d61205e618733b6e0c6071221fd1bf96dffc9417e2da61888cce6f1cd5\": container with ID starting with 33efd3d61205e618733b6e0c6071221fd1bf96dffc9417e2da61888cce6f1cd5 not found: ID does not exist"
Sep 17 11:24:48.225575 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.225552    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"]
Sep 17 11:24:48.229693 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.229672    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-23a45b-openshift-default-6b7879456b-rcx8d"]
Sep 17 11:24:48.690863 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:48.690832    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acd3f492-353a-4b32-914f-f35e33a17b26" path="/var/lib/kubelet/pods/acd3f492-353a-4b32-914f-f35e33a17b26/volumes"
Sep 17 11:24:53.895843 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:53.895662    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x"]
Sep 17 11:24:53.896750 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:53.896634    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x" podUID="2cff8fe0-aa14-41cb-8654-5c84d123f325" containerName="payload-pre-processing" containerID="cri-o://87f307031808b2fd440f802ce773f8e8adbdd72f78ebe77d81a7e6a66b532409" gracePeriod=30
Sep 17 11:24:54.153162 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:54.153108    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x"
Sep 17 11:24:54.233166 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:54.233134    2570 generic.go:356] "Generic (PLEG): container finished" podID="2cff8fe0-aa14-41cb-8654-5c84d123f325" containerID="87f307031808b2fd440f802ce773f8e8adbdd72f78ebe77d81a7e6a66b532409" exitCode=0
Sep 17 11:24:54.233358 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:54.233175    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x"
Sep 17 11:24:54.233358 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:54.233224    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x" event={"ID":"2cff8fe0-aa14-41cb-8654-5c84d123f325","Type":"ContainerDied","Data":"87f307031808b2fd440f802ce773f8e8adbdd72f78ebe77d81a7e6a66b532409"}
Sep 17 11:24:54.233358 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:54.233269    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x" event={"ID":"2cff8fe0-aa14-41cb-8654-5c84d123f325","Type":"ContainerDied","Data":"7a5d4cd6cd3ead80487e65c53bd55709461a44534ba1ecb2c2917671fd471ad3"}
Sep 17 11:24:54.233358 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:54.233296    2570 scope.go:117] "RemoveContainer" containerID="87f307031808b2fd440f802ce773f8e8adbdd72f78ebe77d81a7e6a66b532409"
Sep 17 11:24:54.233619 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:54.233554    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cff8fe0-aa14-41cb-8654-5c84d123f325-plugins-config-volume\") pod \"2cff8fe0-aa14-41cb-8654-5c84d123f325\" (UID: \"2cff8fe0-aa14-41cb-8654-5c84d123f325\") "
Sep 17 11:24:54.233682 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:54.233655    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbpf4\" (UniqueName: \"kubernetes.io/projected/2cff8fe0-aa14-41cb-8654-5c84d123f325-kube-api-access-dbpf4\") pod \"2cff8fe0-aa14-41cb-8654-5c84d123f325\" (UID: \"2cff8fe0-aa14-41cb-8654-5c84d123f325\") "
Sep 17 11:24:54.234029 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:54.233992    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cff8fe0-aa14-41cb-8654-5c84d123f325-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2cff8fe0-aa14-41cb-8654-5c84d123f325" (UID: "2cff8fe0-aa14-41cb-8654-5c84d123f325"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:24:54.236311 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:54.236271    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cff8fe0-aa14-41cb-8654-5c84d123f325-kube-api-access-dbpf4" (OuterVolumeSpecName: "kube-api-access-dbpf4") pod "2cff8fe0-aa14-41cb-8654-5c84d123f325" (UID: "2cff8fe0-aa14-41cb-8654-5c84d123f325"). InnerVolumeSpecName "kube-api-access-dbpf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:24:54.247036 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:54.247014    2570 scope.go:117] "RemoveContainer" containerID="87f307031808b2fd440f802ce773f8e8adbdd72f78ebe77d81a7e6a66b532409"
Sep 17 11:24:54.247340 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:24:54.247314    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87f307031808b2fd440f802ce773f8e8adbdd72f78ebe77d81a7e6a66b532409\": container with ID starting with 87f307031808b2fd440f802ce773f8e8adbdd72f78ebe77d81a7e6a66b532409 not found: ID does not exist" containerID="87f307031808b2fd440f802ce773f8e8adbdd72f78ebe77d81a7e6a66b532409"
Sep 17 11:24:54.247408 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:54.247349    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87f307031808b2fd440f802ce773f8e8adbdd72f78ebe77d81a7e6a66b532409"} err="failed to get container status \"87f307031808b2fd440f802ce773f8e8adbdd72f78ebe77d81a7e6a66b532409\": rpc error: code = NotFound desc = could not find container \"87f307031808b2fd440f802ce773f8e8adbdd72f78ebe77d81a7e6a66b532409\": container with ID starting with 87f307031808b2fd440f802ce773f8e8adbdd72f78ebe77d81a7e6a66b532409 not found: ID does not exist"
Sep 17 11:24:54.335418 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:54.335391    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2cff8fe0-aa14-41cb-8654-5c84d123f325-plugins-config-volume\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:24:54.335418 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:54.335414    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbpf4\" (UniqueName: \"kubernetes.io/projected/2cff8fe0-aa14-41cb-8654-5c84d123f325-kube-api-access-dbpf4\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:24:54.554568 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:54.554536    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x"]
Sep 17 11:24:54.558218 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:54.558188    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-026f86-649c65f74-85x4x"]
Sep 17 11:24:54.690444 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:24:54.690405    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cff8fe0-aa14-41cb-8654-5c84d123f325" path="/var/lib/kubelet/pods/2cff8fe0-aa14-41cb-8654-5c84d123f325/volumes"
Sep 17 11:25:11.802432 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:11.802392    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-b8287f-29827395-6776x"]
Sep 17 11:25:11.804121 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:11.804099    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-b8287f-29827395-6776x"]
Sep 17 11:25:11.837925 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:11.837895    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr"]
Sep 17 11:25:11.838133 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:11.838104    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr" podUID="6c5afcad-b6e4-4e98-bc46-6fd32a12e34d" containerName="payload-pre-processing" containerID="cri-o://22baf2f30a86d6adbce0371369f7fc9015b8c82fd35118446eb590d935f64f7d" gracePeriod=30
Sep 17 11:25:12.090489 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:12.090462    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr"
Sep 17 11:25:12.183995 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:12.183965    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65rbc\" (UniqueName: \"kubernetes.io/projected/6c5afcad-b6e4-4e98-bc46-6fd32a12e34d-kube-api-access-65rbc\") pod \"6c5afcad-b6e4-4e98-bc46-6fd32a12e34d\" (UID: \"6c5afcad-b6e4-4e98-bc46-6fd32a12e34d\") "
Sep 17 11:25:12.183995 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:12.184004    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c5afcad-b6e4-4e98-bc46-6fd32a12e34d-plugins-config-volume\") pod \"6c5afcad-b6e4-4e98-bc46-6fd32a12e34d\" (UID: \"6c5afcad-b6e4-4e98-bc46-6fd32a12e34d\") "
Sep 17 11:25:12.184448 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:12.184421    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c5afcad-b6e4-4e98-bc46-6fd32a12e34d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6c5afcad-b6e4-4e98-bc46-6fd32a12e34d" (UID: "6c5afcad-b6e4-4e98-bc46-6fd32a12e34d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:25:12.186112 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:12.186084    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c5afcad-b6e4-4e98-bc46-6fd32a12e34d-kube-api-access-65rbc" (OuterVolumeSpecName: "kube-api-access-65rbc") pod "6c5afcad-b6e4-4e98-bc46-6fd32a12e34d" (UID: "6c5afcad-b6e4-4e98-bc46-6fd32a12e34d"). InnerVolumeSpecName "kube-api-access-65rbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:25:12.285650 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:12.285622    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65rbc\" (UniqueName: \"kubernetes.io/projected/6c5afcad-b6e4-4e98-bc46-6fd32a12e34d-kube-api-access-65rbc\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:25:12.285650 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:12.285648    2570 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c5afcad-b6e4-4e98-bc46-6fd32a12e34d-plugins-config-volume\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:25:12.324881 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:12.324804    2570 generic.go:356] "Generic (PLEG): container finished" podID="6c5afcad-b6e4-4e98-bc46-6fd32a12e34d" containerID="22baf2f30a86d6adbce0371369f7fc9015b8c82fd35118446eb590d935f64f7d" exitCode=0
Sep 17 11:25:12.324881 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:12.324845    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr"
Sep 17 11:25:12.325042 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:12.324892    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr" event={"ID":"6c5afcad-b6e4-4e98-bc46-6fd32a12e34d","Type":"ContainerDied","Data":"22baf2f30a86d6adbce0371369f7fc9015b8c82fd35118446eb590d935f64f7d"}
Sep 17 11:25:12.325042 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:12.324946    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr" event={"ID":"6c5afcad-b6e4-4e98-bc46-6fd32a12e34d","Type":"ContainerDied","Data":"3fef22335bb467798302016fc7aafc7afa09a3f5483599612c1c21fdf4212348"}
Sep 17 11:25:12.325042 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:12.324970    2570 scope.go:117] "RemoveContainer" containerID="22baf2f30a86d6adbce0371369f7fc9015b8c82fd35118446eb590d935f64f7d"
Sep 17 11:25:12.333711 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:12.333696    2570 scope.go:117] "RemoveContainer" containerID="22baf2f30a86d6adbce0371369f7fc9015b8c82fd35118446eb590d935f64f7d"
Sep 17 11:25:12.333992 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:25:12.333975    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22baf2f30a86d6adbce0371369f7fc9015b8c82fd35118446eb590d935f64f7d\": container with ID starting with 22baf2f30a86d6adbce0371369f7fc9015b8c82fd35118446eb590d935f64f7d not found: ID does not exist" containerID="22baf2f30a86d6adbce0371369f7fc9015b8c82fd35118446eb590d935f64f7d"
Sep 17 11:25:12.334044 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:12.334001    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22baf2f30a86d6adbce0371369f7fc9015b8c82fd35118446eb590d935f64f7d"} err="failed to get container status \"22baf2f30a86d6adbce0371369f7fc9015b8c82fd35118446eb590d935f64f7d\": rpc error: code = NotFound desc = could not find container \"22baf2f30a86d6adbce0371369f7fc9015b8c82fd35118446eb590d935f64f7d\": container with ID starting with 22baf2f30a86d6adbce0371369f7fc9015b8c82fd35118446eb590d935f64f7d not found: ID does not exist"
Sep 17 11:25:12.347743 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:12.347720    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr"]
Sep 17 11:25:12.353790 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:12.353768    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-b8287f-7b77d67cb6-qrzdr"]
Sep 17 11:25:12.691004 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:12.690927    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c5afcad-b6e4-4e98-bc46-6fd32a12e34d" path="/var/lib/kubelet/pods/6c5afcad-b6e4-4e98-bc46-6fd32a12e34d/volumes"
Sep 17 11:25:12.691205 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:12.691191    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8781fac0-82e6-43a0-9899-c9ccce87c438" path="/var/lib/kubelet/pods/8781fac0-82e6-43a0-9899-c9ccce87c438/volumes"
Sep 17 11:25:19.001054 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:19.001013    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"]
Sep 17 11:25:19.001633 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:19.001261    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc" podUID="1e25f05f-cc33-49b9-8453-61fb59bb92c1" containerName="istio-proxy" containerID="cri-o://7ae8dc941352fd6e8c325ce285cdf04775d291a4b2db9b62f8c256ea1452424a" gracePeriod=30
Sep 17 11:25:21.227772 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:21.227738    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-xdjh4"]
Sep 17 11:25:21.228187 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:21.227919    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-658cf9cdcf-xdjh4" podUID="09937e0c-545e-4e16-86f3-2f2e33bc1e11" containerName="manager" containerID="cri-o://726d8e231389dd373e9374b992d9149e4f53653f0eb167d43faec5d514fb75da" gracePeriod=30
Sep 17 11:25:21.375522 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:21.375475    2570 generic.go:356] "Generic (PLEG): container finished" podID="09937e0c-545e-4e16-86f3-2f2e33bc1e11" containerID="726d8e231389dd373e9374b992d9149e4f53653f0eb167d43faec5d514fb75da" exitCode=0
Sep 17 11:25:21.375674 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:21.375546    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-658cf9cdcf-xdjh4" event={"ID":"09937e0c-545e-4e16-86f3-2f2e33bc1e11","Type":"ContainerDied","Data":"726d8e231389dd373e9374b992d9149e4f53653f0eb167d43faec5d514fb75da"}
Sep 17 11:25:21.477276 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:21.477253    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-658cf9cdcf-xdjh4"
Sep 17 11:25:21.569753 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:21.569723    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09937e0c-545e-4e16-86f3-2f2e33bc1e11-webhook-cert\") pod \"09937e0c-545e-4e16-86f3-2f2e33bc1e11\" (UID: \"09937e0c-545e-4e16-86f3-2f2e33bc1e11\") "
Sep 17 11:25:21.569913 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:21.569819    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8nfv\" (UniqueName: \"kubernetes.io/projected/09937e0c-545e-4e16-86f3-2f2e33bc1e11-kube-api-access-w8nfv\") pod \"09937e0c-545e-4e16-86f3-2f2e33bc1e11\" (UID: \"09937e0c-545e-4e16-86f3-2f2e33bc1e11\") "
Sep 17 11:25:21.569913 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:21.569845    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09937e0c-545e-4e16-86f3-2f2e33bc1e11-metrics-certs\") pod \"09937e0c-545e-4e16-86f3-2f2e33bc1e11\" (UID: \"09937e0c-545e-4e16-86f3-2f2e33bc1e11\") "
Sep 17 11:25:21.571722 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:21.571691    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09937e0c-545e-4e16-86f3-2f2e33bc1e11-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "09937e0c-545e-4e16-86f3-2f2e33bc1e11" (UID: "09937e0c-545e-4e16-86f3-2f2e33bc1e11"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:25:21.571841 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:21.571795    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09937e0c-545e-4e16-86f3-2f2e33bc1e11-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "09937e0c-545e-4e16-86f3-2f2e33bc1e11" (UID: "09937e0c-545e-4e16-86f3-2f2e33bc1e11"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:25:21.571897 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:21.571877    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09937e0c-545e-4e16-86f3-2f2e33bc1e11-kube-api-access-w8nfv" (OuterVolumeSpecName: "kube-api-access-w8nfv") pod "09937e0c-545e-4e16-86f3-2f2e33bc1e11" (UID: "09937e0c-545e-4e16-86f3-2f2e33bc1e11"). InnerVolumeSpecName "kube-api-access-w8nfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:25:21.670890 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:21.670858    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8nfv\" (UniqueName: \"kubernetes.io/projected/09937e0c-545e-4e16-86f3-2f2e33bc1e11-kube-api-access-w8nfv\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:25:21.670890 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:21.670884    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09937e0c-545e-4e16-86f3-2f2e33bc1e11-metrics-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:25:21.670890 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:21.670893    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09937e0c-545e-4e16-86f3-2f2e33bc1e11-webhook-cert\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:25:22.382995 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:22.382962    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-658cf9cdcf-xdjh4" event={"ID":"09937e0c-545e-4e16-86f3-2f2e33bc1e11","Type":"ContainerDied","Data":"442fcad61c6a1fa722f4a2cadcb263f91a54483bf631e27e41a1bdc63208ae1d"}
Sep 17 11:25:22.383412 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:22.383021    2570 scope.go:117] "RemoveContainer" containerID="726d8e231389dd373e9374b992d9149e4f53653f0eb167d43faec5d514fb75da"
Sep 17 11:25:22.383412 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:22.382972    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-658cf9cdcf-xdjh4"
Sep 17 11:25:22.444168 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:22.444145    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-xdjh4"]
Sep 17 11:25:22.445844 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:22.445824    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-xdjh4"]
Sep 17 11:25:22.691345 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:22.691272    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09937e0c-545e-4e16-86f3-2f2e33bc1e11" path="/var/lib/kubelet/pods/09937e0c-545e-4e16-86f3-2f2e33bc1e11/volumes"
Sep 17 11:25:22.918062 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:22.918031    2570 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 11:25:22.918214 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:22.918088    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc" podUID="1e25f05f-cc33-49b9-8453-61fb59bb92c1" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 11:25:24.249246 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.249220    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:25:24.393033 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.392944    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56shb\" (UniqueName: \"kubernetes.io/projected/1e25f05f-cc33-49b9-8453-61fb59bb92c1-kube-api-access-56shb\") pod \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") "
Sep 17 11:25:24.393174 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.393049    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-podinfo\") pod \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") "
Sep 17 11:25:24.393174 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.393077    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-data\") pod \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") "
Sep 17 11:25:24.393174 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.393099    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-token\") pod \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") "
Sep 17 11:25:24.393174 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.393116    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-credential-socket\") pod \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") "
Sep 17 11:25:24.393174 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.393145    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-workload-socket\") pod \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") "
Sep 17 11:25:24.393450 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.393178    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-envoy\") pod \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") "
Sep 17 11:25:24.393450 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.393212    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istiod-ca-cert\") pod \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") "
Sep 17 11:25:24.393450 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.393243    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-workload-certs\") pod \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\" (UID: \"1e25f05f-cc33-49b9-8453-61fb59bb92c1\") "
Sep 17 11:25:24.393450 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.393334    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-data" (OuterVolumeSpecName: "istio-data") pod "1e25f05f-cc33-49b9-8453-61fb59bb92c1" (UID: "1e25f05f-cc33-49b9-8453-61fb59bb92c1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:25:24.393692 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.393547    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1e25f05f-cc33-49b9-8453-61fb59bb92c1" (UID: "1e25f05f-cc33-49b9-8453-61fb59bb92c1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:25:24.393692 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.393564    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1e25f05f-cc33-49b9-8453-61fb59bb92c1" (UID: "1e25f05f-cc33-49b9-8453-61fb59bb92c1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:25:24.393692 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.393642    2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-data\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:25:24.393692 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.393662    2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-workload-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:25:24.394261 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.393971    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1e25f05f-cc33-49b9-8453-61fb59bb92c1" (UID: "1e25f05f-cc33-49b9-8453-61fb59bb92c1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 11:25:24.394456 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.394425    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1e25f05f-cc33-49b9-8453-61fb59bb92c1" (UID: "1e25f05f-cc33-49b9-8453-61fb59bb92c1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:25:24.395502 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.395450    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e25f05f-cc33-49b9-8453-61fb59bb92c1-kube-api-access-56shb" (OuterVolumeSpecName: "kube-api-access-56shb") pod "1e25f05f-cc33-49b9-8453-61fb59bb92c1" (UID: "1e25f05f-cc33-49b9-8453-61fb59bb92c1"). InnerVolumeSpecName "kube-api-access-56shb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:25:24.395823 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.395781    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1e25f05f-cc33-49b9-8453-61fb59bb92c1" (UID: "1e25f05f-cc33-49b9-8453-61fb59bb92c1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:25:24.395945 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.395869    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-token" (OuterVolumeSpecName: "istio-token") pod "1e25f05f-cc33-49b9-8453-61fb59bb92c1" (UID: "1e25f05f-cc33-49b9-8453-61fb59bb92c1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:25:24.395945 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.395881    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1e25f05f-cc33-49b9-8453-61fb59bb92c1" (UID: "1e25f05f-cc33-49b9-8453-61fb59bb92c1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 11:25:24.397751 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.397721    2570 generic.go:356] "Generic (PLEG): container finished" podID="1e25f05f-cc33-49b9-8453-61fb59bb92c1" containerID="7ae8dc941352fd6e8c325ce285cdf04775d291a4b2db9b62f8c256ea1452424a" exitCode=0
Sep 17 11:25:24.397842 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.397802    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc" event={"ID":"1e25f05f-cc33-49b9-8453-61fb59bb92c1","Type":"ContainerDied","Data":"7ae8dc941352fd6e8c325ce285cdf04775d291a4b2db9b62f8c256ea1452424a"}
Sep 17 11:25:24.397842 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.397812    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"
Sep 17 11:25:24.397930 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.397858    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc" event={"ID":"1e25f05f-cc33-49b9-8453-61fb59bb92c1","Type":"ContainerDied","Data":"92f870625570367ab6562f296fb0c12cb7550633fb44f952b5700bd1db0b1827"}
Sep 17 11:25:24.397930 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.397892    2570 scope.go:117] "RemoveContainer" containerID="7ae8dc941352fd6e8c325ce285cdf04775d291a4b2db9b62f8c256ea1452424a"
Sep 17 11:25:24.418960 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.418935    2570 scope.go:117] "RemoveContainer" containerID="10baa356715620f5e6cc94700d3e27b0ac62e4cca5c8f8f047462bf4d6d661a5"
Sep 17 11:25:24.429897 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.429869    2570 scope.go:117] "RemoveContainer" containerID="7ae8dc941352fd6e8c325ce285cdf04775d291a4b2db9b62f8c256ea1452424a"
Sep 17 11:25:24.430236 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:25:24.430202    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ae8dc941352fd6e8c325ce285cdf04775d291a4b2db9b62f8c256ea1452424a\": container with ID starting with 7ae8dc941352fd6e8c325ce285cdf04775d291a4b2db9b62f8c256ea1452424a not found: ID does not exist" containerID="7ae8dc941352fd6e8c325ce285cdf04775d291a4b2db9b62f8c256ea1452424a"
Sep 17 11:25:24.430331 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.430241    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ae8dc941352fd6e8c325ce285cdf04775d291a4b2db9b62f8c256ea1452424a"} err="failed to get container status \"7ae8dc941352fd6e8c325ce285cdf04775d291a4b2db9b62f8c256ea1452424a\": rpc error: code = NotFound desc = could not find container \"7ae8dc941352fd6e8c325ce285cdf04775d291a4b2db9b62f8c256ea1452424a\": container with ID starting with 7ae8dc941352fd6e8c325ce285cdf04775d291a4b2db9b62f8c256ea1452424a not found: ID does not exist"
Sep 17 11:25:24.430331 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.430264    2570 scope.go:117] "RemoveContainer" containerID="10baa356715620f5e6cc94700d3e27b0ac62e4cca5c8f8f047462bf4d6d661a5"
Sep 17 11:25:24.430630 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:25:24.430600    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10baa356715620f5e6cc94700d3e27b0ac62e4cca5c8f8f047462bf4d6d661a5\": container with ID starting with 10baa356715620f5e6cc94700d3e27b0ac62e4cca5c8f8f047462bf4d6d661a5 not found: ID does not exist" containerID="10baa356715620f5e6cc94700d3e27b0ac62e4cca5c8f8f047462bf4d6d661a5"
Sep 17 11:25:24.430726 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.430638    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10baa356715620f5e6cc94700d3e27b0ac62e4cca5c8f8f047462bf4d6d661a5"} err="failed to get container status \"10baa356715620f5e6cc94700d3e27b0ac62e4cca5c8f8f047462bf4d6d661a5\": rpc error: code = NotFound desc = could not find container \"10baa356715620f5e6cc94700d3e27b0ac62e4cca5c8f8f047462bf4d6d661a5\": container with ID starting with 10baa356715620f5e6cc94700d3e27b0ac62e4cca5c8f8f047462bf4d6d661a5 not found: ID does not exist"
Sep 17 11:25:24.433336 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.433312    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"]
Sep 17 11:25:24.435988 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.435966    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b8287f-openshift-default-65f56d78f8-ck9tc"]
Sep 17 11:25:24.494550 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.494495    2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-envoy\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:25:24.494550 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.494542    2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istiod-ca-cert\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:25:24.494550 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.494551    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56shb\" (UniqueName: \"kubernetes.io/projected/1e25f05f-cc33-49b9-8453-61fb59bb92c1-kube-api-access-56shb\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:25:24.494550 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.494560    2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-podinfo\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:25:24.494550 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.494569    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e25f05f-cc33-49b9-8453-61fb59bb92c1-istio-token\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:25:24.494903 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.494577    2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-credential-socket\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:25:24.494903 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.494586    2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e25f05f-cc33-49b9-8453-61fb59bb92c1-workload-socket\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:25:24.692905 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:24.692822    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e25f05f-cc33-49b9-8453-61fb59bb92c1" path="/var/lib/kubelet/pods/1e25f05f-cc33-49b9-8453-61fb59bb92c1/volumes"
Sep 17 11:25:30.922498 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:25:30.922464    2570 scope.go:117] "RemoveContainer" containerID="e0abbf9772e62187e8f867e97332d101156455d01cdbd5c04b385bdf0aa0922d"
Sep 17 11:26:23.318859 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.318771    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-k82qw"]
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319103    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acd3f492-353a-4b32-914f-f35e33a17b26" containerName="istio-proxy"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319114    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="acd3f492-353a-4b32-914f-f35e33a17b26" containerName="istio-proxy"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319124    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e25f05f-cc33-49b9-8453-61fb59bb92c1" containerName="istio-proxy"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319129    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e25f05f-cc33-49b9-8453-61fb59bb92c1" containerName="istio-proxy"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319142    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cff8fe0-aa14-41cb-8654-5c84d123f325" containerName="payload-pre-processing"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319152    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cff8fe0-aa14-41cb-8654-5c84d123f325" containerName="payload-pre-processing"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319166    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c5afcad-b6e4-4e98-bc46-6fd32a12e34d" containerName="payload-pre-processing"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319172    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c5afcad-b6e4-4e98-bc46-6fd32a12e34d" containerName="payload-pre-processing"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319178    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e25f05f-cc33-49b9-8453-61fb59bb92c1" containerName="istio-proxy"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319183    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e25f05f-cc33-49b9-8453-61fb59bb92c1" containerName="istio-proxy"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319190    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75a1e3a3-883d-498b-9f04-a91ee315334d" containerName="payload-pre-processing"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319195    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="75a1e3a3-883d-498b-9f04-a91ee315334d" containerName="payload-pre-processing"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319200    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48a6c3aa-880c-4bd8-a313-7bf743f1fda7" containerName="payload-pre-processing"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319205    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="48a6c3aa-880c-4bd8-a313-7bf743f1fda7" containerName="payload-pre-processing"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319211    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acd3f492-353a-4b32-914f-f35e33a17b26" containerName="istio-proxy"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319216    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="acd3f492-353a-4b32-914f-f35e33a17b26" containerName="istio-proxy"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319226    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="625516fc-92e1-4d8e-adaa-f8a502096204" containerName="payload-pre-processing"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319231    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="625516fc-92e1-4d8e-adaa-f8a502096204" containerName="payload-pre-processing"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319241    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e81370d-9111-483a-a234-270f80ea5dbf" containerName="payload-processing"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319246    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e81370d-9111-483a-a234-270f80ea5dbf" containerName="payload-processing"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319252    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09937e0c-545e-4e16-86f3-2f2e33bc1e11" containerName="manager"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319256    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="09937e0c-545e-4e16-86f3-2f2e33bc1e11" containerName="manager"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319305    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="75a1e3a3-883d-498b-9f04-a91ee315334d" containerName="payload-pre-processing"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319313    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="09937e0c-545e-4e16-86f3-2f2e33bc1e11" containerName="manager"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319321    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d494458-0355-4bbf-964b-83587335abe4" containerName="istio-proxy"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319327    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="625516fc-92e1-4d8e-adaa-f8a502096204" containerName="payload-pre-processing"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319333    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cff8fe0-aa14-41cb-8654-5c84d123f325" containerName="payload-pre-processing"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319339    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c5afcad-b6e4-4e98-bc46-6fd32a12e34d" containerName="payload-pre-processing"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319344    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e25f05f-cc33-49b9-8453-61fb59bb92c1" containerName="istio-proxy"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319350    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="acd3f492-353a-4b32-914f-f35e33a17b26" containerName="istio-proxy"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319354    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="acd3f492-353a-4b32-914f-f35e33a17b26" containerName="istio-proxy"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319360    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e81370d-9111-483a-a234-270f80ea5dbf" containerName="payload-processing"
Sep 17 11:26:23.321152 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.319366    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="48a6c3aa-880c-4bd8-a313-7bf743f1fda7" containerName="payload-pre-processing"
Sep 17 11:26:23.323083 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.321942    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-658cf9cdcf-k82qw"
Sep 17 11:26:23.326344 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.326319    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 11:26:23.326344 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.326319    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 11:26:23.326654 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.326638    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tj882\""
Sep 17 11:26:23.326728 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.326706    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 11:26:23.336268 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.336245    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-k82qw"]
Sep 17 11:26:23.481798 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.481767    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63f85812-f3be-4dbc-aec4-92611b31b153-metrics-certs\") pod \"maas-controller-658cf9cdcf-k82qw\" (UID: \"63f85812-f3be-4dbc-aec4-92611b31b153\") " pod="opendatahub/maas-controller-658cf9cdcf-k82qw"
Sep 17 11:26:23.481958 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.481814    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63f85812-f3be-4dbc-aec4-92611b31b153-webhook-cert\") pod \"maas-controller-658cf9cdcf-k82qw\" (UID: \"63f85812-f3be-4dbc-aec4-92611b31b153\") " pod="opendatahub/maas-controller-658cf9cdcf-k82qw"
Sep 17 11:26:23.481958 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.481883    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mbjw\" (UniqueName: \"kubernetes.io/projected/63f85812-f3be-4dbc-aec4-92611b31b153-kube-api-access-6mbjw\") pod \"maas-controller-658cf9cdcf-k82qw\" (UID: \"63f85812-f3be-4dbc-aec4-92611b31b153\") " pod="opendatahub/maas-controller-658cf9cdcf-k82qw"
Sep 17 11:26:23.583198 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.583135    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mbjw\" (UniqueName: \"kubernetes.io/projected/63f85812-f3be-4dbc-aec4-92611b31b153-kube-api-access-6mbjw\") pod \"maas-controller-658cf9cdcf-k82qw\" (UID: \"63f85812-f3be-4dbc-aec4-92611b31b153\") " pod="opendatahub/maas-controller-658cf9cdcf-k82qw"
Sep 17 11:26:23.583198 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.583178    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63f85812-f3be-4dbc-aec4-92611b31b153-metrics-certs\") pod \"maas-controller-658cf9cdcf-k82qw\" (UID: \"63f85812-f3be-4dbc-aec4-92611b31b153\") " pod="opendatahub/maas-controller-658cf9cdcf-k82qw"
Sep 17 11:26:23.583353 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.583230    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63f85812-f3be-4dbc-aec4-92611b31b153-webhook-cert\") pod \"maas-controller-658cf9cdcf-k82qw\" (UID: \"63f85812-f3be-4dbc-aec4-92611b31b153\") " pod="opendatahub/maas-controller-658cf9cdcf-k82qw"
Sep 17 11:26:23.585627 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.585601    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63f85812-f3be-4dbc-aec4-92611b31b153-webhook-cert\") pod \"maas-controller-658cf9cdcf-k82qw\" (UID: \"63f85812-f3be-4dbc-aec4-92611b31b153\") " pod="opendatahub/maas-controller-658cf9cdcf-k82qw"
Sep 17 11:26:23.585732 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.585627    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63f85812-f3be-4dbc-aec4-92611b31b153-metrics-certs\") pod \"maas-controller-658cf9cdcf-k82qw\" (UID: \"63f85812-f3be-4dbc-aec4-92611b31b153\") " pod="opendatahub/maas-controller-658cf9cdcf-k82qw"
Sep 17 11:26:23.592272 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.592249    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mbjw\" (UniqueName: \"kubernetes.io/projected/63f85812-f3be-4dbc-aec4-92611b31b153-kube-api-access-6mbjw\") pod \"maas-controller-658cf9cdcf-k82qw\" (UID: \"63f85812-f3be-4dbc-aec4-92611b31b153\") " pod="opendatahub/maas-controller-658cf9cdcf-k82qw"
Sep 17 11:26:23.632466 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.632447    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-658cf9cdcf-k82qw"
Sep 17 11:26:23.902572 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.902543    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-k82qw"]
Sep 17 11:26:23.904013 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:26:23.903982    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f85812_f3be_4dbc_aec4_92611b31b153.slice/crio-5fb27c4486627a69594f512b5eaafb70b1950cb0a19c470ce24399354f17bffa WatchSource:0}: Error finding container 5fb27c4486627a69594f512b5eaafb70b1950cb0a19c470ce24399354f17bffa: Status 404 returned error can't find the container with id 5fb27c4486627a69594f512b5eaafb70b1950cb0a19c470ce24399354f17bffa
Sep 17 11:26:23.905244 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:23.905223    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 11:26:24.690605 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:24.690531    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-658cf9cdcf-k82qw"
Sep 17 11:26:24.690605 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:24.690578    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-658cf9cdcf-k82qw" event={"ID":"63f85812-f3be-4dbc-aec4-92611b31b153","Type":"ContainerStarted","Data":"cc2c26f7764f48cfafa6407e23c74ad210fc7aa723b3a738ad63a53948c329db"}
Sep 17 11:26:24.690605 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:24.690599    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-658cf9cdcf-k82qw" event={"ID":"63f85812-f3be-4dbc-aec4-92611b31b153","Type":"ContainerStarted","Data":"5fb27c4486627a69594f512b5eaafb70b1950cb0a19c470ce24399354f17bffa"}
Sep 17 11:26:24.705343 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:24.705294    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-658cf9cdcf-k82qw" podStartSLOduration=1.288934969 podStartE2EDuration="1.705281794s" totalImagesPullingTime="416.346825ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:26:24.704915597 +0000 UTC m=+1974.500250031" watchObservedRunningTime="2026-09-17 11:26:24.705281794 +0000 UTC m=+1974.500616232"
Sep 17 11:26:35.694644 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:35.694615    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-658cf9cdcf-k82qw"
Sep 17 11:26:45.038665 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.038633    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-k82qw"]
Sep 17 11:26:45.039185 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.038842    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-658cf9cdcf-k82qw" podUID="63f85812-f3be-4dbc-aec4-92611b31b153" containerName="manager" containerID="cri-o://cc2c26f7764f48cfafa6407e23c74ad210fc7aa723b3a738ad63a53948c329db" gracePeriod=30
Sep 17 11:26:45.279292 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.279270    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-658cf9cdcf-k82qw"
Sep 17 11:26:45.357966 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.357882    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mbjw\" (UniqueName: \"kubernetes.io/projected/63f85812-f3be-4dbc-aec4-92611b31b153-kube-api-access-6mbjw\") pod \"63f85812-f3be-4dbc-aec4-92611b31b153\" (UID: \"63f85812-f3be-4dbc-aec4-92611b31b153\") "
Sep 17 11:26:45.357966 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.357941    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63f85812-f3be-4dbc-aec4-92611b31b153-metrics-certs\") pod \"63f85812-f3be-4dbc-aec4-92611b31b153\" (UID: \"63f85812-f3be-4dbc-aec4-92611b31b153\") "
Sep 17 11:26:45.358181 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.357973    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63f85812-f3be-4dbc-aec4-92611b31b153-webhook-cert\") pod \"63f85812-f3be-4dbc-aec4-92611b31b153\" (UID: \"63f85812-f3be-4dbc-aec4-92611b31b153\") "
Sep 17 11:26:45.360299 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.360268    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63f85812-f3be-4dbc-aec4-92611b31b153-kube-api-access-6mbjw" (OuterVolumeSpecName: "kube-api-access-6mbjw") pod "63f85812-f3be-4dbc-aec4-92611b31b153" (UID: "63f85812-f3be-4dbc-aec4-92611b31b153"). InnerVolumeSpecName "kube-api-access-6mbjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:26:45.360560 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.360520    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63f85812-f3be-4dbc-aec4-92611b31b153-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "63f85812-f3be-4dbc-aec4-92611b31b153" (UID: "63f85812-f3be-4dbc-aec4-92611b31b153"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:26:45.360790 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.360758    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63f85812-f3be-4dbc-aec4-92611b31b153-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "63f85812-f3be-4dbc-aec4-92611b31b153" (UID: "63f85812-f3be-4dbc-aec4-92611b31b153"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 11:26:45.459328 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.459302    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/63f85812-f3be-4dbc-aec4-92611b31b153-metrics-certs\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:26:45.459328 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.459325    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63f85812-f3be-4dbc-aec4-92611b31b153-webhook-cert\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:26:45.459476 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.459334    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mbjw\" (UniqueName: \"kubernetes.io/projected/63f85812-f3be-4dbc-aec4-92611b31b153-kube-api-access-6mbjw\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:26:45.784678 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.784639    2570 generic.go:356] "Generic (PLEG): container finished" podID="63f85812-f3be-4dbc-aec4-92611b31b153" containerID="cc2c26f7764f48cfafa6407e23c74ad210fc7aa723b3a738ad63a53948c329db" exitCode=0
Sep 17 11:26:45.784900 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.784697    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-658cf9cdcf-k82qw"
Sep 17 11:26:45.784900 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.784735    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-658cf9cdcf-k82qw" event={"ID":"63f85812-f3be-4dbc-aec4-92611b31b153","Type":"ContainerDied","Data":"cc2c26f7764f48cfafa6407e23c74ad210fc7aa723b3a738ad63a53948c329db"}
Sep 17 11:26:45.784900 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.784800    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-658cf9cdcf-k82qw" event={"ID":"63f85812-f3be-4dbc-aec4-92611b31b153","Type":"ContainerDied","Data":"5fb27c4486627a69594f512b5eaafb70b1950cb0a19c470ce24399354f17bffa"}
Sep 17 11:26:45.784900 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.784830    2570 scope.go:117] "RemoveContainer" containerID="cc2c26f7764f48cfafa6407e23c74ad210fc7aa723b3a738ad63a53948c329db"
Sep 17 11:26:45.794695 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.794674    2570 scope.go:117] "RemoveContainer" containerID="cc2c26f7764f48cfafa6407e23c74ad210fc7aa723b3a738ad63a53948c329db"
Sep 17 11:26:45.795026 ip-10-0-138-123 kubenswrapper[2570]: E0917 11:26:45.795001    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc2c26f7764f48cfafa6407e23c74ad210fc7aa723b3a738ad63a53948c329db\": container with ID starting with cc2c26f7764f48cfafa6407e23c74ad210fc7aa723b3a738ad63a53948c329db not found: ID does not exist" containerID="cc2c26f7764f48cfafa6407e23c74ad210fc7aa723b3a738ad63a53948c329db"
Sep 17 11:26:45.795119 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.795038    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc2c26f7764f48cfafa6407e23c74ad210fc7aa723b3a738ad63a53948c329db"} err="failed to get container status \"cc2c26f7764f48cfafa6407e23c74ad210fc7aa723b3a738ad63a53948c329db\": rpc error: code = NotFound desc = could not find container \"cc2c26f7764f48cfafa6407e23c74ad210fc7aa723b3a738ad63a53948c329db\": container with ID starting with cc2c26f7764f48cfafa6407e23c74ad210fc7aa723b3a738ad63a53948c329db not found: ID does not exist"
Sep 17 11:26:45.812166 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.812143    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-k82qw"]
Sep 17 11:26:45.816759 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:45.816738    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-k82qw"]
Sep 17 11:26:46.633121 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.633088    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-xklxc"]
Sep 17 11:26:46.633479 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.633465    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63f85812-f3be-4dbc-aec4-92611b31b153" containerName="manager"
Sep 17 11:26:46.633541 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.633484    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="63f85812-f3be-4dbc-aec4-92611b31b153" containerName="manager"
Sep 17 11:26:46.633588 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.633551    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="63f85812-f3be-4dbc-aec4-92611b31b153" containerName="manager"
Sep 17 11:26:46.633588 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.633565    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e25f05f-cc33-49b9-8453-61fb59bb92c1" containerName="istio-proxy"
Sep 17 11:26:46.637737 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.637717    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-658cf9cdcf-xklxc"
Sep 17 11:26:46.642177 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.642153    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tj882\""
Sep 17 11:26:46.642273 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.642179    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 11:26:46.642432 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.642419    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 11:26:46.642547 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.642527    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 11:26:46.654765 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.649179    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-xklxc"]
Sep 17 11:26:46.669301 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.669277    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4d673ba-2f47-4127-8e30-30977a25b070-metrics-certs\") pod \"maas-controller-658cf9cdcf-xklxc\" (UID: \"b4d673ba-2f47-4127-8e30-30977a25b070\") " pod="opendatahub/maas-controller-658cf9cdcf-xklxc"
Sep 17 11:26:46.669412 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.669339    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4d673ba-2f47-4127-8e30-30977a25b070-webhook-cert\") pod \"maas-controller-658cf9cdcf-xklxc\" (UID: \"b4d673ba-2f47-4127-8e30-30977a25b070\") " pod="opendatahub/maas-controller-658cf9cdcf-xklxc"
Sep 17 11:26:46.669412 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.669366    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw22b\" (UniqueName: \"kubernetes.io/projected/b4d673ba-2f47-4127-8e30-30977a25b070-kube-api-access-dw22b\") pod \"maas-controller-658cf9cdcf-xklxc\" (UID: \"b4d673ba-2f47-4127-8e30-30977a25b070\") " pod="opendatahub/maas-controller-658cf9cdcf-xklxc"
Sep 17 11:26:46.689811 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.689786    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63f85812-f3be-4dbc-aec4-92611b31b153" path="/var/lib/kubelet/pods/63f85812-f3be-4dbc-aec4-92611b31b153/volumes"
Sep 17 11:26:46.770059 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.770033    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4d673ba-2f47-4127-8e30-30977a25b070-webhook-cert\") pod \"maas-controller-658cf9cdcf-xklxc\" (UID: \"b4d673ba-2f47-4127-8e30-30977a25b070\") " pod="opendatahub/maas-controller-658cf9cdcf-xklxc"
Sep 17 11:26:46.770175 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.770075    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw22b\" (UniqueName: \"kubernetes.io/projected/b4d673ba-2f47-4127-8e30-30977a25b070-kube-api-access-dw22b\") pod \"maas-controller-658cf9cdcf-xklxc\" (UID: \"b4d673ba-2f47-4127-8e30-30977a25b070\") " pod="opendatahub/maas-controller-658cf9cdcf-xklxc"
Sep 17 11:26:46.770175 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.770158    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4d673ba-2f47-4127-8e30-30977a25b070-metrics-certs\") pod \"maas-controller-658cf9cdcf-xklxc\" (UID: \"b4d673ba-2f47-4127-8e30-30977a25b070\") " pod="opendatahub/maas-controller-658cf9cdcf-xklxc"
Sep 17 11:26:46.772654 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.772628    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4d673ba-2f47-4127-8e30-30977a25b070-webhook-cert\") pod \"maas-controller-658cf9cdcf-xklxc\" (UID: \"b4d673ba-2f47-4127-8e30-30977a25b070\") " pod="opendatahub/maas-controller-658cf9cdcf-xklxc"
Sep 17 11:26:46.772740 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.772628    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4d673ba-2f47-4127-8e30-30977a25b070-metrics-certs\") pod \"maas-controller-658cf9cdcf-xklxc\" (UID: \"b4d673ba-2f47-4127-8e30-30977a25b070\") " pod="opendatahub/maas-controller-658cf9cdcf-xklxc"
Sep 17 11:26:46.780904 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.780886    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw22b\" (UniqueName: \"kubernetes.io/projected/b4d673ba-2f47-4127-8e30-30977a25b070-kube-api-access-dw22b\") pod \"maas-controller-658cf9cdcf-xklxc\" (UID: \"b4d673ba-2f47-4127-8e30-30977a25b070\") " pod="opendatahub/maas-controller-658cf9cdcf-xklxc"
Sep 17 11:26:46.949004 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:46.948938    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-658cf9cdcf-xklxc"
Sep 17 11:26:47.227320 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:47.227295    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-658cf9cdcf-xklxc"]
Sep 17 11:26:47.229775 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:26:47.229748    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d673ba_2f47_4127_8e30_30977a25b070.slice/crio-6405c2085243d7151bcc1c57cd7426fbe7cc5ab3f8cbc4af9bedb44662248d9c WatchSource:0}: Error finding container 6405c2085243d7151bcc1c57cd7426fbe7cc5ab3f8cbc4af9bedb44662248d9c: Status 404 returned error can't find the container with id 6405c2085243d7151bcc1c57cd7426fbe7cc5ab3f8cbc4af9bedb44662248d9c
Sep 17 11:26:47.797080 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:47.797042    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-658cf9cdcf-xklxc" event={"ID":"b4d673ba-2f47-4127-8e30-30977a25b070","Type":"ContainerStarted","Data":"b93dadbfc29d652e84f55ee25fd98cc628f968f10fc1efcda374d0a7e826e4d7"}
Sep 17 11:26:47.797479 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:47.797101    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-658cf9cdcf-xklxc" event={"ID":"b4d673ba-2f47-4127-8e30-30977a25b070","Type":"ContainerStarted","Data":"6405c2085243d7151bcc1c57cd7426fbe7cc5ab3f8cbc4af9bedb44662248d9c"}
Sep 17 11:26:47.797479 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:47.797139    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-658cf9cdcf-xklxc"
Sep 17 11:26:47.822728 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:47.822677    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-658cf9cdcf-xklxc" podStartSLOduration=1.3407190820000001 podStartE2EDuration="1.822662559s" totalImagesPullingTime="481.943477ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:26:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:26:47.820803951 +0000 UTC m=+1997.616138390" watchObservedRunningTime="2026-09-17 11:26:47.822662559 +0000 UTC m=+1997.617996998"
Sep 17 11:26:58.803653 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:26:58.803625    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-658cf9cdcf-xklxc"
Sep 17 11:28:03.911449 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:03.911345    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8"]
Sep 17 11:28:03.912084 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:03.911617    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8" podUID="aafdab76-04d3-4d9f-83b0-f7b8e42c102e" containerName="manager" containerID="cri-o://d00edf6e7eaf11cc1b08374941c4e83a77c1f14161cd4bc214dc4abadcfbdbf3" gracePeriod=10
Sep 17 11:28:04.150747 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:04.150712    2570 generic.go:356] "Generic (PLEG): container finished" podID="aafdab76-04d3-4d9f-83b0-f7b8e42c102e" containerID="d00edf6e7eaf11cc1b08374941c4e83a77c1f14161cd4bc214dc4abadcfbdbf3" exitCode=0
Sep 17 11:28:04.150887 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:04.150788    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8" event={"ID":"aafdab76-04d3-4d9f-83b0-f7b8e42c102e","Type":"ContainerDied","Data":"d00edf6e7eaf11cc1b08374941c4e83a77c1f14161cd4bc214dc4abadcfbdbf3"}
Sep 17 11:28:04.150887 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:04.150871    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8" event={"ID":"aafdab76-04d3-4d9f-83b0-f7b8e42c102e","Type":"ContainerDied","Data":"e6c818b8ead72154dd7e4ca0090d71a5ba00710f31f6f4da00dad8c810e443bd"}
Sep 17 11:28:04.150970 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:04.150890    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6c818b8ead72154dd7e4ca0090d71a5ba00710f31f6f4da00dad8c810e443bd"
Sep 17 11:28:04.157559 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:04.157540    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8"
Sep 17 11:28:04.202760 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:04.202696    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr76p\" (UniqueName: \"kubernetes.io/projected/aafdab76-04d3-4d9f-83b0-f7b8e42c102e-kube-api-access-lr76p\") pod \"aafdab76-04d3-4d9f-83b0-f7b8e42c102e\" (UID: \"aafdab76-04d3-4d9f-83b0-f7b8e42c102e\") "
Sep 17 11:28:04.202760 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:04.202738    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aafdab76-04d3-4d9f-83b0-f7b8e42c102e-extensions-socket-volume\") pod \"aafdab76-04d3-4d9f-83b0-f7b8e42c102e\" (UID: \"aafdab76-04d3-4d9f-83b0-f7b8e42c102e\") "
Sep 17 11:28:04.203144 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:04.203117    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aafdab76-04d3-4d9f-83b0-f7b8e42c102e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "aafdab76-04d3-4d9f-83b0-f7b8e42c102e" (UID: "aafdab76-04d3-4d9f-83b0-f7b8e42c102e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 11:28:04.204867 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:04.204843    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aafdab76-04d3-4d9f-83b0-f7b8e42c102e-kube-api-access-lr76p" (OuterVolumeSpecName: "kube-api-access-lr76p") pod "aafdab76-04d3-4d9f-83b0-f7b8e42c102e" (UID: "aafdab76-04d3-4d9f-83b0-f7b8e42c102e"). InnerVolumeSpecName "kube-api-access-lr76p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 11:28:04.304028 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:04.303999    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr76p\" (UniqueName: \"kubernetes.io/projected/aafdab76-04d3-4d9f-83b0-f7b8e42c102e-kube-api-access-lr76p\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:28:04.304028 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:04.304025    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aafdab76-04d3-4d9f-83b0-f7b8e42c102e-extensions-socket-volume\") on node \"ip-10-0-138-123.ec2.internal\" DevicePath \"\""
Sep 17 11:28:05.155751 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:05.155722    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8"
Sep 17 11:28:05.176252 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:05.176220    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8"]
Sep 17 11:28:05.180010 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:05.179985    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-nckm8"]
Sep 17 11:28:06.690556 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:06.690498    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aafdab76-04d3-4d9f-83b0-f7b8e42c102e" path="/var/lib/kubelet/pods/aafdab76-04d3-4d9f-83b0-f7b8e42c102e/volumes"
Sep 17 11:28:30.801524 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:30.801484    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 11:28:30.809538 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:30.809501    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 11:28:30.982524 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:28:30.982483    2570 scope.go:117] "RemoveContainer" containerID="d00edf6e7eaf11cc1b08374941c4e83a77c1f14161cd4bc214dc4abadcfbdbf3"
Sep 17 11:29:04.673501 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:04.673462    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6rhrv"]
Sep 17 11:29:04.673973 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:04.673833    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aafdab76-04d3-4d9f-83b0-f7b8e42c102e" containerName="manager"
Sep 17 11:29:04.673973 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:04.673844    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="aafdab76-04d3-4d9f-83b0-f7b8e42c102e" containerName="manager"
Sep 17 11:29:04.673973 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:04.673898    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="aafdab76-04d3-4d9f-83b0-f7b8e42c102e" containerName="manager"
Sep 17 11:29:04.676702 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:04.676686    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6rhrv"
Sep 17 11:29:04.679382 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:04.679355    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-m8gtb\""
Sep 17 11:29:04.690460 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:04.690439    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6rhrv"]
Sep 17 11:29:04.813584 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:04.813551    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5gxb\" (UniqueName: \"kubernetes.io/projected/0ec4c533-75f7-4e13-8569-0e01527519b7-kube-api-access-w5gxb\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6rhrv\" (UID: \"0ec4c533-75f7-4e13-8569-0e01527519b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6rhrv"
Sep 17 11:29:04.813735 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:04.813601    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ec4c533-75f7-4e13-8569-0e01527519b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6rhrv\" (UID: \"0ec4c533-75f7-4e13-8569-0e01527519b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6rhrv"
Sep 17 11:29:04.914865 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:04.914823    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ec4c533-75f7-4e13-8569-0e01527519b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6rhrv\" (UID: \"0ec4c533-75f7-4e13-8569-0e01527519b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6rhrv"
Sep 17 11:29:04.915026 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:04.914987    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5gxb\" (UniqueName: \"kubernetes.io/projected/0ec4c533-75f7-4e13-8569-0e01527519b7-kube-api-access-w5gxb\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6rhrv\" (UID: \"0ec4c533-75f7-4e13-8569-0e01527519b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6rhrv"
Sep 17 11:29:04.915174 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:04.915157    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ec4c533-75f7-4e13-8569-0e01527519b7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6rhrv\" (UID: \"0ec4c533-75f7-4e13-8569-0e01527519b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6rhrv"
Sep 17 11:29:04.924246 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:04.924182    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5gxb\" (UniqueName: \"kubernetes.io/projected/0ec4c533-75f7-4e13-8569-0e01527519b7-kube-api-access-w5gxb\") pod \"kuadrant-operator-controller-manager-5769f99d9f-6rhrv\" (UID: \"0ec4c533-75f7-4e13-8569-0e01527519b7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6rhrv"
Sep 17 11:29:04.987795 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:04.987761    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6rhrv"
Sep 17 11:29:05.273369 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:05.270628    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6rhrv"]
Sep 17 11:29:05.436810 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:05.436772    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6rhrv" event={"ID":"0ec4c533-75f7-4e13-8569-0e01527519b7","Type":"ContainerStarted","Data":"368d640cc3a7001f80bee3ef198e0b0bb789173ff3fe82469e18c85883153214"}
Sep 17 11:29:05.436996 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:05.436833    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6rhrv" event={"ID":"0ec4c533-75f7-4e13-8569-0e01527519b7","Type":"ContainerStarted","Data":"57a7c62a2800c839e63fa6cbfceecbdab4394c45d632d71350fca09bc770c2ad"}
Sep 17 11:29:05.436996 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:05.436879    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6rhrv"
Sep 17 11:29:05.460661 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:05.460616    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6rhrv" podStartSLOduration=1.4606002120000001 podStartE2EDuration="1.460600212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:29:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:29:05.459095528 +0000 UTC m=+2135.254429980" watchObservedRunningTime="2026-09-17 11:29:05.460600212 +0000 UTC m=+2135.255934651"
Sep 17 11:29:16.444135 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:29:16.444103    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-6rhrv"
Sep 17 11:33:30.828134 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:33:30.828106    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 11:33:30.846622 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:33:30.846594    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-lv7s5_ac62c987-276e-4087-917b-cd0d72f5faa7/ovn-acl-logging/0.log"
Sep 17 11:34:02.215157 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:02.215084    2570 ???:1] "http: TLS handshake error from 10.0.129.205:38142: EOF"
Sep 17 11:34:02.220318 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:02.220295    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v56d8_ef38bd1a-72d9-451f-b754-72d2fd579687/global-pull-secret-syncer/0.log"
Sep 17 11:34:02.348788 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:02.348756    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-snvdp_436e3582-44b3-4a08-9192-c700c482f195/konnectivity-agent/0.log"
Sep 17 11:34:02.397268 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:02.397229    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-123.ec2.internal_0e9bd5460479070ecb380c4ff6316476/haproxy/0.log"
Sep 17 11:34:07.822289 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:07.822259    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-q2cwm_9e5a482b-a9df-40ae-9882-9fe42103ccb4/manager/0.log"
Sep 17 11:34:07.867747 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:07.867717    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-vzxwb_fc2c2655-44e9-4da2-bbf2-4596ad57a678/manager/0.log"
Sep 17 11:34:08.015489 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:08.015457    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-6rhrv_0ec4c533-75f7-4e13-8569-0e01527519b7/manager/0.log"
Sep 17 11:34:08.162393 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:08.162304    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-mgdwr_0befb76e-4334-4b49-94fd-0debe22e1538/manager/0.log"
Sep 17 11:34:10.399471 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:10.399441    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pj2l2_dc13021c-972c-4534-a81c-5954ad4e5bf6/node-exporter/0.log"
Sep 17 11:34:10.423871 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:10.423812    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pj2l2_dc13021c-972c-4534-a81c-5954ad4e5bf6/kube-rbac-proxy/0.log"
Sep 17 11:34:10.446603 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:10.446578    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pj2l2_dc13021c-972c-4534-a81c-5954ad4e5bf6/init-textfile/0.log"
Sep 17 11:34:10.785590 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:10.785562    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_825da161-2a61-47f9-b825-a431b38cfa69/prometheus/0.log"
Sep 17 11:34:10.822778 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:10.822749    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_825da161-2a61-47f9-b825-a431b38cfa69/config-reloader/0.log"
Sep 17 11:34:10.848773 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:10.848750    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_825da161-2a61-47f9-b825-a431b38cfa69/thanos-sidecar/0.log"
Sep 17 11:34:10.877025 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:10.877000    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_825da161-2a61-47f9-b825-a431b38cfa69/kube-rbac-proxy-web/0.log"
Sep 17 11:34:10.913662 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:10.913642    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_825da161-2a61-47f9-b825-a431b38cfa69/kube-rbac-proxy/0.log"
Sep 17 11:34:10.939948 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:10.939911    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_825da161-2a61-47f9-b825-a431b38cfa69/kube-rbac-proxy-thanos/0.log"
Sep 17 11:34:10.966045 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:10.966023    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_825da161-2a61-47f9-b825-a431b38cfa69/init-config-reloader/0.log"
Sep 17 11:34:11.951997 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:11.951968    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"]
Sep 17 11:34:11.955473 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:11.955455    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"
Sep 17 11:34:11.958846 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:11.958825    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tmn9t\"/\"kube-root-ca.crt\""
Sep 17 11:34:11.960102 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:11.960079    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tmn9t\"/\"openshift-service-ca.crt\""
Sep 17 11:34:11.960229 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:11.960098    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tmn9t\"/\"default-dockercfg-scghf\""
Sep 17 11:34:11.965561 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:11.965541    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"]
Sep 17 11:34:12.085298 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.085269    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtbxh\" (UniqueName: \"kubernetes.io/projected/786b5e7c-5159-45c1-9552-cc6d2310b9c5-kube-api-access-qtbxh\") pod \"perf-node-gather-daemonset-5pbpd\" (UID: \"786b5e7c-5159-45c1-9552-cc6d2310b9c5\") " pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"
Sep 17 11:34:12.085420 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.085312    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/786b5e7c-5159-45c1-9552-cc6d2310b9c5-sys\") pod \"perf-node-gather-daemonset-5pbpd\" (UID: \"786b5e7c-5159-45c1-9552-cc6d2310b9c5\") " pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"
Sep 17 11:34:12.085420 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.085404    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/786b5e7c-5159-45c1-9552-cc6d2310b9c5-proc\") pod \"perf-node-gather-daemonset-5pbpd\" (UID: \"786b5e7c-5159-45c1-9552-cc6d2310b9c5\") " pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"
Sep 17 11:34:12.085495 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.085438    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/786b5e7c-5159-45c1-9552-cc6d2310b9c5-lib-modules\") pod \"perf-node-gather-daemonset-5pbpd\" (UID: \"786b5e7c-5159-45c1-9552-cc6d2310b9c5\") " pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"
Sep 17 11:34:12.085495 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.085470    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/786b5e7c-5159-45c1-9552-cc6d2310b9c5-podres\") pod \"perf-node-gather-daemonset-5pbpd\" (UID: \"786b5e7c-5159-45c1-9552-cc6d2310b9c5\") " pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"
Sep 17 11:34:12.186272 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.186247    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/786b5e7c-5159-45c1-9552-cc6d2310b9c5-podres\") pod \"perf-node-gather-daemonset-5pbpd\" (UID: \"786b5e7c-5159-45c1-9552-cc6d2310b9c5\") " pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"
Sep 17 11:34:12.186409 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.186311    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtbxh\" (UniqueName: \"kubernetes.io/projected/786b5e7c-5159-45c1-9552-cc6d2310b9c5-kube-api-access-qtbxh\") pod \"perf-node-gather-daemonset-5pbpd\" (UID: \"786b5e7c-5159-45c1-9552-cc6d2310b9c5\") " pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"
Sep 17 11:34:12.186409 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.186327    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/786b5e7c-5159-45c1-9552-cc6d2310b9c5-sys\") pod \"perf-node-gather-daemonset-5pbpd\" (UID: \"786b5e7c-5159-45c1-9552-cc6d2310b9c5\") " pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"
Sep 17 11:34:12.186409 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.186366    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/786b5e7c-5159-45c1-9552-cc6d2310b9c5-proc\") pod \"perf-node-gather-daemonset-5pbpd\" (UID: \"786b5e7c-5159-45c1-9552-cc6d2310b9c5\") " pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"
Sep 17 11:34:12.186409 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.186385    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/786b5e7c-5159-45c1-9552-cc6d2310b9c5-lib-modules\") pod \"perf-node-gather-daemonset-5pbpd\" (UID: \"786b5e7c-5159-45c1-9552-cc6d2310b9c5\") " pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"
Sep 17 11:34:12.186661 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.186409    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/786b5e7c-5159-45c1-9552-cc6d2310b9c5-podres\") pod \"perf-node-gather-daemonset-5pbpd\" (UID: \"786b5e7c-5159-45c1-9552-cc6d2310b9c5\") " pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"
Sep 17 11:34:12.186661 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.186459    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/786b5e7c-5159-45c1-9552-cc6d2310b9c5-proc\") pod \"perf-node-gather-daemonset-5pbpd\" (UID: \"786b5e7c-5159-45c1-9552-cc6d2310b9c5\") " pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"
Sep 17 11:34:12.186661 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.186491    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/786b5e7c-5159-45c1-9552-cc6d2310b9c5-sys\") pod \"perf-node-gather-daemonset-5pbpd\" (UID: \"786b5e7c-5159-45c1-9552-cc6d2310b9c5\") " pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"
Sep 17 11:34:12.186661 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.186527    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/786b5e7c-5159-45c1-9552-cc6d2310b9c5-lib-modules\") pod \"perf-node-gather-daemonset-5pbpd\" (UID: \"786b5e7c-5159-45c1-9552-cc6d2310b9c5\") " pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"
Sep 17 11:34:12.195224 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.195200    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtbxh\" (UniqueName: \"kubernetes.io/projected/786b5e7c-5159-45c1-9552-cc6d2310b9c5-kube-api-access-qtbxh\") pod \"perf-node-gather-daemonset-5pbpd\" (UID: \"786b5e7c-5159-45c1-9552-cc6d2310b9c5\") " pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"
Sep 17 11:34:12.266250 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.266229    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"
Sep 17 11:34:12.543856 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.543834    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"]
Sep 17 11:34:12.545436 ip-10-0-138-123 kubenswrapper[2570]: W0917 11:34:12.545402    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod786b5e7c_5159_45c1_9552_cc6d2310b9c5.slice/crio-b3c000a28bea05821247d3aa9e8e25824a1384b38e2451dcb6bdc5f9a768658c WatchSource:0}: Error finding container b3c000a28bea05821247d3aa9e8e25824a1384b38e2451dcb6bdc5f9a768658c: Status 404 returned error can't find the container with id b3c000a28bea05821247d3aa9e8e25824a1384b38e2451dcb6bdc5f9a768658c
Sep 17 11:34:12.874772 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.874692    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd" event={"ID":"786b5e7c-5159-45c1-9552-cc6d2310b9c5","Type":"ContainerStarted","Data":"0c21948172ea507a2bc46969808aadf8689594459baf37437b13c3bbecd019a7"}
Sep 17 11:34:12.874772 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.874742    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd" event={"ID":"786b5e7c-5159-45c1-9552-cc6d2310b9c5","Type":"ContainerStarted","Data":"b3c000a28bea05821247d3aa9e8e25824a1384b38e2451dcb6bdc5f9a768658c"}
Sep 17 11:34:12.874982 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.874827    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"
Sep 17 11:34:12.898099 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:12.898049    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd" podStartSLOduration=1.8980363439999999 podStartE2EDuration="1.898036344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:34:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:34:12.896297441 +0000 UTC m=+2442.691631879" watchObservedRunningTime="2026-09-17 11:34:12.898036344 +0000 UTC m=+2442.693370784"
Sep 17 11:34:16.039346 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:16.039324    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmpqk_a2062301-9298-4b90-b0b2-9cbbac41130a/dns/0.log"
Sep 17 11:34:16.091961 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:16.091940    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmpqk_a2062301-9298-4b90-b0b2-9cbbac41130a/kube-rbac-proxy/0.log"
Sep 17 11:34:16.268637 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:16.268612    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nwlxk_afe38f2b-75ab-4150-87dc-a948eba57e44/dns-node-resolver/0.log"
Sep 17 11:34:17.301763 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:17.301734    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jv7wk_89b9f0b0-986a-461c-bb56-8c747c1e21bd/node-ca/0.log"
Sep 17 11:34:18.889440 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:18.889409    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tmn9t/perf-node-gather-daemonset-5pbpd"
Sep 17 11:34:19.197553 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:19.197451    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8665f874d8-5fz7h_6e8ff76e-8565-420d-b9fd-d3a0decfc8a9/kube-auth-proxy/0.log"
Sep 17 11:34:19.261765 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:19.261735    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pgmjq_d1616799-1ec0-4cf2-948a-12c8ffaba408/istio-proxy/0.log"
Sep 17 11:34:19.263982 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:19.263962    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pgmjq_d1616799-1ec0-4cf2-948a-12c8ffaba408/istio-proxy/1.log"
Sep 17 11:34:20.280280 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:20.280246    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-k5q5b_a9591f62-675e-42af-8cdc-7a201faa92da/serve-healthcheck-canary/0.log"
Sep 17 11:34:20.957907 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:20.957879    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s2cf4_69728ca8-7dbb-4982-9fd5-4a16ebbacf01/kube-rbac-proxy/0.log"
Sep 17 11:34:20.979015 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:20.978994    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s2cf4_69728ca8-7dbb-4982-9fd5-4a16ebbacf01/exporter/0.log"
Sep 17 11:34:21.009957 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:21.009937    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s2cf4_69728ca8-7dbb-4982-9fd5-4a16ebbacf01/extractor/0.log"
Sep 17 11:34:23.373274 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:23.373191    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8665f874d8-5fz7h_6e8ff76e-8565-420d-b9fd-d3a0decfc8a9/kube-auth-proxy/0.log"
Sep 17 11:34:23.438079 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:23.438051    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pgmjq_d1616799-1ec0-4cf2-948a-12c8ffaba408/istio-proxy/0.log"
Sep 17 11:34:23.440282 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:23.440261    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pgmjq_d1616799-1ec0-4cf2-948a-12c8ffaba408/istio-proxy/1.log"
Sep 17 11:34:23.542753 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:23.542730    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bdtc5_12c5f420-1616-4886-8e0b-9696a1b9b190/manager/0.log"
Sep 17 11:34:23.756774 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:23.756686    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-4ddxc_ed831471-85be-4249-9097-2799dbd87b2c/manager/0.log"
Sep 17 11:34:23.797175 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:23.797147    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-658cf9cdcf-xklxc_b4d673ba-2f47-4127-8e30-30977a25b070/manager/0.log"
Sep 17 11:34:23.978465 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:23.978444    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c54c4bd97-965xp_fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a/manager/0.log"
Sep 17 11:34:23.998282 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:23.998260    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c54c4bd97-965xp_fecfaf3e-043f-4a99-9793-cbfd9cbe6a4a/copy-manifests/0.log"
Sep 17 11:34:25.692321 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:25.692271    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8665f874d8-5fz7h_6e8ff76e-8565-420d-b9fd-d3a0decfc8a9/kube-auth-proxy/0.log"
Sep 17 11:34:25.745536 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:25.745494    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pgmjq_d1616799-1ec0-4cf2-948a-12c8ffaba408/istio-proxy/0.log"
Sep 17 11:34:25.747994 ip-10-0-138-123 kubenswrapper[2570]: I0917 11:34:25.747974    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pgmjq_d1616799-1ec0-4cf2-948a-12c8ffaba408/istio-proxy/1.log"