Sep 15 12:42:49.905887 ip-10-0-129-48 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 15 12:42:49.905899 ip-10-0-129-48 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 15 12:42:49.905906 ip-10-0-129-48 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 15 12:42:49.906059 ip-10-0-129-48 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 15 12:42:59.950653 ip-10-0-129-48 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 15 12:42:59.950671 ip-10-0-129-48 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a9f6ef046da24f4b84b90adac91f0d47 --
Sep 15 12:44:55.108510 ip-10-0-129-48 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 12:44:55.431837 ip-10-0-129-48 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 12:44:55.431837 ip-10-0-129-48 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 12:44:55.431837 ip-10-0-129-48 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 12:44:55.431837 ip-10-0-129-48 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 12:44:55.431837 ip-10-0-129-48 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 12:44:55.433030 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.432947    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 12:44:55.438826 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438804    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 12:44:55.438826 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438823    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 12:44:55.438826 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438827    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 12:44:55.438826 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438830    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 12:44:55.438826 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438833    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 12:44:55.439014 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438836    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 12:44:55.439014 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438840    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 12:44:55.439014 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438843    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 12:44:55.439014 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438846    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 12:44:55.439014 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438849    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 12:44:55.439014 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438852    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 12:44:55.439014 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438854    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 12:44:55.439014 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438857    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 12:44:55.439014 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438860    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 12:44:55.439014 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438864    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 12:44:55.439014 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438868    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 12:44:55.439014 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438871    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 12:44:55.439014 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438874    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 12:44:55.439014 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438876    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 12:44:55.439014 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438879    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 12:44:55.439014 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438882    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 12:44:55.439014 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438884    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 12:44:55.439014 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438887    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 12:44:55.439014 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438890    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438892    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438895    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438898    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438901    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438904    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438906    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438909    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438911    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438914    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438916    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438919    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438921    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438924    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438927    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438932    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438935    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438937    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438940    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438943    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 12:44:55.439487 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438946    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438948    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438951    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438953    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438956    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438958    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438961    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438964    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438966    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438969    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438972    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438975    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438977    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438980    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438982    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438985    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438987    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438990    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438992    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438995    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 12:44:55.440006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.438998    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439001    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439005    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439008    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439011    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439014    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439017    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439022    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439025    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439028    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439031    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439034    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439037    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439040    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439044    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439047    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439049    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439052    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439055    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439058    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 12:44:55.440531 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439061    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 12:44:55.441022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439063    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 12:44:55.441022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439066    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 12:44:55.441022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439069    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 12:44:55.441022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439071    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 12:44:55.441022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439074    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 12:44:55.441022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439076    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 12:44:55.441022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439079    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 12:44:55.441022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439083    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 12:44:55.441022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439087    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 12:44:55.441022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439090    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 12:44:55.441022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439093    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 12:44:55.441022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439096    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 12:44:55.441022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439098    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 12:44:55.441022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439101    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 12:44:55.441022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.439103    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 12:44:55.441022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441023    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 12:44:55.441451 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441031    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 12:44:55.441451 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441034    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 12:44:55.441451 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441037    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 12:44:55.441451 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441040    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 12:44:55.441451 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441043    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 12:44:55.441451 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441046    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 12:44:55.441451 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441049    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 12:44:55.441451 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441051    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 12:44:55.441451 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441054    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 12:44:55.441451 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441056    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 12:44:55.441451 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441059    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 12:44:55.441451 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441062    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 12:44:55.441451 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441064    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 12:44:55.441451 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441067    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 12:44:55.441451 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441069    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 12:44:55.441451 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441072    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 12:44:55.441451 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441075    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 12:44:55.441451 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441078    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 12:44:55.441451 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441080    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 12:44:55.441935 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441084    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 12:44:55.441935 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441088    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 12:44:55.441935 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441091    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 12:44:55.441935 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441093    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 12:44:55.441935 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441096    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 12:44:55.441935 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441099    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 12:44:55.441935 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441102    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 12:44:55.441935 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441105    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 12:44:55.441935 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441107    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 12:44:55.441935 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441110    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 12:44:55.441935 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441113    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 12:44:55.441935 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441115    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 12:44:55.441935 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441119    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 12:44:55.441935 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441121    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 12:44:55.441935 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441125    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 12:44:55.441935 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441128    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 12:44:55.441935 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441131    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 12:44:55.441935 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441134    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 12:44:55.441935 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441136    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441139    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441142    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441144    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441147    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441149    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441152    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441154    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441156    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441159    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441161    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441164    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441167    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441170    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441173    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441175    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441178    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441180    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441183    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441185    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 12:44:55.442430 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441188    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441190    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441193    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441195    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441198    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441200    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441204    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441206    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441209    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441212    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441214    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441217    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441219    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441237    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441240    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441242    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441245    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441248    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441250    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441253    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 12:44:55.442948 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441257    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441260    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441263    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441268    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441271    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441275    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441280    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441283    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441286    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441288    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441291    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441294    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441297    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441300    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441303    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441306    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441308    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441311    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441315    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441317    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 12:44:55.443480 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441321    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441687    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441692    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441695    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441697    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441700    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441703    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441707    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441711    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441714    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441717    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441720    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441723    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441726    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441729    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441732    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441734    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441737    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441740    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441743    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 12:44:55.443992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441745    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441748    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441751    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441753    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441756    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441759    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441761    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441764    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441767    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441769    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441772    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441774    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441777    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441780    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441782    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441785    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441787    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441791    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441794    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441797    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 12:44:55.444500 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441800    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441802    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441804    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441807    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441809    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441812    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441814    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441817    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441819    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441821    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441825    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441827    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441830    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441832    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441835    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441838    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441841    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441844    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441846    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441849    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 12:44:55.445031 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441851    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 12:44:55.445585 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441854    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 12:44:55.445585 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441856    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 12:44:55.445585 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441859    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 12:44:55.445585 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441861    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 12:44:55.445585 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441864    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 12:44:55.445585 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441866    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 12:44:55.445585 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441870    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 12:44:55.445585 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441873    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 12:44:55.445585 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441875    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 12:44:55.445585 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441878    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 12:44:55.445585 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441880    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 12:44:55.445585 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441882    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 12:44:55.445585 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441885    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 12:44:55.445585 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441887    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 12:44:55.445585 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441890    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 12:44:55.445585 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441892    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 12:44:55.445585 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441894    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 12:44:55.445585 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441897    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 12:44:55.445585 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441899    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 12:44:55.446055 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441902    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 12:44:55.446055 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441904    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 12:44:55.446055 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441907    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 12:44:55.446055 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441909    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 12:44:55.446055 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441912    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 12:44:55.446055 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441914    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 12:44:55.446055 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441917    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 12:44:55.446055 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441919    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 12:44:55.446055 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441922    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 12:44:55.446055 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441924    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 12:44:55.446055 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441927    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 12:44:55.446055 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441929    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 12:44:55.446055 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441932    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 12:44:55.446055 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441934    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 12:44:55.446055 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441937    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 12:44:55.446055 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441940    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 12:44:55.446055 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441942    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 12:44:55.446055 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441946    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 12:44:55.446055 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441950    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.441952    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442022    2567 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442055    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442062    2567 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442067    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442071    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442074    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442078    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442082    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442085    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442088    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442091    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442095    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442098    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442101    2567 flags.go:64] FLAG: --cgroup-root=""
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442103    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442106    2567 flags.go:64] FLAG: --client-ca-file=""
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442110    2567 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442113    2567 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442117    2567 flags.go:64] FLAG: --cluster-domain=""
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442119    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442122    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442126    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 12:44:55.446587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442129    2567 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442133    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442136    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442139    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442142    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442145    2567 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442148    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442151    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442154    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442157    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442164    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442167    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442170    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442173    2567 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442175    2567 flags.go:64] FLAG: --enable-server="true"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442178    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442185    2567 flags.go:64] FLAG: --event-burst="100"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442188    2567 flags.go:64] FLAG: --event-qps="50"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442191    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442194    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442197    2567 flags.go:64] FLAG: --eviction-hard=""
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442201    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442203    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442206    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442209    2567 flags.go:64] FLAG: --eviction-soft=""
Sep 15 12:44:55.447212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442212    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442215    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442219    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442235    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442239    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442242    2567 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442244    2567 flags.go:64] FLAG: --feature-gates=""
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442248    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442251    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442255    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442258    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442261    2567 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442264    2567 flags.go:64] FLAG: --help="false"
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442267    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-129-48.ec2.internal"
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442270    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442273    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442275    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442279    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442282    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442285    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442287    2567 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442290    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442293    2567 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 12:44:55.447840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442296    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442299    2567 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442301    2567 flags.go:64] FLAG: --kube-reserved=""
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442304    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442307    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442310    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442313    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442315    2567 flags.go:64] FLAG: --lock-file=""
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442318    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442321    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442324    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442331    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442335    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442337    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442340    2567 flags.go:64] FLAG: --logging-format="text"
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442346    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442349    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442352    2567 flags.go:64] FLAG: --manifest-url=""
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442355    2567 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442359    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442362    2567 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442366    2567 flags.go:64] FLAG: --max-pods="110"
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442369    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442373    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442376    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 12:44:55.448525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442379    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442382    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442385    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442387    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442394    2567 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442397    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442400    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442404    2567 flags.go:64] FLAG: --pod-cidr=""
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442406    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442411    2567 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442415    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442418    2567 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442421    2567 flags.go:64] FLAG: --port="10250"
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442424    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442427    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04f1ac553b606f167"
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442430    2567 flags.go:64] FLAG: --qos-reserved=""
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442433    2567 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442436    2567 flags.go:64] FLAG: --register-node="true"
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442441    2567 flags.go:64] FLAG: --register-with-taints=""
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442444    2567 flags.go:64] FLAG: --registry-burst="10"
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442448    2567 flags.go:64] FLAG: --registry-qps="5"
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442451    2567 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442454    2567 flags.go:64] FLAG: --reserved-memory=""
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442459    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442462    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 12:44:55.449168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442465    2567 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442468    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442471    2567 flags.go:64] FLAG: --runonce="false"
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442473    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442476    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442479    2567 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442482    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442485    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442488    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442491    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442494    2567 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442497    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442500    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442503    2567 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442506    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442509    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442512    2567 flags.go:64] FLAG: --system-cgroups=""
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442515    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442520    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442523    2567 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442526    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442529    2567 flags.go:64] FLAG: --tls-min-version=""
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442532    2567 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442535    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442537    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 12:44:55.449869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442541    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442544    2567 flags.go:64] FLAG: --v="2"
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442548    2567 flags.go:64] FLAG: --version="false"
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442553    2567 flags.go:64] FLAG: --vmodule=""
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442557    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.442562    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442676    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442681    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442685    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442688    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442691    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442694    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442697    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442699    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442703    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442707    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442710    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442713    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442715    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442718    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442721    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 12:44:55.450528 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442724    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442727    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442729    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442732    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442735    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442737    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442740    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442743    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442745    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442748    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442751    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442755    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442757    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442760    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442763    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442766    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442771    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442773    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442776    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442778    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 12:44:55.451043 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442781    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 12:44:55.451549 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442784    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 12:44:55.451549 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442786    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 12:44:55.451549 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442789    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 12:44:55.451549 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442792    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 12:44:55.451549 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442794    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 12:44:55.451549 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442797    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 12:44:55.451549 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442799    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 12:44:55.451549 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442802    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 12:44:55.451549 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442805    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 12:44:55.451549 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442807    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 12:44:55.451549 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442810    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 12:44:55.451549 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442812    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 12:44:55.451549 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442815    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 12:44:55.451549 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442817    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 12:44:55.451549 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442820    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 12:44:55.451549 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442822    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 12:44:55.451549 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442826    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 12:44:55.451549 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442829    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 12:44:55.451549 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442833    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442836    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442839    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442842    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442846    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442849    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442851    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442854    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442857    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442861    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442863    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442866    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442869    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442871    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442874    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442876    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442879    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442882    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442884    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442887    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 12:44:55.452022 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442890    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 12:44:55.452540 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442892    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 12:44:55.452540 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442895    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 12:44:55.452540 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442898    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 12:44:55.452540 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442901    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 12:44:55.452540 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442903    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 12:44:55.452540 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442906    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 12:44:55.452540 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442909    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 12:44:55.452540 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442911    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 12:44:55.452540 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442914    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 12:44:55.452540 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442916    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 12:44:55.452540 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442919    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 12:44:55.452540 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442922    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 12:44:55.452540 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442924    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 12:44:55.452540 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442927    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 12:44:55.452540 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442929    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 12:44:55.452540 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442933    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 12:44:55.452540 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442936    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 12:44:55.452540 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442938    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 12:44:55.452540 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442941    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 12:44:55.453006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442944    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 12:44:55.453006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442947    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 12:44:55.453006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442951    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 12:44:55.453006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442954    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 12:44:55.453006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.442956    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 12:44:55.453006 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.443459    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 12:44:55.453006 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.450245    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 12:44:55.453006 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.450262    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 12:44:55.453006 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.450811    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 12:44:55.453006 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.450818    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 12:44:55.453006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450875    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 12:44:55.453006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450880    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 12:44:55.453006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450883    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 12:44:55.453006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450886    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 12:44:55.453006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450889    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 12:44:55.453456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450891    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 12:44:55.453456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450894    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 12:44:55.453456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450897    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 12:44:55.453456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450900    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 12:44:55.453456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450902    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 12:44:55.453456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450905    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 12:44:55.453456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450908    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 12:44:55.453456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450911    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 12:44:55.453456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450914    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 12:44:55.453456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450916    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 12:44:55.453456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450919    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 12:44:55.453456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450922    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 12:44:55.453456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450926    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 12:44:55.453456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450930    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 12:44:55.453456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450933    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 12:44:55.453456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450937    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 12:44:55.453456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450940    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 12:44:55.453456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450942    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 12:44:55.453456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450945    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450947    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450950    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450953    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450956    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450958    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450963    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450967    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450971    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450973    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450976    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450979    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450981    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450984    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450986    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450989    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450992    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450995    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.450997    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451000    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 12:44:55.453952 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451002    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451005    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451007    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451010    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451013    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451015    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451018    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451020    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451023    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451026    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451028    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451032    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451035    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451038    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451042    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451044    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451047    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451050    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451053    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451057    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 12:44:55.454450 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451060    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451062    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451065    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451067    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451070    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451073    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451075    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451078    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451080    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451083    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451086    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451088    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451091    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451093    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451096    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451098    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451101    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451104    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451106    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451109    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 12:44:55.454963 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451112    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 12:44:55.455571 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451114    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 12:44:55.455571 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451117    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 12:44:55.455571 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451119    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 12:44:55.455571 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451122    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 12:44:55.455571 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451124    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 12:44:55.455571 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451127    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 12:44:55.455571 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451130    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 12:44:55.455571 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451132    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 12:44:55.455571 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451135    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 12:44:55.455571 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451138    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 12:44:55.455571 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451141    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 12:44:55.455571 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451144    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 12:44:55.455571 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451146    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 12:44:55.455571 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451149    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 12:44:55.455571 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451152    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 12:44:55.455950 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.451156    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 12:44:55.455950 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451281    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 12:44:55.455950 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451286    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 12:44:55.455950 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451289    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 12:44:55.455950 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451292    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 12:44:55.455950 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451295    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 12:44:55.455950 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451297    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 12:44:55.455950 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451300    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 12:44:55.455950 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451303    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 12:44:55.455950 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451305    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 12:44:55.455950 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451308    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 12:44:55.455950 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451310    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 12:44:55.455950 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451313    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 12:44:55.455950 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451315    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 12:44:55.455950 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451318    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 12:44:55.456491 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451320    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 12:44:55.456491 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451323    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 12:44:55.456491 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451325    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 12:44:55.456491 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451328    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 12:44:55.456491 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451330    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 12:44:55.456491 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451333    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 12:44:55.456491 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451335    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 12:44:55.456491 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451338    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 12:44:55.456491 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451340    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 12:44:55.456491 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451343    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 12:44:55.456491 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451345    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 12:44:55.456491 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451348    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 12:44:55.456491 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451351    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 12:44:55.456491 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451353    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 12:44:55.456491 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451356    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 12:44:55.456491 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451359    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 12:44:55.456491 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451362    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 12:44:55.456491 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451364    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 12:44:55.456491 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451367    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451369    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451372    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451374    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451377    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451380    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451382    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451385    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451388    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451390    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451393    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451395    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451398    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451400    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451403    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451405    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451408    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451410    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451414    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451418    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 12:44:55.457289 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451420    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451423    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451426    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451428    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451431    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451433    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451436    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451438    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451441    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451451    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451454    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451457    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451459    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451462    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451465    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451467    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451470    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451473    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451477    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451479    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 12:44:55.457855 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451482    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451484    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451487    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451489    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451492    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451494    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451499    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451502    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451505    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451508    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451511    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451514    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451517    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451519    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451522    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451524    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451527    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451530    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451533    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451535    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 12:44:55.458359 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451538    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 12:44:55.458917 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451540    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 12:44:55.458917 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451543    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 12:44:55.458917 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451546    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 12:44:55.458917 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451548    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 12:44:55.458917 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451551    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 12:44:55.458917 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:55.451554    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 12:44:55.458917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.451559    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 12:44:55.458917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.451667    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 12:44:55.458917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.454309    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 12:44:55.458917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.455074    2567 server.go:1019] "Starting client certificate rotation"
Sep 15 12:44:55.458917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.455195    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 12:44:55.458917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.455263    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 12:44:55.458917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.457006    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 12:44:55.460801 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.460784    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 12:44:55.468359 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.468342    2567 log.go:25] "Validated CRI v1 runtime API"
Sep 15 12:44:55.470773 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.470758    2567 log.go:25] "Validated CRI v1 image API"
Sep 15 12:44:55.471623 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.471603    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 12:44:55.473926 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.473903    2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c55725d3-d257-4cd8-8b0f-7da8516e231c:/dev/nvme0n1p3 cbe159a0-700e-4318-9b0c-8792f6c0bf19:/dev/nvme0n1p4]
Sep 15 12:44:55.474003 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.473925    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 12:44:55.478160 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.478044    2567 manager.go:216] Machine: {Timestamp:2026-09-15 12:44:55.477580424 +0000 UTC m=+0.272646226 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110652 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23141f9b63705faecc77f8451007cb SystemUUID:ec23141f-9b63-705f-aecc-77f8451007cb BootID:a9f6ef04-6da2-4f4b-84b9-0adac91f0d47 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ef:98:49:93 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ef:98:49:93 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:9f:4c:2b:ea:0f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 12:44:55.478160 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.478145    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 12:44:55.478348 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.478264    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 12:44:55.480326 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.480290    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 12:44:55.480516 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.480332    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-48.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 12:44:55.481003 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.480992    2567 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 12:44:55.481032 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.481005    2567 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 12:44:55.481032 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.481013    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 12:44:55.481623 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.481613    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 12:44:55.482171 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.482154    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 12:44:55.482377 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.482365    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 12:44:55.485134 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.485122    2567 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 12:44:55.485261 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.485251    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 12:44:55.485305 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.485281    2567 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 12:44:55.485305 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.485299    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 12:44:55.485444 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.485312    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 12:44:55.485444 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.485320    2567 kubelet.go:398] "Adding apiserver pod source"
Sep 15 12:44:55.485444 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.485329    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 12:44:55.485667 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.485655    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 12:44:55.485713 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.485678    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 12:44:55.487353 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.487334    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 12:44:55.489261 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.489246    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 12:44:55.489331 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.489285    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 12:44:55.490613 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.490598    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 12:44:55.490667 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.490618    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 12:44:55.490667 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.490624    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 12:44:55.490667 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.490630    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 12:44:55.490667 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.490639    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 12:44:55.490667 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.490644    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 12:44:55.490667 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.490658    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 12:44:55.490667 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.490663    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 12:44:55.490667 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.490670    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 12:44:55.490915 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.490676    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 12:44:55.490915 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.490695    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 12:44:55.490915 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.490702    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 12:44:55.491651 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.491636    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 12:44:55.491651 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.491647    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 12:44:55.495024 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.495010    2567 server.go:1268] "Started kubelet"
Sep 15 12:44:55.495102 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.495076    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-48.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 12:44:55.495172 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.495100    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 12:44:55.495172 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:55.495129    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 12:44:55.495277 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:55.495151    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 12:44:55.495277 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.495183    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 12:44:55.495360 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.495345    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 12:44:55.496040 ip-10-0-129-48 systemd[1]: Started Kubernetes Kubelet.
Sep 15 12:44:55.496982 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.496629    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 12:44:55.499331 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.499311    2567 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 12:44:55.502740 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:55.502720    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 12:44:55.503530 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.503511    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 12:44:55.503946 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.503927    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 12:44:55.504026 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:55.504009    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-48.ec2.internal\" not found"
Sep 15 12:44:55.504339 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:55.503547    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-48.ec2.internal.18d57f35aef5ff6c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-48.ec2.internal,UID:ip-10-0-129-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-48.ec2.internal,},FirstTimestamp:2026-09-15 12:44:55.494991724 +0000 UTC m=+0.290057526,LastTimestamp:2026-09-15 12:44:55.494991724 +0000 UTC m=+0.290057526,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-48.ec2.internal,}"
Sep 15 12:44:55.504597 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.504576    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 12:44:55.504597 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.504586    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 12:44:55.504742 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.504614    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 12:44:55.504742 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.504686    2567 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 12:44:55.504742 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.504699    2567 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 12:44:55.504860 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.504846    2567 factory.go:55] Registering systemd factory
Sep 15 12:44:55.504900 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.504889    2567 factory.go:223] Registration of the systemd container factory successfully
Sep 15 12:44:55.505103 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.505091    2567 factory.go:153] Registering CRI-O factory
Sep 15 12:44:55.505103 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.505104    2567 factory.go:223] Registration of the crio container factory successfully
Sep 15 12:44:55.505180 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.505148    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 12:44:55.505180 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.505166    2567 factory.go:103] Registering Raw factory
Sep 15 12:44:55.505180 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.505176    2567 manager.go:1196] Started watching for new ooms in manager
Sep 15 12:44:55.505614 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.505602    2567 manager.go:349] Starting recovery of all containers
Sep 15 12:44:55.508373 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:55.508347    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 15 12:44:55.508512 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:55.508484    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 15 12:44:55.514868 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.514846    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dgx9d"
Sep 15 12:44:55.516936 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.516785    2567 manager.go:354] Recovery completed
Sep 15 12:44:55.522020 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.521987    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 12:44:55.522182 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.522164    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dgx9d"
Sep 15 12:44:55.523782 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.523769    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 12:44:55.523837 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.523796    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 12:44:55.523837 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.523806    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasSufficientPID"
Sep 15 12:44:55.524391 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.524369    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 12:44:55.524391 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.524381    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 12:44:55.524391 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.524372    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 12:44:55.524510 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.524395    2567 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 12:44:55.525138 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.525122    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 12:44:55.525217 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.525149    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 12:44:55.525217 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.525184    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasSufficientPID"
Sep 15 12:44:55.525418 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.525404    2567 policy_none.go:49] "None policy: Start"
Sep 15 12:44:55.525484 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.525422    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 12:44:55.525484 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.525436    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 12:44:55.525791 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:55.525356    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-48.ec2.internal.18d57f35b0ad524c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-48.ec2.internal,UID:ip-10-0-129-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-48.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-48.ec2.internal,},FirstTimestamp:2026-09-15 12:44:55.523783244 +0000 UTC m=+0.318849046,LastTimestamp:2026-09-15 12:44:55.523783244 +0000 UTC m=+0.318849046,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-48.ec2.internal,}"
Sep 15 12:44:55.526401 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.526387    2567 policy_none.go:47] "Start"
Sep 15 12:44:55.555015 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.554994    2567 manager.go:337] "Starting Device Plugin manager"
Sep 15 12:44:55.567424 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:55.555039    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 12:44:55.567424 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.555052    2567 server.go:87] "Starting device plugin registration server"
Sep 15 12:44:55.567424 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.555382    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 12:44:55.567424 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.555392    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 12:44:55.567424 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.555492    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 12:44:55.567424 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.555569    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 12:44:55.567424 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.555580    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 12:44:55.567424 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:55.556189    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 12:44:55.567424 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:55.556248    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-48.ec2.internal\" not found"
Sep 15 12:44:55.631460 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.631423    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 12:44:55.632769 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.632751    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 12:44:55.632863 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.632803    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 12:44:55.632863 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.632833    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 12:44:55.632958 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:55.632942    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 12:44:55.635545 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.635522    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 12:44:55.656764 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.656733    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 12:44:55.657649 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.657631    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 12:44:55.657743 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.657662    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 12:44:55.657743 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.657672    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasSufficientPID"
Sep 15 12:44:55.657743 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.657693    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-48.ec2.internal"
Sep 15 12:44:55.664694 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.664672    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-48.ec2.internal"
Sep 15 12:44:55.664694 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:55.664695    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-48.ec2.internal\": node \"ip-10-0-129-48.ec2.internal\" not found"
Sep 15 12:44:55.685458 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:55.685384    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-48.ec2.internal\" not found"
Sep 15 12:44:55.733465 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.733435    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-48.ec2.internal"]
Sep 15 12:44:55.733557 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.733503    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 12:44:55.734861 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.734847    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 12:44:55.734943 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.734874    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 12:44:55.734943 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.734888    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasSufficientPID"
Sep 15 12:44:55.736209 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.736196    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 12:44:55.736328 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.736315    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal"
Sep 15 12:44:55.736386 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.736339    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 12:44:55.736877 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.736862    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 12:44:55.736968 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.736893    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 12:44:55.736968 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.736907    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasSufficientPID"
Sep 15 12:44:55.736968 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.736866    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 12:44:55.736968 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.736959    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 12:44:55.736968 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.736969    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasSufficientPID"
Sep 15 12:44:55.737888 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.737872    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-48.ec2.internal"
Sep 15 12:44:55.737959 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.737901    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 12:44:55.738576 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.738564    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 12:44:55.738656 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.738586    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 12:44:55.738656 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.738595    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeHasSufficientPID"
Sep 15 12:44:55.773922 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:55.773900    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-48.ec2.internal\" not found" node="ip-10-0-129-48.ec2.internal"
Sep 15 12:44:55.778265 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:55.778251    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-48.ec2.internal\" not found" node="ip-10-0-129-48.ec2.internal"
Sep 15 12:44:55.786265 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:55.786252    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-48.ec2.internal\" not found"
Sep 15 12:44:55.807468 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.807451    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d61f3f71a7c2331f1f115ac9c3aa31ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal\" (UID: \"d61f3f71a7c2331f1f115ac9c3aa31ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal"
Sep 15 12:44:55.807524 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.807474    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d61f3f71a7c2331f1f115ac9c3aa31ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal\" (UID: \"d61f3f71a7c2331f1f115ac9c3aa31ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal"
Sep 15 12:44:55.807524 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.807492    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/19e9bd3d9e4c4d8228116fb4b9295f1a-config\") pod \"kube-apiserver-proxy-ip-10-0-129-48.ec2.internal\" (UID: \"19e9bd3d9e4c4d8228116fb4b9295f1a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-48.ec2.internal"
Sep 15 12:44:55.886376 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:55.886354    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-48.ec2.internal\" not found"
Sep 15 12:44:55.907819 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.907797    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d61f3f71a7c2331f1f115ac9c3aa31ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal\" (UID: \"d61f3f71a7c2331f1f115ac9c3aa31ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal"
Sep 15 12:44:55.907878 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.907824    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d61f3f71a7c2331f1f115ac9c3aa31ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal\" (UID: \"d61f3f71a7c2331f1f115ac9c3aa31ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal"
Sep 15 12:44:55.907878 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.907842    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/19e9bd3d9e4c4d8228116fb4b9295f1a-config\") pod \"kube-apiserver-proxy-ip-10-0-129-48.ec2.internal\" (UID: \"19e9bd3d9e4c4d8228116fb4b9295f1a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-48.ec2.internal"
Sep 15 12:44:55.907936 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.907901    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d61f3f71a7c2331f1f115ac9c3aa31ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal\" (UID: \"d61f3f71a7c2331f1f115ac9c3aa31ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal"
Sep 15 12:44:55.907936 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.907911    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d61f3f71a7c2331f1f115ac9c3aa31ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal\" (UID: \"d61f3f71a7c2331f1f115ac9c3aa31ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal"
Sep 15 12:44:55.907936 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:55.907919    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/19e9bd3d9e4c4d8228116fb4b9295f1a-config\") pod \"kube-apiserver-proxy-ip-10-0-129-48.ec2.internal\" (UID: \"19e9bd3d9e4c4d8228116fb4b9295f1a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-48.ec2.internal"
Sep 15 12:44:55.987314 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:55.987216    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-48.ec2.internal\" not found"
Sep 15 12:44:56.076770 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:56.076735    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal"
Sep 15 12:44:56.080578 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:56.080464    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-48.ec2.internal"
Sep 15 12:44:56.087651 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:56.087630    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-48.ec2.internal\" not found"
Sep 15 12:44:56.188140 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:56.188090    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-48.ec2.internal\" not found"
Sep 15 12:44:57.362432 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:57.362392    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-48.ec2.internal\" not found"
Sep 15 12:44:57.463026 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:57.462985    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-48.ec2.internal\" not found"
Sep 15 12:44:57.474527 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:57.474505    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 12:44:57.528909 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:57.528886    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 12:44:57.529319 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:57.529018    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 12:44:57.529319 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:57.529049    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 12:44:57.563357 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:57.563310    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-48.ec2.internal\" not found"
Sep 15 12:44:57.582828 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:57.582775    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 12:44:57.599733 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:57.599707    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 12:39:56 +0000 UTC" deadline="2028-05-10 22:41:35.099948516 +0000 UTC"
Sep 15 12:44:57.599733 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:57.599729    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14481h56m37.500222314s"
Sep 15 12:44:57.664041 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:57.664016    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-48.ec2.internal\" not found"
Sep 15 12:44:57.716456 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:57.716429    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e9bd3d9e4c4d8228116fb4b9295f1a.slice/crio-ff94c0fbbe8de3a26b5970cd155819694df029c782b98b108e48e71caba235e1 WatchSource:0}: Error finding container ff94c0fbbe8de3a26b5970cd155819694df029c782b98b108e48e71caba235e1: Status 404 returned error can't find the container with id ff94c0fbbe8de3a26b5970cd155819694df029c782b98b108e48e71caba235e1
Sep 15 12:44:57.719306 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:57.719292    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 12:44:57.764662 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:57.764644    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-48.ec2.internal\" not found"
Sep 15 12:44:57.865201 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:57.865136    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-48.ec2.internal\" not found"
Sep 15 12:44:57.965707 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:57.965677    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-48.ec2.internal\" not found"
Sep 15 12:44:58.033588 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.033565    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 12:44:58.078595 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.078571    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-48.ec2.internal"
Sep 15 12:44:58.089255 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.089233    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 12:44:58.090067 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.090052    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal"
Sep 15 12:44:58.101517 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.101501    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 12:44:58.203371 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:58.203347    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd61f3f71a7c2331f1f115ac9c3aa31ce.slice/crio-be215ba57a92b6193c8ac78efa3332ab50351f77975070f7f1cdeb27a46c4950 WatchSource:0}: Error finding container be215ba57a92b6193c8ac78efa3332ab50351f77975070f7f1cdeb27a46c4950: Status 404 returned error can't find the container with id be215ba57a92b6193c8ac78efa3332ab50351f77975070f7f1cdeb27a46c4950
Sep 15 12:44:58.560361 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.560288    2567 apiserver.go:52] "Watching apiserver"
Sep 15 12:44:58.569497 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.569471    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 12:44:58.571853 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.570204    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-mpvlq","openshift-image-registry/node-ca-mqrsx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal","openshift-multus/network-metrics-daemon-rjf2q","openshift-network-diagnostics/network-check-target-tb86v","openshift-network-operator/iptables-alerter-fdhxj","openshift-ovn-kubernetes/ovnkube-node-wv7pg","kube-system/global-pull-secret-syncer-4gb4s","kube-system/konnectivity-agent-d2bpj","kube-system/kube-apiserver-proxy-ip-10-0-129-48.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2","openshift-cluster-node-tuning-operator/tuned-4nflc","openshift-dns/node-resolver-f2f6j","openshift-multus/multus-additional-cni-plugins-rmdnt"]
Sep 15 12:44:58.572525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.572478    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.573659 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.573639    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f2f6j"
Sep 15 12:44:58.574912 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.574893    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.576007 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.575988    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:44:58.576638 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:58.576094    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjf2q" podUID="ae00611b-05f3-44f1-8fde-3eeb385a7ef1"
Sep 15 12:44:58.577062 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.577042    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:44:58.577155 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:58.577111    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb86v" podUID="b50eaefb-c7d0-4b42-adc8-3e1349c91875"
Sep 15 12:44:58.577412 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.577394    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 12:44:58.578359 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.578340    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fdhxj"
Sep 15 12:44:58.579339 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.579321    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 12:44:58.579540 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.579525    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d2bpj"
Sep 15 12:44:58.579806 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.579789    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lwv27\""
Sep 15 12:44:58.579946 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.579929    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5wxm2\""
Sep 15 12:44:58.580730 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.580677    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.581212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.581090    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 12:44:58.581212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.581110    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 12:44:58.581212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.581124    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 12:44:58.581965 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.581765    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 12:44:58.581965 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.581781    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 12:44:58.581965 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.581765    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 12:44:58.581965 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.581768    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 12:44:58.581965 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.581852    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 12:44:58.581965 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.581878    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 12:44:58.582308 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.582123    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mqrsx"
Sep 15 12:44:58.582368 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.582343    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 12:44:58.582488 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.582469    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xhg62\""
Sep 15 12:44:58.583564 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.583547    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:44:58.583654 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:58.583606    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gb4s" podUID="048c8d38-9a54-4ece-9887-db9382ceee1f"
Sep 15 12:44:58.584443 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.584275    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 12:44:58.584443 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.584312    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 12:44:58.584443 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.584328    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 12:44:58.585864 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.585844    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.587124 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.587106    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 12:44:58.587213 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.587178    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qxfgb\""
Sep 15 12:44:58.587213 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.587199    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.588855 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.588838    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7q469\""
Sep 15 12:44:58.588948 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.588854    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 12:44:58.589796 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.589774    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-j58xz\""
Sep 15 12:44:58.589796 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.589761    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 12:44:58.589948 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.589790    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 12:44:58.590106 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590077    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/55b54275-0333-41b0-bd19-21a54efb5ef8-iptables-alerter-script\") pod \"iptables-alerter-fdhxj\" (UID: \"55b54275-0333-41b0-bd19-21a54efb5ef8\") " pod="openshift-network-operator/iptables-alerter-fdhxj"
Sep 15 12:44:58.590205 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590108    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55b54275-0333-41b0-bd19-21a54efb5ef8-host-slash\") pod \"iptables-alerter-fdhxj\" (UID: \"55b54275-0333-41b0-bd19-21a54efb5ef8\") " pod="openshift-network-operator/iptables-alerter-fdhxj"
Sep 15 12:44:58.590205 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590140    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jl5v\" (UniqueName: \"kubernetes.io/projected/55b54275-0333-41b0-bd19-21a54efb5ef8-kube-api-access-8jl5v\") pod \"iptables-alerter-fdhxj\" (UID: \"55b54275-0333-41b0-bd19-21a54efb5ef8\") " pod="openshift-network-operator/iptables-alerter-fdhxj"
Sep 15 12:44:58.590205 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590163    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-run-ovn\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.590205 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590186    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-cni-bin\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.590417 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590210    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.590417 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590228    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 12:44:58.590417 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590235    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/826d3dbd-d234-48bd-b6fe-d426ab919b84-konnectivity-ca\") pod \"konnectivity-agent-d2bpj\" (UID: \"826d3dbd-d234-48bd-b6fe-d426ab919b84\") " pod="kube-system/konnectivity-agent-d2bpj"
Sep 15 12:44:58.590417 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590265    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-systemd-units\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.590417 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590288    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-run-systemd\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.590417 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590310    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-node-log\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.590417 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590369    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rzs8\" (UniqueName: \"kubernetes.io/projected/5486db58-30f3-45ce-8ecb-de7cf67208ed-kube-api-access-5rzs8\") pod \"node-resolver-f2f6j\" (UID: \"5486db58-30f3-45ce-8ecb-de7cf67208ed\") " pod="openshift-dns/node-resolver-f2f6j"
Sep 15 12:44:58.590417 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590189    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 12:44:58.590417 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590398    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ba39148c-16e4-4d97-bc00-ad3586383bdc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.590840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590435    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 12:44:58.590840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590391    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 12:44:58.590840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590436    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt6j8\" (UniqueName: \"kubernetes.io/projected/ba39148c-16e4-4d97-bc00-ad3586383bdc-kube-api-access-jt6j8\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.590840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590740    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d31ad8c3-8e88-4cfe-9cc0-45accff28163-ovnkube-script-lib\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.590840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590766    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/826d3dbd-d234-48bd-b6fe-d426ab919b84-agent-certs\") pod \"konnectivity-agent-d2bpj\" (UID: \"826d3dbd-d234-48bd-b6fe-d426ab919b84\") " pod="kube-system/konnectivity-agent-d2bpj"
Sep 15 12:44:58.590840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590791    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba39148c-16e4-4d97-bc00-ad3586383bdc-cnibin\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.590840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590816    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msb67\" (UniqueName: \"kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67\") pod \"network-check-target-tb86v\" (UID: \"b50eaefb-c7d0-4b42-adc8-3e1349c91875\") " pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:44:58.591194 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590840    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-slash\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.591194 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590872    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 12:44:58.591194 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590882    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-run-netns\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.591194 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590905    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-var-lib-openvswitch\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.591194 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590928    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5486db58-30f3-45ce-8ecb-de7cf67208ed-hosts-file\") pod \"node-resolver-f2f6j\" (UID: \"5486db58-30f3-45ce-8ecb-de7cf67208ed\") " pod="openshift-dns/node-resolver-f2f6j"
Sep 15 12:44:58.591194 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590951    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4pcr\" (UniqueName: \"kubernetes.io/projected/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-kube-api-access-q4pcr\") pod \"network-metrics-daemon-rjf2q\" (UID: \"ae00611b-05f3-44f1-8fde-3eeb385a7ef1\") " pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:44:58.591194 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.590989    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-etc-openvswitch\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.591194 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591016    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 12:44:58.591194 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591083    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 12:44:58.591194 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591041    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-cni-netd\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.591194 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591137    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba39148c-16e4-4d97-bc00-ad3586383bdc-system-cni-dir\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.591194 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591162    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba39148c-16e4-4d97-bc00-ad3586383bdc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.591194 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591187    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ba39148c-16e4-4d97-bc00-ad3586383bdc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.591801 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591213    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-svzkg\""
Sep 15 12:44:58.591801 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591226    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs\") pod \"network-metrics-daemon-rjf2q\" (UID: \"ae00611b-05f3-44f1-8fde-3eeb385a7ef1\") " pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:44:58.591801 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591250    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-run-openvswitch\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.591801 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591255    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ht57z\""
Sep 15 12:44:58.591801 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d31ad8c3-8e88-4cfe-9cc0-45accff28163-ovnkube-config\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.591801 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591299    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d31ad8c3-8e88-4cfe-9cc0-45accff28163-env-overrides\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.591801 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591321    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5486db58-30f3-45ce-8ecb-de7cf67208ed-tmp-dir\") pod \"node-resolver-f2f6j\" (UID: \"5486db58-30f3-45ce-8ecb-de7cf67208ed\") " pod="openshift-dns/node-resolver-f2f6j"
Sep 15 12:44:58.591801 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591345    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-kubelet\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.591801 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591366    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw8m5\" (UniqueName: \"kubernetes.io/projected/d31ad8c3-8e88-4cfe-9cc0-45accff28163-kube-api-access-xw8m5\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.591801 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591429    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba39148c-16e4-4d97-bc00-ad3586383bdc-cni-binary-copy\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.591801 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591453    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-log-socket\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.591801 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591477    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-run-ovn-kubernetes\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.591801 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591501    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d31ad8c3-8e88-4cfe-9cc0-45accff28163-ovn-node-metrics-cert\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.591801 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591564    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 12:44:58.591801 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591587    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 12:44:58.591801 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.591651    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s2qj4\""
Sep 15 12:44:58.601078 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.600960    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 12:44:58.640329 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.640309    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xh62s"
Sep 15 12:44:58.649781 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.649765    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xh62s"
Sep 15 12:44:58.663750 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.663728    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 12:44:58.679563 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.679539    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 12:44:58.692552 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.692528    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-multus-daemon-config\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.692670 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.692558    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qcfs\" (UniqueName: \"kubernetes.io/projected/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-kube-api-access-4qcfs\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.692670 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.692575    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-sysconfig\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.692670 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.692593    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-run-systemd\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.692670 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.692624    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-node-log\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.692811 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.692677    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-node-log\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.692811 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.692689    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rzs8\" (UniqueName: \"kubernetes.io/projected/5486db58-30f3-45ce-8ecb-de7cf67208ed-kube-api-access-5rzs8\") pod \"node-resolver-f2f6j\" (UID: \"5486db58-30f3-45ce-8ecb-de7cf67208ed\") " pod="openshift-dns/node-resolver-f2f6j"
Sep 15 12:44:58.692811 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.692711    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/048c8d38-9a54-4ece-9887-db9382ceee1f-kubelet-config\") pod \"global-pull-secret-syncer-4gb4s\" (UID: \"048c8d38-9a54-4ece-9887-db9382ceee1f\") " pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:44:58.692811 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.692710    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-run-systemd\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.692811 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.692761    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret\") pod \"global-pull-secret-syncer-4gb4s\" (UID: \"048c8d38-9a54-4ece-9887-db9382ceee1f\") " pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:44:58.693024 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.692810    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tksdz\" (UniqueName: \"kubernetes.io/projected/b21d4a34-9489-4099-8eef-89a54d5e9fc1-kube-api-access-tksdz\") pod \"node-ca-mqrsx\" (UID: \"b21d4a34-9489-4099-8eef-89a54d5e9fc1\") " pod="openshift-image-registry/node-ca-mqrsx"
Sep 15 12:44:58.693024 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.692853    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-kubernetes\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.693024 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.692886    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ba39148c-16e4-4d97-bc00-ad3586383bdc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.693024 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.692914    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt6j8\" (UniqueName: \"kubernetes.io/projected/ba39148c-16e4-4d97-bc00-ad3586383bdc-kube-api-access-jt6j8\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.693024 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.692938    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d31ad8c3-8e88-4cfe-9cc0-45accff28163-ovnkube-script-lib\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.693024 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.692963    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/826d3dbd-d234-48bd-b6fe-d426ab919b84-agent-certs\") pod \"konnectivity-agent-d2bpj\" (UID: \"826d3dbd-d234-48bd-b6fe-d426ab919b84\") " pod="kube-system/konnectivity-agent-d2bpj"
Sep 15 12:44:58.693024 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693001    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-modprobe-d\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.693358 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693027    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-sysctl-d\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.693358 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693050    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-lib-modules\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.693358 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693076    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba39148c-16e4-4d97-bc00-ad3586383bdc-cnibin\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.693358 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693120    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ba39148c-16e4-4d97-bc00-ad3586383bdc-cnibin\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.693358 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693159    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msb67\" (UniqueName: \"kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67\") pod \"network-check-target-tb86v\" (UID: \"b50eaefb-c7d0-4b42-adc8-3e1349c91875\") " pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:44:58.693358 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693184    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-run-netns\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.693358 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693208    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-var-lib-openvswitch\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.693358 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693232    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4pcr\" (UniqueName: \"kubernetes.io/projected/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-kube-api-access-q4pcr\") pod \"network-metrics-daemon-rjf2q\" (UID: \"ae00611b-05f3-44f1-8fde-3eeb385a7ef1\") " pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:44:58.693358 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693258    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-etc-openvswitch\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.693358 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693275    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-run-netns\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.693358 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693292    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-var-lib-openvswitch\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.693358 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693283    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-cni-netd\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.693358 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693322    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-cni-netd\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.693358 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693352    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b21d4a34-9489-4099-8eef-89a54d5e9fc1-host\") pod \"node-ca-mqrsx\" (UID: \"b21d4a34-9489-4099-8eef-89a54d5e9fc1\") " pod="openshift-image-registry/node-ca-mqrsx"
Sep 15 12:44:58.693358 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693361    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-etc-openvswitch\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.694014 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693378    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b21d4a34-9489-4099-8eef-89a54d5e9fc1-serviceca\") pod \"node-ca-mqrsx\" (UID: \"b21d4a34-9489-4099-8eef-89a54d5e9fc1\") " pod="openshift-image-registry/node-ca-mqrsx"
Sep 15 12:44:58.694014 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693404    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba39148c-16e4-4d97-bc00-ad3586383bdc-system-cni-dir\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.694014 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693424    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs\") pod \"network-metrics-daemon-rjf2q\" (UID: \"ae00611b-05f3-44f1-8fde-3eeb385a7ef1\") " pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:44:58.694014 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693438    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-run-openvswitch\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.694014 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693453    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d31ad8c3-8e88-4cfe-9cc0-45accff28163-env-overrides\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.694014 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693461    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ba39148c-16e4-4d97-bc00-ad3586383bdc-system-cni-dir\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.694014 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693476    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-multus-socket-dir-parent\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.694014 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693503    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-systemd\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.694014 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693516    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-run-openvswitch\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.694014 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693527    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-kubelet\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.694014 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:58.693537    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:44:58.694014 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693549    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d31ad8c3-8e88-4cfe-9cc0-45accff28163-ovnkube-script-lib\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.694014 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693554    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw8m5\" (UniqueName: \"kubernetes.io/projected/d31ad8c3-8e88-4cfe-9cc0-45accff28163-kube-api-access-xw8m5\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.694014 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:58.693600    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs podName:ae00611b-05f3-44f1-8fde-3eeb385a7ef1 nodeName:}" failed. No retries permitted until 2026-09-15 12:44:59.193579764 +0000 UTC m=+2.914895296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs") pod "network-metrics-daemon-rjf2q" (UID: "ae00611b-05f3-44f1-8fde-3eeb385a7ef1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:44:58.694014 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693599    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-kubelet\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.694014 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693637    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-system-cni-dir\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.694014 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693662    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-etc-kubernetes\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.694709 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693685    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/048c8d38-9a54-4ece-9887-db9382ceee1f-dbus\") pod \"global-pull-secret-syncer-4gb4s\" (UID: \"048c8d38-9a54-4ece-9887-db9382ceee1f\") " pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:44:58.694709 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693711    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-sysctl-conf\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.694709 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693733    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-run\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.694709 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693763    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-log-socket\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.694709 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693759    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 12:44:58.694709 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693790    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-run-ovn-kubernetes\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.694709 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693812    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d31ad8c3-8e88-4cfe-9cc0-45accff28163-ovn-node-metrics-cert\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.694709 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693813    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-log-socket\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.694709 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693818    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d31ad8c3-8e88-4cfe-9cc0-45accff28163-env-overrides\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.694709 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693854    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-run-ovn-kubernetes\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.694709 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693892    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/55b54275-0333-41b0-bd19-21a54efb5ef8-iptables-alerter-script\") pod \"iptables-alerter-fdhxj\" (UID: \"55b54275-0333-41b0-bd19-21a54efb5ef8\") " pod="openshift-network-operator/iptables-alerter-fdhxj"
Sep 15 12:44:58.694709 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693920    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55b54275-0333-41b0-bd19-21a54efb5ef8-host-slash\") pod \"iptables-alerter-fdhxj\" (UID: \"55b54275-0333-41b0-bd19-21a54efb5ef8\") " pod="openshift-network-operator/iptables-alerter-fdhxj"
Sep 15 12:44:58.694709 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693946    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-host-run-k8s-cni-cncf-io\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.694709 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.693988    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-run-ovn\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.694709 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694013    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-cni-bin\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.694709 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694037    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/826d3dbd-d234-48bd-b6fe-d426ab919b84-konnectivity-ca\") pod \"konnectivity-agent-d2bpj\" (UID: \"826d3dbd-d234-48bd-b6fe-d426ab919b84\") " pod="kube-system/konnectivity-agent-d2bpj"
Sep 15 12:44:58.694709 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694025    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/55b54275-0333-41b0-bd19-21a54efb5ef8-host-slash\") pod \"iptables-alerter-fdhxj\" (UID: \"55b54275-0333-41b0-bd19-21a54efb5ef8\") " pod="openshift-network-operator/iptables-alerter-fdhxj"
Sep 15 12:44:58.694709 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694063    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-cnibin\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.695512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694110    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-run-ovn\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.695512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694146    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.695512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694170    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-systemd-units\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.695512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694179    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-cni-bin\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.695512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694207    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ba39148c-16e4-4d97-bc00-ad3586383bdc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.695512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694239    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-host-var-lib-cni-bin\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.695512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694259    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-systemd-units\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.695512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694277    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-multus-conf-dir\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.695512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694304    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffjpd\" (UniqueName: \"kubernetes.io/projected/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-kube-api-access-ffjpd\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.695512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694335    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-socket-dir\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.695512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694360    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-multus-cni-dir\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.695512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694381    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-host-var-lib-kubelet\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.695512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694405    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-registration-dir\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.695512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694431    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-etc-selinux\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.695512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694433    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/55b54275-0333-41b0-bd19-21a54efb5ef8-iptables-alerter-script\") pod \"iptables-alerter-fdhxj\" (UID: \"55b54275-0333-41b0-bd19-21a54efb5ef8\") " pod="openshift-network-operator/iptables-alerter-fdhxj"
Sep 15 12:44:58.695512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694472    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-slash\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.695512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694508    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-slash\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.696320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694542    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5486db58-30f3-45ce-8ecb-de7cf67208ed-hosts-file\") pod \"node-resolver-f2f6j\" (UID: \"5486db58-30f3-45ce-8ecb-de7cf67208ed\") " pod="openshift-dns/node-resolver-f2f6j"
Sep 15 12:44:58.696320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694576    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-host-var-lib-cni-multus\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.696320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694599    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5486db58-30f3-45ce-8ecb-de7cf67208ed-hosts-file\") pod \"node-resolver-f2f6j\" (UID: \"5486db58-30f3-45ce-8ecb-de7cf67208ed\") " pod="openshift-dns/node-resolver-f2f6j"
Sep 15 12:44:58.696320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694626    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/826d3dbd-d234-48bd-b6fe-d426ab919b84-konnectivity-ca\") pod \"konnectivity-agent-d2bpj\" (UID: \"826d3dbd-d234-48bd-b6fe-d426ab919b84\") " pod="kube-system/konnectivity-agent-d2bpj"
Sep 15 12:44:58.696320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694640    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-device-dir\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.696320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694668    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-tuned\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.696320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694691    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-host-run-netns\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.696320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694716    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-sys\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.696320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694742    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba39148c-16e4-4d97-bc00-ad3586383bdc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.696320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694768    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ba39148c-16e4-4d97-bc00-ad3586383bdc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.696320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694799    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d31ad8c3-8e88-4cfe-9cc0-45accff28163-ovnkube-config\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.696320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694826    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5486db58-30f3-45ce-8ecb-de7cf67208ed-tmp-dir\") pod \"node-resolver-f2f6j\" (UID: \"5486db58-30f3-45ce-8ecb-de7cf67208ed\") " pod="openshift-dns/node-resolver-f2f6j"
Sep 15 12:44:58.696320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694848    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-host\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.696320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694881    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ba39148c-16e4-4d97-bc00-ad3586383bdc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.696320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694886    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-cni-binary-copy\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.696320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694921    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-hostroot\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.696320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694941    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf0cecf6-307b-4722-8430-819b1afe2dff-tmp\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.697178 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.694963    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba39148c-16e4-4d97-bc00-ad3586383bdc-cni-binary-copy\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.697178 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.695000    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jl5v\" (UniqueName: \"kubernetes.io/projected/55b54275-0333-41b0-bd19-21a54efb5ef8-kube-api-access-8jl5v\") pod \"iptables-alerter-fdhxj\" (UID: \"55b54275-0333-41b0-bd19-21a54efb5ef8\") " pod="openshift-network-operator/iptables-alerter-fdhxj"
Sep 15 12:44:58.697178 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.695022    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-host-run-multus-certs\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.697178 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.695042    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-sys-fs\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.697178 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.695061    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-var-lib-kubelet\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.697178 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.695080    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qht22\" (UniqueName: \"kubernetes.io/projected/bf0cecf6-307b-4722-8430-819b1afe2dff-kube-api-access-qht22\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.697178 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.695102    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.697178 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.695171    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5486db58-30f3-45ce-8ecb-de7cf67208ed-tmp-dir\") pod \"node-resolver-f2f6j\" (UID: \"5486db58-30f3-45ce-8ecb-de7cf67208ed\") " pod="openshift-dns/node-resolver-f2f6j"
Sep 15 12:44:58.697178 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.695180    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d31ad8c3-8e88-4cfe-9cc0-45accff28163-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.697178 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.695236    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ba39148c-16e4-4d97-bc00-ad3586383bdc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.697178 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.695321    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d31ad8c3-8e88-4cfe-9cc0-45accff28163-ovnkube-config\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.697178 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.695603    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ba39148c-16e4-4d97-bc00-ad3586383bdc-cni-binary-copy\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.697680 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.697664    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d31ad8c3-8e88-4cfe-9cc0-45accff28163-ovn-node-metrics-cert\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.697862 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.697843    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/826d3dbd-d234-48bd-b6fe-d426ab919b84-agent-certs\") pod \"konnectivity-agent-d2bpj\" (UID: \"826d3dbd-d234-48bd-b6fe-d426ab919b84\") " pod="kube-system/konnectivity-agent-d2bpj"
Sep 15 12:44:58.706195 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.706171    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rzs8\" (UniqueName: \"kubernetes.io/projected/5486db58-30f3-45ce-8ecb-de7cf67208ed-kube-api-access-5rzs8\") pod \"node-resolver-f2f6j\" (UID: \"5486db58-30f3-45ce-8ecb-de7cf67208ed\") " pod="openshift-dns/node-resolver-f2f6j"
Sep 15 12:44:58.706313 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:58.706220    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 12:44:58.706313 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:58.706240    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 12:44:58.706313 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:58.706252    2567 projected.go:196] Error preparing data for projected volume kube-api-access-msb67 for pod openshift-network-diagnostics/network-check-target-tb86v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:44:58.706462 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:58.706319    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67 podName:b50eaefb-c7d0-4b42-adc8-3e1349c91875 nodeName:}" failed. No retries permitted until 2026-09-15 12:44:59.206300339 +0000 UTC m=+2.927615868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-msb67" (UniqueName: "kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67") pod "network-check-target-tb86v" (UID: "b50eaefb-c7d0-4b42-adc8-3e1349c91875") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:44:58.708387 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.708351    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4pcr\" (UniqueName: \"kubernetes.io/projected/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-kube-api-access-q4pcr\") pod \"network-metrics-daemon-rjf2q\" (UID: \"ae00611b-05f3-44f1-8fde-3eeb385a7ef1\") " pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:44:58.708531 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.708513    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt6j8\" (UniqueName: \"kubernetes.io/projected/ba39148c-16e4-4d97-bc00-ad3586383bdc-kube-api-access-jt6j8\") pod \"multus-additional-cni-plugins-rmdnt\" (UID: \"ba39148c-16e4-4d97-bc00-ad3586383bdc\") " pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.708676 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.708657    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jl5v\" (UniqueName: \"kubernetes.io/projected/55b54275-0333-41b0-bd19-21a54efb5ef8-kube-api-access-8jl5v\") pod \"iptables-alerter-fdhxj\" (UID: \"55b54275-0333-41b0-bd19-21a54efb5ef8\") " pod="openshift-network-operator/iptables-alerter-fdhxj"
Sep 15 12:44:58.710037 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.710001    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw8m5\" (UniqueName: \"kubernetes.io/projected/d31ad8c3-8e88-4cfe-9cc0-45accff28163-kube-api-access-xw8m5\") pod \"ovnkube-node-wv7pg\" (UID: \"d31ad8c3-8e88-4cfe-9cc0-45accff28163\") " pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.710955 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.710912    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal" event={"ID":"d61f3f71a7c2331f1f115ac9c3aa31ce","Type":"ContainerStarted","Data":"be215ba57a92b6193c8ac78efa3332ab50351f77975070f7f1cdeb27a46c4950"}
Sep 15 12:44:58.712499 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.712476    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-48.ec2.internal" event={"ID":"19e9bd3d9e4c4d8228116fb4b9295f1a","Type":"ContainerStarted","Data":"ff94c0fbbe8de3a26b5970cd155819694df029c782b98b108e48e71caba235e1"}
Sep 15 12:44:58.795621 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795586    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b21d4a34-9489-4099-8eef-89a54d5e9fc1-host\") pod \"node-ca-mqrsx\" (UID: \"b21d4a34-9489-4099-8eef-89a54d5e9fc1\") " pod="openshift-image-registry/node-ca-mqrsx"
Sep 15 12:44:58.795621 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795618    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b21d4a34-9489-4099-8eef-89a54d5e9fc1-serviceca\") pod \"node-ca-mqrsx\" (UID: \"b21d4a34-9489-4099-8eef-89a54d5e9fc1\") " pod="openshift-image-registry/node-ca-mqrsx"
Sep 15 12:44:58.795866 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795655    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-multus-socket-dir-parent\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.795866 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795709    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-systemd\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.795866 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795741    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-system-cni-dir\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.795866 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795752    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-multus-socket-dir-parent\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.795866 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795763    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-etc-kubernetes\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.795866 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795790    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/048c8d38-9a54-4ece-9887-db9382ceee1f-dbus\") pod \"global-pull-secret-syncer-4gb4s\" (UID: \"048c8d38-9a54-4ece-9887-db9382ceee1f\") " pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:44:58.795866 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795812    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-sysctl-conf\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.795866 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795833    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-run\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.795866 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795865    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-host-run-k8s-cni-cncf-io\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.796320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795883    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-systemd\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.796320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795898    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-system-cni-dir\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.796320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795890    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-cnibin\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.796320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795918    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/048c8d38-9a54-4ece-9887-db9382ceee1f-dbus\") pod \"global-pull-secret-syncer-4gb4s\" (UID: \"048c8d38-9a54-4ece-9887-db9382ceee1f\") " pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:44:58.796320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795944    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-cnibin\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.796320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795946    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.796320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795956    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-run\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.796320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795959    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-etc-kubernetes\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.796320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.795996    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-host-var-lib-cni-bin\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.796320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796010    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.796320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796021    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-multus-conf-dir\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.796320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796045    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffjpd\" (UniqueName: \"kubernetes.io/projected/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-kube-api-access-ffjpd\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.796320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796060    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-host-var-lib-cni-bin\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.796320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796067    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-multus-conf-dir\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.796320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796011    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-host-run-k8s-cni-cncf-io\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.796320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796068    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-socket-dir\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.796320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796102    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-sysctl-conf\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.796320 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796107    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-multus-cni-dir\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.797292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796140    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-host-var-lib-kubelet\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.797292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796152    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-multus-cni-dir\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.797292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796165    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-registration-dir\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.797292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796189    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-host-var-lib-kubelet\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.797292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796191    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-etc-selinux\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.797292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796200    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-socket-dir\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.797292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796205    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b21d4a34-9489-4099-8eef-89a54d5e9fc1-serviceca\") pod \"node-ca-mqrsx\" (UID: \"b21d4a34-9489-4099-8eef-89a54d5e9fc1\") " pod="openshift-image-registry/node-ca-mqrsx"
Sep 15 12:44:58.797292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796233    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-etc-selinux\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.797292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796222    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-host-var-lib-cni-multus\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.797292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796253    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-host-var-lib-cni-multus\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.797292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796258    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-registration-dir\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.797292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796270    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-device-dir\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.797292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796290    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-tuned\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.797292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796305    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-host-run-netns\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.797292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796319    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-sys\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.797292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796337    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-device-dir\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.797292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796342    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-host\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.797917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796375    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-cni-binary-copy\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.797917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796379    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-host\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.797917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796387    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-host-run-netns\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.797917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796400    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-hostroot\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.797917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796422    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-sys\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.797917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796424    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf0cecf6-307b-4722-8430-819b1afe2dff-tmp\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.797917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796456    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-host-run-multus-certs\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.797917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796480    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-sys-fs\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.797917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796503    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-var-lib-kubelet\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.797917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796522    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-hostroot\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.797917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796529    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qht22\" (UniqueName: \"kubernetes.io/projected/bf0cecf6-307b-4722-8430-819b1afe2dff-kube-api-access-qht22\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.797917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796533    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-host-run-multus-certs\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.797917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796580    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-var-lib-kubelet\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.797917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796565    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-multus-daemon-config\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.797917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796620    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qcfs\" (UniqueName: \"kubernetes.io/projected/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-kube-api-access-4qcfs\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.797917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796647    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-sysconfig\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.797917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796678    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/048c8d38-9a54-4ece-9887-db9382ceee1f-kubelet-config\") pod \"global-pull-secret-syncer-4gb4s\" (UID: \"048c8d38-9a54-4ece-9887-db9382ceee1f\") " pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:44:58.797917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796706    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret\") pod \"global-pull-secret-syncer-4gb4s\" (UID: \"048c8d38-9a54-4ece-9887-db9382ceee1f\") " pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:44:58.798626 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796730    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tksdz\" (UniqueName: \"kubernetes.io/projected/b21d4a34-9489-4099-8eef-89a54d5e9fc1-kube-api-access-tksdz\") pod \"node-ca-mqrsx\" (UID: \"b21d4a34-9489-4099-8eef-89a54d5e9fc1\") " pod="openshift-image-registry/node-ca-mqrsx"
Sep 15 12:44:58.798626 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796754    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-kubernetes\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.798626 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796784    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-modprobe-d\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.798626 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796837    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-sys-fs\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.798626 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796842    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-sysctl-d\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.798626 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796877    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-lib-modules\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.798626 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796963    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-sysctl-d\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.798626 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.796965    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-cni-binary-copy\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.798626 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:58.796963    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 12:44:58.798626 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.797092    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-lib-modules\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.798626 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.797112    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-kubernetes\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.798626 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.797129    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-sysconfig\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.798626 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.797121    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-multus-daemon-config\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.798626 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:58.797159    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret podName:048c8d38-9a54-4ece-9887-db9382ceee1f nodeName:}" failed. No retries permitted until 2026-09-15 12:44:59.297141941 +0000 UTC m=+3.018457467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret") pod "global-pull-secret-syncer-4gb4s" (UID: "048c8d38-9a54-4ece-9887-db9382ceee1f") : object "kube-system"/"original-pull-secret" not registered
Sep 15 12:44:58.798626 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.797174    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b21d4a34-9489-4099-8eef-89a54d5e9fc1-host\") pod \"node-ca-mqrsx\" (UID: \"b21d4a34-9489-4099-8eef-89a54d5e9fc1\") " pod="openshift-image-registry/node-ca-mqrsx"
Sep 15 12:44:58.798626 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.797209    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/048c8d38-9a54-4ece-9887-db9382ceee1f-kubelet-config\") pod \"global-pull-secret-syncer-4gb4s\" (UID: \"048c8d38-9a54-4ece-9887-db9382ceee1f\") " pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:44:58.798626 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.797239    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-modprobe-d\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.799345 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.798955    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf0cecf6-307b-4722-8430-819b1afe2dff-etc-tuned\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.799345 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.799144    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf0cecf6-307b-4722-8430-819b1afe2dff-tmp\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.806045 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.805964    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffjpd\" (UniqueName: \"kubernetes.io/projected/cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5-kube-api-access-ffjpd\") pod \"multus-mpvlq\" (UID: \"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5\") " pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.807609 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.807590    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qcfs\" (UniqueName: \"kubernetes.io/projected/d0e6e48c-80e7-43f0-be2c-a4c7e590a857-kube-api-access-4qcfs\") pod \"aws-ebs-csi-driver-node-ns8p2\" (UID: \"d0e6e48c-80e7-43f0-be2c-a4c7e590a857\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.808067 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.808045    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qht22\" (UniqueName: \"kubernetes.io/projected/bf0cecf6-307b-4722-8430-819b1afe2dff-kube-api-access-qht22\") pod \"tuned-4nflc\" (UID: \"bf0cecf6-307b-4722-8430-819b1afe2dff\") " pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:58.808144 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.808044    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tksdz\" (UniqueName: \"kubernetes.io/projected/b21d4a34-9489-4099-8eef-89a54d5e9fc1-kube-api-access-tksdz\") pod \"node-ca-mqrsx\" (UID: \"b21d4a34-9489-4099-8eef-89a54d5e9fc1\") " pod="openshift-image-registry/node-ca-mqrsx"
Sep 15 12:44:58.884935 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.884858    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:44:58.891615 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.891590    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f2f6j"
Sep 15 12:44:58.901594 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.901571    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rmdnt"
Sep 15 12:44:58.908751 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.908726    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fdhxj"
Sep 15 12:44:58.914472 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.914451    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-d2bpj"
Sep 15 12:44:58.922254 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.922233    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mpvlq"
Sep 15 12:44:58.927927 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.927906    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mqrsx"
Sep 15 12:44:58.935315 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.935297    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2"
Sep 15 12:44:58.940771 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:58.940753    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4nflc"
Sep 15 12:44:59.199421 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:59.199344    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs\") pod \"network-metrics-daemon-rjf2q\" (UID: \"ae00611b-05f3-44f1-8fde-3eeb385a7ef1\") " pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:44:59.199567 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:59.199458    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:44:59.199567 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:59.199507    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs podName:ae00611b-05f3-44f1-8fde-3eeb385a7ef1 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:00.199494698 +0000 UTC m=+3.920810211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs") pod "network-metrics-daemon-rjf2q" (UID: "ae00611b-05f3-44f1-8fde-3eeb385a7ef1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:44:59.299726 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:59.299697    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret\") pod \"global-pull-secret-syncer-4gb4s\" (UID: \"048c8d38-9a54-4ece-9887-db9382ceee1f\") " pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:44:59.299874 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:59.299733    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msb67\" (UniqueName: \"kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67\") pod \"network-check-target-tb86v\" (UID: \"b50eaefb-c7d0-4b42-adc8-3e1349c91875\") " pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:44:59.299874 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:59.299849    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 12:44:59.299947 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:59.299918    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret podName:048c8d38-9a54-4ece-9887-db9382ceee1f nodeName:}" failed. No retries permitted until 2026-09-15 12:45:00.299902874 +0000 UTC m=+4.021218387 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret") pod "global-pull-secret-syncer-4gb4s" (UID: "048c8d38-9a54-4ece-9887-db9382ceee1f") : object "kube-system"/"original-pull-secret" not registered
Sep 15 12:44:59.299947 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:59.299856    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 12:44:59.299947 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:59.299946    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 12:44:59.300083 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:59.299955    2567 projected.go:196] Error preparing data for projected volume kube-api-access-msb67 for pod openshift-network-diagnostics/network-check-target-tb86v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:44:59.300083 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:44:59.300008    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67 podName:b50eaefb-c7d0-4b42-adc8-3e1349c91875 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:00.299997124 +0000 UTC m=+4.021312651 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-msb67" (UniqueName: "kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67") pod "network-check-target-tb86v" (UID: "b50eaefb-c7d0-4b42-adc8-3e1349c91875") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:44:59.334914 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:59.334685    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf2bf6d7_5fe0_4a65_91b9_51e0aaaf38d5.slice/crio-8b772a0d18e73fc13222bbd5593c790c66096216b63dd2c2b9da79ed13b10eee WatchSource:0}: Error finding container 8b772a0d18e73fc13222bbd5593c790c66096216b63dd2c2b9da79ed13b10eee: Status 404 returned error can't find the container with id 8b772a0d18e73fc13222bbd5593c790c66096216b63dd2c2b9da79ed13b10eee
Sep 15 12:44:59.336591 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:59.336567    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0e6e48c_80e7_43f0_be2c_a4c7e590a857.slice/crio-d242d452e8cf7ff310d5788527163cc346c61b16b83fbb3cb4e6e19d778e383b WatchSource:0}: Error finding container d242d452e8cf7ff310d5788527163cc346c61b16b83fbb3cb4e6e19d778e383b: Status 404 returned error can't find the container with id d242d452e8cf7ff310d5788527163cc346c61b16b83fbb3cb4e6e19d778e383b
Sep 15 12:44:59.337618 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:59.337594    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd31ad8c3_8e88_4cfe_9cc0_45accff28163.slice/crio-af7816cd898d9321239d6fb333e53e9465ace6a57ad88ec21e3e265d342cd90f WatchSource:0}: Error finding container af7816cd898d9321239d6fb333e53e9465ace6a57ad88ec21e3e265d342cd90f: Status 404 returned error can't find the container with id af7816cd898d9321239d6fb333e53e9465ace6a57ad88ec21e3e265d342cd90f
Sep 15 12:44:59.338476 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:59.338363    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba39148c_16e4_4d97_bc00_ad3586383bdc.slice/crio-c2781499d21f04ec247de53af2c2a524eab9594b9a201a95e06d4407e744590c WatchSource:0}: Error finding container c2781499d21f04ec247de53af2c2a524eab9594b9a201a95e06d4407e744590c: Status 404 returned error can't find the container with id c2781499d21f04ec247de53af2c2a524eab9594b9a201a95e06d4407e744590c
Sep 15 12:44:59.341118 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:59.341097    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf0cecf6_307b_4722_8430_819b1afe2dff.slice/crio-2c5a134746e4b07e369a6dcb58f0f793977e13e6373de35e73f0629538c1a959 WatchSource:0}: Error finding container 2c5a134746e4b07e369a6dcb58f0f793977e13e6373de35e73f0629538c1a959: Status 404 returned error can't find the container with id 2c5a134746e4b07e369a6dcb58f0f793977e13e6373de35e73f0629538c1a959
Sep 15 12:44:59.341899 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:59.341881    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb21d4a34_9489_4099_8eef_89a54d5e9fc1.slice/crio-c9a77b1c8b188bed77b4c05f42f3dd5771d991783312061f63550b48917fa876 WatchSource:0}: Error finding container c9a77b1c8b188bed77b4c05f42f3dd5771d991783312061f63550b48917fa876: Status 404 returned error can't find the container with id c9a77b1c8b188bed77b4c05f42f3dd5771d991783312061f63550b48917fa876
Sep 15 12:44:59.342780 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:59.342762    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5486db58_30f3_45ce_8ecb_de7cf67208ed.slice/crio-8c2563a82ac1d1bb841c2635fc39ca96015ccfb675eee90eda202c28fb76bcfe WatchSource:0}: Error finding container 8c2563a82ac1d1bb841c2635fc39ca96015ccfb675eee90eda202c28fb76bcfe: Status 404 returned error can't find the container with id 8c2563a82ac1d1bb841c2635fc39ca96015ccfb675eee90eda202c28fb76bcfe
Sep 15 12:44:59.343516 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:59.343492    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod826d3dbd_d234_48bd_b6fe_d426ab919b84.slice/crio-3daaf12213ed32e31c0154b094c68d7fa431710a1df3b782b0778ae880537c46 WatchSource:0}: Error finding container 3daaf12213ed32e31c0154b094c68d7fa431710a1df3b782b0778ae880537c46: Status 404 returned error can't find the container with id 3daaf12213ed32e31c0154b094c68d7fa431710a1df3b782b0778ae880537c46
Sep 15 12:44:59.345303 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:44:59.345283    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55b54275_0333_41b0_bd19_21a54efb5ef8.slice/crio-d40d64e6edb7756df609ac341ae0c26e8b4f75c9b6b5a06c12ad6800b8ff916f WatchSource:0}: Error finding container d40d64e6edb7756df609ac341ae0c26e8b4f75c9b6b5a06c12ad6800b8ff916f: Status 404 returned error can't find the container with id d40d64e6edb7756df609ac341ae0c26e8b4f75c9b6b5a06c12ad6800b8ff916f
Sep 15 12:44:59.652167 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:59.652072    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 12:39:58 +0000 UTC" deadline="2028-04-28 00:16:17.099144345 +0000 UTC"
Sep 15 12:44:59.652167 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:59.652106    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14171h31m17.447041885s"
Sep 15 12:44:59.716494 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:59.716450    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mqrsx" event={"ID":"b21d4a34-9489-4099-8eef-89a54d5e9fc1","Type":"ContainerStarted","Data":"c9a77b1c8b188bed77b4c05f42f3dd5771d991783312061f63550b48917fa876"}
Sep 15 12:44:59.718140 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:59.718109    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4nflc" event={"ID":"bf0cecf6-307b-4722-8430-819b1afe2dff","Type":"ContainerStarted","Data":"2c5a134746e4b07e369a6dcb58f0f793977e13e6373de35e73f0629538c1a959"}
Sep 15 12:44:59.728597 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:59.723687    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rmdnt" event={"ID":"ba39148c-16e4-4d97-bc00-ad3586383bdc","Type":"ContainerStarted","Data":"c2781499d21f04ec247de53af2c2a524eab9594b9a201a95e06d4407e744590c"}
Sep 15 12:44:59.728597 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:59.727326    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg" event={"ID":"d31ad8c3-8e88-4cfe-9cc0-45accff28163","Type":"ContainerStarted","Data":"af7816cd898d9321239d6fb333e53e9465ace6a57ad88ec21e3e265d342cd90f"}
Sep 15 12:44:59.730621 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:59.730540    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2" event={"ID":"d0e6e48c-80e7-43f0-be2c-a4c7e590a857","Type":"ContainerStarted","Data":"d242d452e8cf7ff310d5788527163cc346c61b16b83fbb3cb4e6e19d778e383b"}
Sep 15 12:44:59.732223 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:59.732200    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d2bpj" event={"ID":"826d3dbd-d234-48bd-b6fe-d426ab919b84","Type":"ContainerStarted","Data":"3daaf12213ed32e31c0154b094c68d7fa431710a1df3b782b0778ae880537c46"}
Sep 15 12:44:59.734195 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:59.734167    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mpvlq" event={"ID":"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5","Type":"ContainerStarted","Data":"8b772a0d18e73fc13222bbd5593c790c66096216b63dd2c2b9da79ed13b10eee"}
Sep 15 12:44:59.738029 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:59.737414    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-48.ec2.internal" event={"ID":"19e9bd3d9e4c4d8228116fb4b9295f1a","Type":"ContainerStarted","Data":"b35ffacc603f125e43acf619cc1ef7a2801dcae67987545f61d01ead33de744b"}
Sep 15 12:44:59.739331 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:59.739277    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fdhxj" event={"ID":"55b54275-0333-41b0-bd19-21a54efb5ef8","Type":"ContainerStarted","Data":"d40d64e6edb7756df609ac341ae0c26e8b4f75c9b6b5a06c12ad6800b8ff916f"}
Sep 15 12:44:59.741609 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:59.741529    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f2f6j" event={"ID":"5486db58-30f3-45ce-8ecb-de7cf67208ed","Type":"ContainerStarted","Data":"8c2563a82ac1d1bb841c2635fc39ca96015ccfb675eee90eda202c28fb76bcfe"}
Sep 15 12:44:59.753741 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:44:59.753676    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-48.ec2.internal" podStartSLOduration=1.753658905 podStartE2EDuration="1.753658905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:44:59.752946065 +0000 UTC m=+3.474261597" watchObservedRunningTime="2026-09-15 12:44:59.753658905 +0000 UTC m=+3.474974434"
Sep 15 12:45:00.206657 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:00.206626    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs\") pod \"network-metrics-daemon-rjf2q\" (UID: \"ae00611b-05f3-44f1-8fde-3eeb385a7ef1\") " pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:00.206836 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:00.206818    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:45:00.206894 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:00.206879    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs podName:ae00611b-05f3-44f1-8fde-3eeb385a7ef1 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:02.206861175 +0000 UTC m=+5.928176703 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs") pod "network-metrics-daemon-rjf2q" (UID: "ae00611b-05f3-44f1-8fde-3eeb385a7ef1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:45:00.307226 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:00.307186    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret\") pod \"global-pull-secret-syncer-4gb4s\" (UID: \"048c8d38-9a54-4ece-9887-db9382ceee1f\") " pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:00.307420 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:00.307248    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msb67\" (UniqueName: \"kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67\") pod \"network-check-target-tb86v\" (UID: \"b50eaefb-c7d0-4b42-adc8-3e1349c91875\") " pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:00.307420 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:00.307387    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 12:45:00.307420 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:00.307407    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 12:45:00.307420 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:00.307420    2567 projected.go:196] Error preparing data for projected volume kube-api-access-msb67 for pod openshift-network-diagnostics/network-check-target-tb86v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:45:00.307630 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:00.307476    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67 podName:b50eaefb-c7d0-4b42-adc8-3e1349c91875 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:02.307459243 +0000 UTC m=+6.028774757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-msb67" (UniqueName: "kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67") pod "network-check-target-tb86v" (UID: "b50eaefb-c7d0-4b42-adc8-3e1349c91875") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:45:00.307876 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:00.307856    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 12:45:00.307951 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:00.307910    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret podName:048c8d38-9a54-4ece-9887-db9382ceee1f nodeName:}" failed. No retries permitted until 2026-09-15 12:45:02.307896301 +0000 UTC m=+6.029211817 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret") pod "global-pull-secret-syncer-4gb4s" (UID: "048c8d38-9a54-4ece-9887-db9382ceee1f") : object "kube-system"/"original-pull-secret" not registered
Sep 15 12:45:00.563781 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:00.563535    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 12:45:00.652762 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:00.652599    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 12:39:58 +0000 UTC" deadline="2028-05-29 07:39:26.175210496 +0000 UTC"
Sep 15 12:45:00.652762 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:00.652675    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14922h54m25.522539922s"
Sep 15 12:45:00.709521 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:00.709490    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:00.709674 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:00.709632    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjf2q" podUID="ae00611b-05f3-44f1-8fde-3eeb385a7ef1"
Sep 15 12:45:00.710262 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:00.710075    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:00.710262 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:00.710172    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gb4s" podUID="048c8d38-9a54-4ece-9887-db9382ceee1f"
Sep 15 12:45:00.710679 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:00.710550    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:00.710679 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:00.710644    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb86v" podUID="b50eaefb-c7d0-4b42-adc8-3e1349c91875"
Sep 15 12:45:02.223642 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:02.222945    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs\") pod \"network-metrics-daemon-rjf2q\" (UID: \"ae00611b-05f3-44f1-8fde-3eeb385a7ef1\") " pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:02.223642 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:02.223233    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:45:02.223642 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:02.223302    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs podName:ae00611b-05f3-44f1-8fde-3eeb385a7ef1 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:06.223282831 +0000 UTC m=+9.944598345 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs") pod "network-metrics-daemon-rjf2q" (UID: "ae00611b-05f3-44f1-8fde-3eeb385a7ef1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:45:02.324344 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:02.324312    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret\") pod \"global-pull-secret-syncer-4gb4s\" (UID: \"048c8d38-9a54-4ece-9887-db9382ceee1f\") " pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:02.324500 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:02.324357    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msb67\" (UniqueName: \"kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67\") pod \"network-check-target-tb86v\" (UID: \"b50eaefb-c7d0-4b42-adc8-3e1349c91875\") " pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:02.324500 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:02.324488    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 12:45:02.324500 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:02.324502    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 12:45:02.324658 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:02.324511    2567 projected.go:196] Error preparing data for projected volume kube-api-access-msb67 for pod openshift-network-diagnostics/network-check-target-tb86v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:45:02.324658 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:02.324552    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67 podName:b50eaefb-c7d0-4b42-adc8-3e1349c91875 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:06.324538857 +0000 UTC m=+10.045854380 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-msb67" (UniqueName: "kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67") pod "network-check-target-tb86v" (UID: "b50eaefb-c7d0-4b42-adc8-3e1349c91875") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:45:02.324930 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:02.324881    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 12:45:02.324930 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:02.324922    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret podName:048c8d38-9a54-4ece-9887-db9382ceee1f nodeName:}" failed. No retries permitted until 2026-09-15 12:45:06.324912065 +0000 UTC m=+10.046227575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret") pod "global-pull-secret-syncer-4gb4s" (UID: "048c8d38-9a54-4ece-9887-db9382ceee1f") : object "kube-system"/"original-pull-secret" not registered
Sep 15 12:45:02.710790 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:02.710714    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:02.710944 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:02.710843    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gb4s" podUID="048c8d38-9a54-4ece-9887-db9382ceee1f"
Sep 15 12:45:02.711288 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:02.711269    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:02.711404 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:02.711379    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjf2q" podUID="ae00611b-05f3-44f1-8fde-3eeb385a7ef1"
Sep 15 12:45:02.711474 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:02.711431    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:02.711528 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:02.711502    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb86v" podUID="b50eaefb-c7d0-4b42-adc8-3e1349c91875"
Sep 15 12:45:04.707602 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:04.707571    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:04.708023 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:04.707691    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb86v" podUID="b50eaefb-c7d0-4b42-adc8-3e1349c91875"
Sep 15 12:45:04.708105 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:04.708088    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:04.708202 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:04.708184    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gb4s" podUID="048c8d38-9a54-4ece-9887-db9382ceee1f"
Sep 15 12:45:04.708237 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:04.708230    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:04.708335 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:04.708303    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjf2q" podUID="ae00611b-05f3-44f1-8fde-3eeb385a7ef1"
Sep 15 12:45:06.256962 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:06.256883    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs\") pod \"network-metrics-daemon-rjf2q\" (UID: \"ae00611b-05f3-44f1-8fde-3eeb385a7ef1\") " pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:06.257554 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:06.257064    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:45:06.257554 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:06.257139    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs podName:ae00611b-05f3-44f1-8fde-3eeb385a7ef1 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:14.257118545 +0000 UTC m=+17.978434079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs") pod "network-metrics-daemon-rjf2q" (UID: "ae00611b-05f3-44f1-8fde-3eeb385a7ef1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:45:06.357707 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:06.357670    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msb67\" (UniqueName: \"kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67\") pod \"network-check-target-tb86v\" (UID: \"b50eaefb-c7d0-4b42-adc8-3e1349c91875\") " pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:06.357876 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:06.357772    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret\") pod \"global-pull-secret-syncer-4gb4s\" (UID: \"048c8d38-9a54-4ece-9887-db9382ceee1f\") " pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:06.357876 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:06.357857    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 12:45:06.358012 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:06.357887    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 12:45:06.358012 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:06.357900    2567 projected.go:196] Error preparing data for projected volume kube-api-access-msb67 for pod openshift-network-diagnostics/network-check-target-tb86v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:45:06.358012 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:06.357961    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67 podName:b50eaefb-c7d0-4b42-adc8-3e1349c91875 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:14.357942957 +0000 UTC m=+18.079258483 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-msb67" (UniqueName: "kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67") pod "network-check-target-tb86v" (UID: "b50eaefb-c7d0-4b42-adc8-3e1349c91875") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:45:06.358294 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:06.357862    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 12:45:06.358372 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:06.358333    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret podName:048c8d38-9a54-4ece-9887-db9382ceee1f nodeName:}" failed. No retries permitted until 2026-09-15 12:45:14.358317161 +0000 UTC m=+18.079632687 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret") pod "global-pull-secret-syncer-4gb4s" (UID: "048c8d38-9a54-4ece-9887-db9382ceee1f") : object "kube-system"/"original-pull-secret" not registered
Sep 15 12:45:06.709227 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:06.708217    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:06.709227 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:06.708331    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gb4s" podUID="048c8d38-9a54-4ece-9887-db9382ceee1f"
Sep 15 12:45:06.709227 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:06.708961    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:06.709227 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:06.709083    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjf2q" podUID="ae00611b-05f3-44f1-8fde-3eeb385a7ef1"
Sep 15 12:45:06.709227 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:06.709145    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:06.709227 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:06.709216    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb86v" podUID="b50eaefb-c7d0-4b42-adc8-3e1349c91875"
Sep 15 12:45:08.707770 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:08.707738    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:08.708249 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:08.707749    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:08.708249 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:08.707872    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjf2q" podUID="ae00611b-05f3-44f1-8fde-3eeb385a7ef1"
Sep 15 12:45:08.708249 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:08.707945    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gb4s" podUID="048c8d38-9a54-4ece-9887-db9382ceee1f"
Sep 15 12:45:08.708249 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:08.707749    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:08.708249 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:08.708057    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb86v" podUID="b50eaefb-c7d0-4b42-adc8-3e1349c91875"
Sep 15 12:45:10.707045 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:10.707005    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:10.707605 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:10.707005    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:10.707605 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:10.707137    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjf2q" podUID="ae00611b-05f3-44f1-8fde-3eeb385a7ef1"
Sep 15 12:45:10.707605 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:10.707189    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gb4s" podUID="048c8d38-9a54-4ece-9887-db9382ceee1f"
Sep 15 12:45:10.707605 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:10.707018    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:10.707605 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:10.707258    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb86v" podUID="b50eaefb-c7d0-4b42-adc8-3e1349c91875"
Sep 15 12:45:12.707219 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:12.707180    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:12.707672 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:12.707218    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:12.707672 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:12.707180    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:12.707672 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:12.707317    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gb4s" podUID="048c8d38-9a54-4ece-9887-db9382ceee1f"
Sep 15 12:45:12.707672 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:12.707403    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjf2q" podUID="ae00611b-05f3-44f1-8fde-3eeb385a7ef1"
Sep 15 12:45:12.707672 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:12.707478    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb86v" podUID="b50eaefb-c7d0-4b42-adc8-3e1349c91875"
Sep 15 12:45:14.317753 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:14.317720    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs\") pod \"network-metrics-daemon-rjf2q\" (UID: \"ae00611b-05f3-44f1-8fde-3eeb385a7ef1\") " pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:14.318222 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:14.317861    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:45:14.318222 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:14.317937    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs podName:ae00611b-05f3-44f1-8fde-3eeb385a7ef1 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:30.317915435 +0000 UTC m=+34.039230946 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs") pod "network-metrics-daemon-rjf2q" (UID: "ae00611b-05f3-44f1-8fde-3eeb385a7ef1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:45:14.418246 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:14.418214    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret\") pod \"global-pull-secret-syncer-4gb4s\" (UID: \"048c8d38-9a54-4ece-9887-db9382ceee1f\") " pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:14.418407 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:14.418261    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msb67\" (UniqueName: \"kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67\") pod \"network-check-target-tb86v\" (UID: \"b50eaefb-c7d0-4b42-adc8-3e1349c91875\") " pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:14.418407 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:14.418370    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 12:45:14.418541 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:14.418411    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 12:45:14.418541 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:14.418429    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 12:45:14.418541 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:14.418442    2567 projected.go:196] Error preparing data for projected volume kube-api-access-msb67 for pod openshift-network-diagnostics/network-check-target-tb86v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:45:14.418541 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:14.418446    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret podName:048c8d38-9a54-4ece-9887-db9382ceee1f nodeName:}" failed. No retries permitted until 2026-09-15 12:45:30.418427779 +0000 UTC m=+34.139743295 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret") pod "global-pull-secret-syncer-4gb4s" (UID: "048c8d38-9a54-4ece-9887-db9382ceee1f") : object "kube-system"/"original-pull-secret" not registered
Sep 15 12:45:14.418541 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:14.418490    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67 podName:b50eaefb-c7d0-4b42-adc8-3e1349c91875 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:30.418475513 +0000 UTC m=+34.139791027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-msb67" (UniqueName: "kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67") pod "network-check-target-tb86v" (UID: "b50eaefb-c7d0-4b42-adc8-3e1349c91875") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:45:14.707237 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:14.707200    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:14.707237 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:14.707238    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:14.707465 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:14.707207    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:14.707465 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:14.707325    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb86v" podUID="b50eaefb-c7d0-4b42-adc8-3e1349c91875"
Sep 15 12:45:14.707465 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:14.707433    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjf2q" podUID="ae00611b-05f3-44f1-8fde-3eeb385a7ef1"
Sep 15 12:45:14.707615 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:14.707521    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gb4s" podUID="048c8d38-9a54-4ece-9887-db9382ceee1f"
Sep 15 12:45:16.708398 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:16.708364    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:16.708837 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:16.708475    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:16.708837 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:16.708480    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gb4s" podUID="048c8d38-9a54-4ece-9887-db9382ceee1f"
Sep 15 12:45:16.708837 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:16.708513    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:16.708837 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:16.708586    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjf2q" podUID="ae00611b-05f3-44f1-8fde-3eeb385a7ef1"
Sep 15 12:45:16.708837 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:16.708653    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb86v" podUID="b50eaefb-c7d0-4b42-adc8-3e1349c91875"
Sep 15 12:45:17.788716 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:17.788235    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4nflc" event={"ID":"bf0cecf6-307b-4722-8430-819b1afe2dff","Type":"ContainerStarted","Data":"1445f817a670802fe3135cefa9b1f0fd921d403b1f02d519375ab19c16100d0a"}
Sep 15 12:45:17.791032 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:17.791005    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg" event={"ID":"d31ad8c3-8e88-4cfe-9cc0-45accff28163","Type":"ContainerStarted","Data":"8cf564162fb2a7ef387db85b8af21edeb499004701cc3e619a8c890669a050fc"}
Sep 15 12:45:17.791120 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:17.791079    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg" event={"ID":"d31ad8c3-8e88-4cfe-9cc0-45accff28163","Type":"ContainerStarted","Data":"aa26fe53c15cb735da11cd13860319065a30d7358c9a29086b2c2055342826b8"}
Sep 15 12:45:17.791120 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:17.791113    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg" event={"ID":"d31ad8c3-8e88-4cfe-9cc0-45accff28163","Type":"ContainerStarted","Data":"db87aa16f902870fd1d92c84f7f75d1632a34bac8ce236960f2b55d5a8d2ad2f"}
Sep 15 12:45:17.791197 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:17.791145    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg" event={"ID":"d31ad8c3-8e88-4cfe-9cc0-45accff28163","Type":"ContainerStarted","Data":"a0e9c42f7ecff3e710e53ddf649a057853c73535680ac7a3cc41c89ac88bba6a"}
Sep 15 12:45:17.792400 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:17.792380    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mpvlq" event={"ID":"cf2bf6d7-5fe0-4a65-91b9-51e0aaaf38d5","Type":"ContainerStarted","Data":"f7e319e504dfdacdce72c0af4235aeb675f613fee3ab6bc0aae136bb09582cae"}
Sep 15 12:45:17.807166 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:17.807116    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4nflc" podStartSLOduration=3.817896776 podStartE2EDuration="21.807099027s" totalImagesPullingTime="17.989202251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:17.806740195 +0000 UTC m=+21.528055727" watchObservedRunningTime="2026-09-15 12:45:17.807099027 +0000 UTC m=+21.528414561"
Sep 15 12:45:17.825443 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:17.825378    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mpvlq" podStartSLOduration=3.792008747 podStartE2EDuration="21.825360214s" totalImagesPullingTime="18.033351467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:17.82523466 +0000 UTC m=+21.546550192" watchObservedRunningTime="2026-09-15 12:45:17.825360214 +0000 UTC m=+21.546675747"
Sep 15 12:45:18.707356 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:18.707325    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:18.707523 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:18.707330    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:18.707523 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:18.707419    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gb4s" podUID="048c8d38-9a54-4ece-9887-db9382ceee1f"
Sep 15 12:45:18.707523 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:18.707438    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:18.707633 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:18.707516    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjf2q" podUID="ae00611b-05f3-44f1-8fde-3eeb385a7ef1"
Sep 15 12:45:18.707633 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:18.707582    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb86v" podUID="b50eaefb-c7d0-4b42-adc8-3e1349c91875"
Sep 15 12:45:18.797950 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:18.797918    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fdhxj" event={"ID":"55b54275-0333-41b0-bd19-21a54efb5ef8","Type":"ContainerStarted","Data":"62e7023ab483f22175876ae349aad1ad72c795d23fb70b686edc2892bf627076"}
Sep 15 12:45:18.799402 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:18.799379    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f2f6j" event={"ID":"5486db58-30f3-45ce-8ecb-de7cf67208ed","Type":"ContainerStarted","Data":"eec41206e3091c492ae22fc4938b67cfd16c71b806cdf3d1e592c5854047f354"}
Sep 15 12:45:18.800651 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:18.800632    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mqrsx" event={"ID":"b21d4a34-9489-4099-8eef-89a54d5e9fc1","Type":"ContainerStarted","Data":"4f1348df902ea36e3ebb8b584d9ee868e2936a8f97c1558d3ceafbb554ea8f3b"}
Sep 15 12:45:18.802085 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:18.802066    2567 generic.go:356] "Generic (PLEG): container finished" podID="ba39148c-16e4-4d97-bc00-ad3586383bdc" containerID="26706c4ddbb3338aaf674689b902c9856730f059375637f2ed21370ad3cef519" exitCode=0
Sep 15 12:45:18.802187 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:18.802128    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rmdnt" event={"ID":"ba39148c-16e4-4d97-bc00-ad3586383bdc","Type":"ContainerDied","Data":"26706c4ddbb3338aaf674689b902c9856730f059375637f2ed21370ad3cef519"}
Sep 15 12:45:18.805526 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:18.805500    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg" event={"ID":"d31ad8c3-8e88-4cfe-9cc0-45accff28163","Type":"ContainerStarted","Data":"ab7f9979cf4c653fe2cefc6c1b2f3a5fe9807e72a00e394dccac8f688587a87a"}
Sep 15 12:45:18.805619 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:18.805557    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg" event={"ID":"d31ad8c3-8e88-4cfe-9cc0-45accff28163","Type":"ContainerStarted","Data":"a934a7c3c65a52c0e1d73bc8dd5a6f8413c4233caea7e314eb4e7b77dd83a34a"}
Sep 15 12:45:18.806808 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:18.806792    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2" event={"ID":"d0e6e48c-80e7-43f0-be2c-a4c7e590a857","Type":"ContainerStarted","Data":"9c092a6a2d5d99a7557523e586d55ce9181304270deabf3b1dce65f9e023fd5a"}
Sep 15 12:45:18.808271 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:18.808249    2567 generic.go:356] "Generic (PLEG): container finished" podID="d61f3f71a7c2331f1f115ac9c3aa31ce" containerID="6499da5474bf1e8ab590327f9d96dbefb1803b45e721baabb96eb1bbd5b02ebd" exitCode=0
Sep 15 12:45:18.808363 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:18.808313    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal" event={"ID":"d61f3f71a7c2331f1f115ac9c3aa31ce","Type":"ContainerDied","Data":"6499da5474bf1e8ab590327f9d96dbefb1803b45e721baabb96eb1bbd5b02ebd"}
Sep 15 12:45:18.809904 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:18.809882    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-d2bpj" event={"ID":"826d3dbd-d234-48bd-b6fe-d426ab919b84","Type":"ContainerStarted","Data":"c34c52debeb15afcb0c19a754d6d40c16104cfb0d64a7af09387ed54b21ae6f3"}
Sep 15 12:45:18.828517 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:18.828485    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mqrsx" podStartSLOduration=4.855546515 podStartE2EDuration="22.828473113s" totalImagesPullingTime="17.972926598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:18.828370074 +0000 UTC m=+22.549685605" watchObservedRunningTime="2026-09-15 12:45:18.828473113 +0000 UTC m=+22.549788641"
Sep 15 12:45:18.828689 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:18.828665    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fdhxj" podStartSLOduration=4.861015426 podStartE2EDuration="22.828659315s" totalImagesPullingTime="17.967643889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:18.814625462 +0000 UTC m=+22.535940993" watchObservedRunningTime="2026-09-15 12:45:18.828659315 +0000 UTC m=+22.549974845"
Sep 15 12:45:18.896732 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:18.896688    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f2f6j" podStartSLOduration=4.918887167 podStartE2EDuration="22.896673845s" totalImagesPullingTime="17.977786678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:18.896637472 +0000 UTC m=+22.617953002" watchObservedRunningTime="2026-09-15 12:45:18.896673845 +0000 UTC m=+22.617989375"
Sep 15 12:45:18.897158 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:18.897127    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-d2bpj" podStartSLOduration=4.929023971 podStartE2EDuration="22.897120299s" totalImagesPullingTime="17.968096328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:18.882551646 +0000 UTC m=+22.603867160" watchObservedRunningTime="2026-09-15 12:45:18.897120299 +0000 UTC m=+22.618435830"
Sep 15 12:45:19.568373 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:19.568340    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-d2bpj"
Sep 15 12:45:19.569251 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:19.569219    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-d2bpj"
Sep 15 12:45:19.815044 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:19.815001    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal" event={"ID":"d61f3f71a7c2331f1f115ac9c3aa31ce","Type":"ContainerStarted","Data":"e33ce0e6cb28398fa5aaabf8e019fea1608118c9342fc2a53bd2dbaf36a00fff"}
Sep 15 12:45:19.830872 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:19.830782    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-48.ec2.internal" podStartSLOduration=21.830766076 podStartE2EDuration="21.830766076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:19.830522799 +0000 UTC m=+23.551838334" watchObservedRunningTime="2026-09-15 12:45:19.830766076 +0000 UTC m=+23.552081606"
Sep 15 12:45:20.359055 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:20.358862    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 12:45:20.645284 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:20.645112    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T12:45:20.35904988Z","UUID":"bc397419-0e64-487b-afb2-161ec42ca7e1","Handler":null,"Name":"","Endpoint":""}
Sep 15 12:45:20.648545 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:20.648517    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 12:45:20.648730 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:20.648556    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 12:45:20.707108 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:20.707073    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:20.707293 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:20.707073    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:20.707293 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:20.707204    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjf2q" podUID="ae00611b-05f3-44f1-8fde-3eeb385a7ef1"
Sep 15 12:45:20.707293 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:20.707079    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:20.707401 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:20.707298    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb86v" podUID="b50eaefb-c7d0-4b42-adc8-3e1349c91875"
Sep 15 12:45:20.707401 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:20.707344    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gb4s" podUID="048c8d38-9a54-4ece-9887-db9382ceee1f"
Sep 15 12:45:20.822389 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:20.822348    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg" event={"ID":"d31ad8c3-8e88-4cfe-9cc0-45accff28163","Type":"ContainerStarted","Data":"55cd6cbd142cff8ff758b9fc28a1214a869999a99e4c923d3cec927873248752"}
Sep 15 12:45:20.824828 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:20.824758    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2" event={"ID":"d0e6e48c-80e7-43f0-be2c-a4c7e590a857","Type":"ContainerStarted","Data":"2f1ae76223fe688b7da062ca7f0ac22779e1be87f03dd2243fc408593ffa677d"}
Sep 15 12:45:20.825028 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:20.825010    2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 15 12:45:22.707232 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:22.707202    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:22.707232 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:22.707224    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:22.707622 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:22.707312    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gb4s" podUID="048c8d38-9a54-4ece-9887-db9382ceee1f"
Sep 15 12:45:22.707676 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:22.707649    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjf2q" podUID="ae00611b-05f3-44f1-8fde-3eeb385a7ef1"
Sep 15 12:45:22.707796 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:22.707697    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:22.707796 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:22.707772    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb86v" podUID="b50eaefb-c7d0-4b42-adc8-3e1349c91875"
Sep 15 12:45:23.833414 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:23.833211    2567 generic.go:356] "Generic (PLEG): container finished" podID="ba39148c-16e4-4d97-bc00-ad3586383bdc" containerID="9e771d940a46090dfaa8ac4ce4a6147c4b83564933183df514880badc3cbcb5c" exitCode=0
Sep 15 12:45:23.833955 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:23.833295    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rmdnt" event={"ID":"ba39148c-16e4-4d97-bc00-ad3586383bdc","Type":"ContainerDied","Data":"9e771d940a46090dfaa8ac4ce4a6147c4b83564933183df514880badc3cbcb5c"}
Sep 15 12:45:23.837362 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:23.837340    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg" event={"ID":"d31ad8c3-8e88-4cfe-9cc0-45accff28163","Type":"ContainerStarted","Data":"40fbe014829a7ba1ae24fb03081483d2ddba33a00f12e20d093bba4f835b4a35"}
Sep 15 12:45:23.837705 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:23.837688    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:45:23.837924 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:23.837751    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:45:23.837924 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:23.837799    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:45:23.839584 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:23.839567    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2" event={"ID":"d0e6e48c-80e7-43f0-be2c-a4c7e590a857","Type":"ContainerStarted","Data":"87529d0ccba1300fc06d54a57d42b8feb893b20355cfe66c4624c39e193ebc0d"}
Sep 15 12:45:23.852611 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:23.852589    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:45:23.852701 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:23.852686    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:45:23.884063 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:23.884023    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg" podStartSLOduration=9.853825962 podStartE2EDuration="27.884011904s" totalImagesPullingTime="18.030185942s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:23.883060658 +0000 UTC m=+27.604376189" watchObservedRunningTime="2026-09-15 12:45:23.884011904 +0000 UTC m=+27.605327435"
Sep 15 12:45:23.900247 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:23.900205    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ns8p2" podStartSLOduration=5.156197661 podStartE2EDuration="27.900193429s" totalImagesPullingTime="22.743995768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:23.899941511 +0000 UTC m=+27.621257043" watchObservedRunningTime="2026-09-15 12:45:23.900193429 +0000 UTC m=+27.621508957"
Sep 15 12:45:24.707241 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:24.707214    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:24.707406 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:24.707257    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:24.707406 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:24.707328    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:24.707406 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:24.707342    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb86v" podUID="b50eaefb-c7d0-4b42-adc8-3e1349c91875"
Sep 15 12:45:24.707529 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:24.707466    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gb4s" podUID="048c8d38-9a54-4ece-9887-db9382ceee1f"
Sep 15 12:45:24.707591 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:24.707571    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjf2q" podUID="ae00611b-05f3-44f1-8fde-3eeb385a7ef1"
Sep 15 12:45:24.843656 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:24.843590    2567 generic.go:356] "Generic (PLEG): container finished" podID="ba39148c-16e4-4d97-bc00-ad3586383bdc" containerID="fb58a808a5c1424b5fd2b52436fa8425c93ce981fc6d0e3b3feec1dc0c607271" exitCode=0
Sep 15 12:45:24.844318 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:24.843653    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rmdnt" event={"ID":"ba39148c-16e4-4d97-bc00-ad3586383bdc","Type":"ContainerDied","Data":"fb58a808a5c1424b5fd2b52436fa8425c93ce981fc6d0e3b3feec1dc0c607271"}
Sep 15 12:45:24.996333 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:24.996148    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tb86v"]
Sep 15 12:45:24.996462 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:24.996422    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:24.996518 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:24.996500    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb86v" podUID="b50eaefb-c7d0-4b42-adc8-3e1349c91875"
Sep 15 12:45:24.999494 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:24.999467    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rjf2q"]
Sep 15 12:45:24.999625 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:24.999581    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:24.999712 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:24.999689    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjf2q" podUID="ae00611b-05f3-44f1-8fde-3eeb385a7ef1"
Sep 15 12:45:25.000097 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:25.000077    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4gb4s"]
Sep 15 12:45:25.000198 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:25.000153    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:25.000257 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:25.000225    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gb4s" podUID="048c8d38-9a54-4ece-9887-db9382ceee1f"
Sep 15 12:45:26.708407 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:26.708371    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:26.708833 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:26.708453    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gb4s" podUID="048c8d38-9a54-4ece-9887-db9382ceee1f"
Sep 15 12:45:26.708833 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:26.708539    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:26.708833 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:26.708653    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjf2q" podUID="ae00611b-05f3-44f1-8fde-3eeb385a7ef1"
Sep 15 12:45:26.708833 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:26.708669    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:26.708833 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:26.708751    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb86v" podUID="b50eaefb-c7d0-4b42-adc8-3e1349c91875"
Sep 15 12:45:26.850647 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:26.850615    2567 generic.go:356] "Generic (PLEG): container finished" podID="ba39148c-16e4-4d97-bc00-ad3586383bdc" containerID="09b6f71bf431dcabea05c3b77b0b610dee9b2be4c7a02f598873b3ebfd137708" exitCode=0
Sep 15 12:45:26.850812 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:26.850677    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rmdnt" event={"ID":"ba39148c-16e4-4d97-bc00-ad3586383bdc","Type":"ContainerDied","Data":"09b6f71bf431dcabea05c3b77b0b610dee9b2be4c7a02f598873b3ebfd137708"}
Sep 15 12:45:27.264029 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:27.263997    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-d2bpj"
Sep 15 12:45:27.264171 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:27.264151    2567 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 15 12:45:27.264712 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:27.264691    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-d2bpj"
Sep 15 12:45:28.707224 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:28.707196    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:28.707766 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:28.707194    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:28.707766 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:28.707317    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb86v" podUID="b50eaefb-c7d0-4b42-adc8-3e1349c91875"
Sep 15 12:45:28.707766 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:28.707404    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjf2q" podUID="ae00611b-05f3-44f1-8fde-3eeb385a7ef1"
Sep 15 12:45:28.707766 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:28.707208    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:28.707766 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:28.707502    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gb4s" podUID="048c8d38-9a54-4ece-9887-db9382ceee1f"
Sep 15 12:45:29.433021 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:29.432995    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f2f6j_5486db58-30f3-45ce-8ecb-de7cf67208ed/dns-node-resolver/0.log"
Sep 15 12:45:30.334613 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:30.334582    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs\") pod \"network-metrics-daemon-rjf2q\" (UID: \"ae00611b-05f3-44f1-8fde-3eeb385a7ef1\") " pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:30.335062 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:30.334701    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:45:30.335062 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:30.334765    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs podName:ae00611b-05f3-44f1-8fde-3eeb385a7ef1 nodeName:}" failed. No retries permitted until 2026-09-15 12:46:02.334745059 +0000 UTC m=+66.056060569 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs") pod "network-metrics-daemon-rjf2q" (UID: "ae00611b-05f3-44f1-8fde-3eeb385a7ef1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 12:45:30.435017 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:30.434962    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msb67\" (UniqueName: \"kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67\") pod \"network-check-target-tb86v\" (UID: \"b50eaefb-c7d0-4b42-adc8-3e1349c91875\") " pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:30.435187 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:30.435073    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret\") pod \"global-pull-secret-syncer-4gb4s\" (UID: \"048c8d38-9a54-4ece-9887-db9382ceee1f\") " pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:30.435187 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:30.435136    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 12:45:30.435187 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:30.435159    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 12:45:30.435187 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:30.435163    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 12:45:30.435187 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:30.435171    2567 projected.go:196] Error preparing data for projected volume kube-api-access-msb67 for pod openshift-network-diagnostics/network-check-target-tb86v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:45:30.435400 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:30.435214    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret podName:048c8d38-9a54-4ece-9887-db9382ceee1f nodeName:}" failed. No retries permitted until 2026-09-15 12:46:02.435201929 +0000 UTC m=+66.156517444 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret") pod "global-pull-secret-syncer-4gb4s" (UID: "048c8d38-9a54-4ece-9887-db9382ceee1f") : object "kube-system"/"original-pull-secret" not registered
Sep 15 12:45:30.435400 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:30.435234    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67 podName:b50eaefb-c7d0-4b42-adc8-3e1349c91875 nodeName:}" failed. No retries permitted until 2026-09-15 12:46:02.435224208 +0000 UTC m=+66.156539717 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-msb67" (UniqueName: "kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67") pod "network-check-target-tb86v" (UID: "b50eaefb-c7d0-4b42-adc8-3e1349c91875") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 12:45:30.601235 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:30.601164    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mqrsx_b21d4a34-9489-4099-8eef-89a54d5e9fc1/node-ca/0.log"
Sep 15 12:45:30.707236 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:30.707196    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:30.707417 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:30.707196    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:30.707417 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:30.707332    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tb86v" podUID="b50eaefb-c7d0-4b42-adc8-3e1349c91875"
Sep 15 12:45:30.707531 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:30.707453    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4gb4s" podUID="048c8d38-9a54-4ece-9887-db9382ceee1f"
Sep 15 12:45:30.707531 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:30.707205    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:30.707637 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:30.707605    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rjf2q" podUID="ae00611b-05f3-44f1-8fde-3eeb385a7ef1"
Sep 15 12:45:31.034820 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.034792    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-48.ec2.internal" event="NodeReady"
Sep 15 12:45:31.035007 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.034916    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 12:45:31.125433 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.125405    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dzc42"]
Sep 15 12:45:31.136475 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.136454    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:31.139032 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.139010    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2w46l"]
Sep 15 12:45:31.145350 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.145309    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 12:45:31.145452 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.145430    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rtf69\""
Sep 15 12:45:31.145530 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.145517    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 12:45:31.161511 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.161481    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:31.170788 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.170765    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 12:45:31.170907 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.170887    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 12:45:31.173694 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.173670    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dzc42"]
Sep 15 12:45:31.174989 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.174952    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 12:45:31.175848 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.175827    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dmbfk\""
Sep 15 12:45:31.176125 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.176018    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 12:45:31.182771 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.182750    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2w46l"]
Sep 15 12:45:31.187987 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.187951    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j77qb"]
Sep 15 12:45:31.202192 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.202168    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j77qb"
Sep 15 12:45:31.204148 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.204129    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j77qb"]
Sep 15 12:45:31.207156 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.207116    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 12:45:31.207410 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.207383    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h4s4k\""
Sep 15 12:45:31.208013 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.207930    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 12:45:31.208144 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.208123    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 12:45:31.241780 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.241756    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jhfx\" (UniqueName: \"kubernetes.io/projected/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-kube-api-access-9jhfx\") pod \"dns-default-dzc42\" (UID: \"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5\") " pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:31.241898 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.241802    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-config-volume\") pod \"dns-default-dzc42\" (UID: \"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5\") " pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:31.241898 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.241822    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64793d1d-8223-42f3-9e9a-61f328d34f29-crio-socket\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:31.241898 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.241847    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-tmp-dir\") pod \"dns-default-dzc42\" (UID: \"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5\") " pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:31.241898 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.241862    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64793d1d-8223-42f3-9e9a-61f328d34f29-data-volume\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:31.241898 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.241878    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64793d1d-8223-42f3-9e9a-61f328d34f29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:31.241898 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.241894    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-metrics-tls\") pod \"dns-default-dzc42\" (UID: \"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5\") " pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:31.242105 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.241907    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64793d1d-8223-42f3-9e9a-61f328d34f29-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:31.242105 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.241921    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6794\" (UniqueName: \"kubernetes.io/projected/64793d1d-8223-42f3-9e9a-61f328d34f29-kube-api-access-w6794\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:31.342861 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.342694    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85sb5\" (UniqueName: \"kubernetes.io/projected/9879519f-861e-41e1-9faf-ea6502c5e01d-kube-api-access-85sb5\") pod \"ingress-canary-j77qb\" (UID: \"9879519f-861e-41e1-9faf-ea6502c5e01d\") " pod="openshift-ingress-canary/ingress-canary-j77qb"
Sep 15 12:45:31.343306 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.342889    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-config-volume\") pod \"dns-default-dzc42\" (UID: \"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5\") " pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:31.343306 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.342910    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64793d1d-8223-42f3-9e9a-61f328d34f29-crio-socket\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:31.343306 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.342932    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-tmp-dir\") pod \"dns-default-dzc42\" (UID: \"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5\") " pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:31.343306 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.342961    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64793d1d-8223-42f3-9e9a-61f328d34f29-data-volume\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:31.343306 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.343130    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64793d1d-8223-42f3-9e9a-61f328d34f29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:31.343306 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.343182    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-metrics-tls\") pod \"dns-default-dzc42\" (UID: \"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5\") " pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:31.343306 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.343247    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64793d1d-8223-42f3-9e9a-61f328d34f29-crio-socket\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:31.343306 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:31.343282    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 12:45:31.343715 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:31.343325    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:31.343715 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:31.343342    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-metrics-tls podName:d18d2255-6fc6-4ba8-a48d-723b6a0e13f5 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:31.843322224 +0000 UTC m=+35.564637751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-metrics-tls") pod "dns-default-dzc42" (UID: "d18d2255-6fc6-4ba8-a48d-723b6a0e13f5") : secret "dns-default-metrics-tls" not found
Sep 15 12:45:31.343715 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:31.343378    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64793d1d-8223-42f3-9e9a-61f328d34f29-insights-runtime-extractor-tls podName:64793d1d-8223-42f3-9e9a-61f328d34f29 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:31.843361645 +0000 UTC m=+35.564677174 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/64793d1d-8223-42f3-9e9a-61f328d34f29-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2w46l" (UID: "64793d1d-8223-42f3-9e9a-61f328d34f29") : secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:31.343715 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.343400    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64793d1d-8223-42f3-9e9a-61f328d34f29-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:31.343715 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.343426    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6794\" (UniqueName: \"kubernetes.io/projected/64793d1d-8223-42f3-9e9a-61f328d34f29-kube-api-access-w6794\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:31.343715 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.343494    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9879519f-861e-41e1-9faf-ea6502c5e01d-cert\") pod \"ingress-canary-j77qb\" (UID: \"9879519f-861e-41e1-9faf-ea6502c5e01d\") " pod="openshift-ingress-canary/ingress-canary-j77qb"
Sep 15 12:45:31.343715 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:31.343510    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 12:45:31.343715 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.343530    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jhfx\" (UniqueName: \"kubernetes.io/projected/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-kube-api-access-9jhfx\") pod \"dns-default-dzc42\" (UID: \"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5\") " pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:31.343715 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:31.343568    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/64793d1d-8223-42f3-9e9a-61f328d34f29-kube-rbac-proxy-cm podName:64793d1d-8223-42f3-9e9a-61f328d34f29 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:31.843553162 +0000 UTC m=+35.564868695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/64793d1d-8223-42f3-9e9a-61f328d34f29-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2w46l" (UID: "64793d1d-8223-42f3-9e9a-61f328d34f29") : configmap "kube-rbac-proxy" not found
Sep 15 12:45:31.343715 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.343608    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64793d1d-8223-42f3-9e9a-61f328d34f29-data-volume\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:31.343715 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.343645    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-tmp-dir\") pod \"dns-default-dzc42\" (UID: \"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5\") " pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:31.344143 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.343796    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-config-volume\") pod \"dns-default-dzc42\" (UID: \"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5\") " pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:31.374945 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.374917    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jhfx\" (UniqueName: \"kubernetes.io/projected/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-kube-api-access-9jhfx\") pod \"dns-default-dzc42\" (UID: \"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5\") " pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:31.375080 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.374915    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6794\" (UniqueName: \"kubernetes.io/projected/64793d1d-8223-42f3-9e9a-61f328d34f29-kube-api-access-w6794\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:31.444062 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.444026    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85sb5\" (UniqueName: \"kubernetes.io/projected/9879519f-861e-41e1-9faf-ea6502c5e01d-kube-api-access-85sb5\") pod \"ingress-canary-j77qb\" (UID: \"9879519f-861e-41e1-9faf-ea6502c5e01d\") " pod="openshift-ingress-canary/ingress-canary-j77qb"
Sep 15 12:45:31.444298 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.444158    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9879519f-861e-41e1-9faf-ea6502c5e01d-cert\") pod \"ingress-canary-j77qb\" (UID: \"9879519f-861e-41e1-9faf-ea6502c5e01d\") " pod="openshift-ingress-canary/ingress-canary-j77qb"
Sep 15 12:45:31.446603 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.446583    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9879519f-861e-41e1-9faf-ea6502c5e01d-cert\") pod \"ingress-canary-j77qb\" (UID: \"9879519f-861e-41e1-9faf-ea6502c5e01d\") " pod="openshift-ingress-canary/ingress-canary-j77qb"
Sep 15 12:45:31.459753 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.459729    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85sb5\" (UniqueName: \"kubernetes.io/projected/9879519f-861e-41e1-9faf-ea6502c5e01d-kube-api-access-85sb5\") pod \"ingress-canary-j77qb\" (UID: \"9879519f-861e-41e1-9faf-ea6502c5e01d\") " pod="openshift-ingress-canary/ingress-canary-j77qb"
Sep 15 12:45:31.529965 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.529927    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j77qb"
Sep 15 12:45:31.846032 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.846000    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j77qb"]
Sep 15 12:45:31.847255 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.847230    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64793d1d-8223-42f3-9e9a-61f328d34f29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:31.847365 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.847265    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-metrics-tls\") pod \"dns-default-dzc42\" (UID: \"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5\") " pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:31.847365 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.847282    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64793d1d-8223-42f3-9e9a-61f328d34f29-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:31.847473 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:31.847388    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:31.847473 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:31.847427    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 12:45:31.847473 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:31.847447    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64793d1d-8223-42f3-9e9a-61f328d34f29-insights-runtime-extractor-tls podName:64793d1d-8223-42f3-9e9a-61f328d34f29 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:32.847432725 +0000 UTC m=+36.568748234 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/64793d1d-8223-42f3-9e9a-61f328d34f29-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2w46l" (UID: "64793d1d-8223-42f3-9e9a-61f328d34f29") : secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:31.847473 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:31.847471    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-metrics-tls podName:d18d2255-6fc6-4ba8-a48d-723b6a0e13f5 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:32.847459366 +0000 UTC m=+36.568774894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-metrics-tls") pod "dns-default-dzc42" (UID: "d18d2255-6fc6-4ba8-a48d-723b6a0e13f5") : secret "dns-default-metrics-tls" not found
Sep 15 12:45:31.847686 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:31.847507    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 12:45:31.847686 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:31.847530    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/64793d1d-8223-42f3-9e9a-61f328d34f29-kube-rbac-proxy-cm podName:64793d1d-8223-42f3-9e9a-61f328d34f29 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:32.847523069 +0000 UTC m=+36.568838577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/64793d1d-8223-42f3-9e9a-61f328d34f29-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2w46l" (UID: "64793d1d-8223-42f3-9e9a-61f328d34f29") : configmap "kube-rbac-proxy" not found
Sep 15 12:45:31.849578 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:45:31.849554    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9879519f_861e_41e1_9faf_ea6502c5e01d.slice/crio-1958aef7c9b201c5b5c3f8c3acbd009c2d1524008197d4cc5474abb06a7cb904 WatchSource:0}: Error finding container 1958aef7c9b201c5b5c3f8c3acbd009c2d1524008197d4cc5474abb06a7cb904: Status 404 returned error can't find the container with id 1958aef7c9b201c5b5c3f8c3acbd009c2d1524008197d4cc5474abb06a7cb904
Sep 15 12:45:31.863067 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.863014    2567 generic.go:356] "Generic (PLEG): container finished" podID="ba39148c-16e4-4d97-bc00-ad3586383bdc" containerID="1db9c2b762a7ed66a4249edb0c98a22c50fc18f2b2f56b57bf61138dbc86480d" exitCode=0
Sep 15 12:45:31.863167 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.863095    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rmdnt" event={"ID":"ba39148c-16e4-4d97-bc00-ad3586383bdc","Type":"ContainerDied","Data":"1db9c2b762a7ed66a4249edb0c98a22c50fc18f2b2f56b57bf61138dbc86480d"}
Sep 15 12:45:31.864205 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:31.864181    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j77qb" event={"ID":"9879519f-861e-41e1-9faf-ea6502c5e01d","Type":"ContainerStarted","Data":"1958aef7c9b201c5b5c3f8c3acbd009c2d1524008197d4cc5474abb06a7cb904"}
Sep 15 12:45:32.706949 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:32.706909    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:45:32.707836 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:32.706909    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:45:32.707836 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:32.706909    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:45:32.717595 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:32.717573    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 12:45:32.717700 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:32.717677    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 12:45:32.717912 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:32.717897    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 12:45:32.718041 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:32.718024    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z9dbl\""
Sep 15 12:45:32.718479 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:32.718463    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w5cgx\""
Sep 15 12:45:32.725946 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:32.725927    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 12:45:32.854719 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:32.854675    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64793d1d-8223-42f3-9e9a-61f328d34f29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:32.854882 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:32.854730    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-metrics-tls\") pod \"dns-default-dzc42\" (UID: \"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5\") " pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:32.854882 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:32.854755    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64793d1d-8223-42f3-9e9a-61f328d34f29-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:32.854882 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:32.854840    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 12:45:32.854882 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:32.854854    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 12:45:32.855077 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:32.854840    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:32.855077 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:32.854905    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-metrics-tls podName:d18d2255-6fc6-4ba8-a48d-723b6a0e13f5 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:34.854890279 +0000 UTC m=+38.576205807 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-metrics-tls") pod "dns-default-dzc42" (UID: "d18d2255-6fc6-4ba8-a48d-723b6a0e13f5") : secret "dns-default-metrics-tls" not found
Sep 15 12:45:32.855077 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:32.854929    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64793d1d-8223-42f3-9e9a-61f328d34f29-insights-runtime-extractor-tls podName:64793d1d-8223-42f3-9e9a-61f328d34f29 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:34.854912947 +0000 UTC m=+38.576228470 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/64793d1d-8223-42f3-9e9a-61f328d34f29-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2w46l" (UID: "64793d1d-8223-42f3-9e9a-61f328d34f29") : secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:32.855077 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:32.854946    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/64793d1d-8223-42f3-9e9a-61f328d34f29-kube-rbac-proxy-cm podName:64793d1d-8223-42f3-9e9a-61f328d34f29 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:34.854936586 +0000 UTC m=+38.576252097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/64793d1d-8223-42f3-9e9a-61f328d34f29-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2w46l" (UID: "64793d1d-8223-42f3-9e9a-61f328d34f29") : configmap "kube-rbac-proxy" not found
Sep 15 12:45:32.870364 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:32.870336    2567 generic.go:356] "Generic (PLEG): container finished" podID="ba39148c-16e4-4d97-bc00-ad3586383bdc" containerID="0cc905471aa1df3ca0db3df481d72834f16fdfecda1ee5c391e9f1f92cf9cbf9" exitCode=0
Sep 15 12:45:32.870483 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:32.870361    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rmdnt" event={"ID":"ba39148c-16e4-4d97-bc00-ad3586383bdc","Type":"ContainerDied","Data":"0cc905471aa1df3ca0db3df481d72834f16fdfecda1ee5c391e9f1f92cf9cbf9"}
Sep 15 12:45:33.876941 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:33.876641    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rmdnt" event={"ID":"ba39148c-16e4-4d97-bc00-ad3586383bdc","Type":"ContainerStarted","Data":"56287a83df1d2020917d146c403586886d4777d982042e559a15e3d8053e000d"}
Sep 15 12:45:33.905552 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:33.905495    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rmdnt" podStartSLOduration=9.540472977 podStartE2EDuration="37.905475479s" totalImagesPullingTime="28.365002502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:33.905005287 +0000 UTC m=+37.626320842" watchObservedRunningTime="2026-09-15 12:45:33.905475479 +0000 UTC m=+37.626791010"
Sep 15 12:45:34.873212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:34.873167    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64793d1d-8223-42f3-9e9a-61f328d34f29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:34.873412 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:34.873224    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-metrics-tls\") pod \"dns-default-dzc42\" (UID: \"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5\") " pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:34.873412 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:34.873255    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64793d1d-8223-42f3-9e9a-61f328d34f29-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:34.873412 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:34.873377    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:34.873412 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:34.873389    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 12:45:34.873636 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:34.873458    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-metrics-tls podName:d18d2255-6fc6-4ba8-a48d-723b6a0e13f5 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:38.873437505 +0000 UTC m=+42.594753053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-metrics-tls") pod "dns-default-dzc42" (UID: "d18d2255-6fc6-4ba8-a48d-723b6a0e13f5") : secret "dns-default-metrics-tls" not found
Sep 15 12:45:34.873636 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:34.873483    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64793d1d-8223-42f3-9e9a-61f328d34f29-insights-runtime-extractor-tls podName:64793d1d-8223-42f3-9e9a-61f328d34f29 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:38.873471833 +0000 UTC m=+42.594787366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/64793d1d-8223-42f3-9e9a-61f328d34f29-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2w46l" (UID: "64793d1d-8223-42f3-9e9a-61f328d34f29") : secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:34.873923 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:34.873902    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64793d1d-8223-42f3-9e9a-61f328d34f29-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:35.882342 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:35.882249    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j77qb" event={"ID":"9879519f-861e-41e1-9faf-ea6502c5e01d","Type":"ContainerStarted","Data":"781657d64e78eb4e49f364696670de575752005d869a6ec42a45a30ab4e9c75f"}
Sep 15 12:45:38.899943 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:38.899907    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64793d1d-8223-42f3-9e9a-61f328d34f29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:38.900387 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:38.899949    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-metrics-tls\") pod \"dns-default-dzc42\" (UID: \"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5\") " pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:38.900387 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:38.900335    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:38.900504 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:38.900403    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 12:45:38.900504 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:38.900442    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64793d1d-8223-42f3-9e9a-61f328d34f29-insights-runtime-extractor-tls podName:64793d1d-8223-42f3-9e9a-61f328d34f29 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:46.900402396 +0000 UTC m=+50.621717922 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/64793d1d-8223-42f3-9e9a-61f328d34f29-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2w46l" (UID: "64793d1d-8223-42f3-9e9a-61f328d34f29") : secret "insights-runtime-extractor-tls" not found
Sep 15 12:45:38.900504 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:45:38.900482    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-metrics-tls podName:d18d2255-6fc6-4ba8-a48d-723b6a0e13f5 nodeName:}" failed. No retries permitted until 2026-09-15 12:45:46.900463537 +0000 UTC m=+50.621779064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-metrics-tls") pod "dns-default-dzc42" (UID: "d18d2255-6fc6-4ba8-a48d-723b6a0e13f5") : secret "dns-default-metrics-tls" not found
Sep 15 12:45:46.958133 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:46.958094    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64793d1d-8223-42f3-9e9a-61f328d34f29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:46.958133 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:46.958134    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-metrics-tls\") pod \"dns-default-dzc42\" (UID: \"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5\") " pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:46.961443 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:46.961420    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d18d2255-6fc6-4ba8-a48d-723b6a0e13f5-metrics-tls\") pod \"dns-default-dzc42\" (UID: \"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5\") " pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:46.961551 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:46.961422    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64793d1d-8223-42f3-9e9a-61f328d34f29-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2w46l\" (UID: \"64793d1d-8223-42f3-9e9a-61f328d34f29\") " pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:47.046217 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:47.046179    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:47.072511 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:47.072486    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2w46l"
Sep 15 12:45:47.343190 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:47.343099    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j77qb" podStartSLOduration=12.774911249 podStartE2EDuration="16.343080792s" totalImagesPullingTime="3.568169543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:45:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:35.909618496 +0000 UTC m=+39.630934038" watchObservedRunningTime="2026-09-15 12:45:47.343080792 +0000 UTC m=+51.064396322"
Sep 15 12:45:47.343328 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:47.343274    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dzc42"]
Sep 15 12:45:47.346370 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:45:47.346349    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd18d2255_6fc6_4ba8_a48d_723b6a0e13f5.slice/crio-71b40bbee34da38162abd1bbd1c7fe286f1ea2b71d8864710f6426ee798bb91a WatchSource:0}: Error finding container 71b40bbee34da38162abd1bbd1c7fe286f1ea2b71d8864710f6426ee798bb91a: Status 404 returned error can't find the container with id 71b40bbee34da38162abd1bbd1c7fe286f1ea2b71d8864710f6426ee798bb91a
Sep 15 12:45:47.360758 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:47.360734    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2w46l"]
Sep 15 12:45:47.364230 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:45:47.364208    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64793d1d_8223_42f3_9e9a_61f328d34f29.slice/crio-755ca069287cec932e6f21fdf616fdb7eb6d35226ace1f796be6807a67f265bf WatchSource:0}: Error finding container 755ca069287cec932e6f21fdf616fdb7eb6d35226ace1f796be6807a67f265bf: Status 404 returned error can't find the container with id 755ca069287cec932e6f21fdf616fdb7eb6d35226ace1f796be6807a67f265bf
Sep 15 12:45:47.910522 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:47.910476    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2w46l" event={"ID":"64793d1d-8223-42f3-9e9a-61f328d34f29","Type":"ContainerStarted","Data":"40debddfd408982b640e51efbef7d2e17b6934ab3ea81c16878f7332767f6d29"}
Sep 15 12:45:47.910789 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:47.910541    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2w46l" event={"ID":"64793d1d-8223-42f3-9e9a-61f328d34f29","Type":"ContainerStarted","Data":"755ca069287cec932e6f21fdf616fdb7eb6d35226ace1f796be6807a67f265bf"}
Sep 15 12:45:47.911757 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:47.911732    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dzc42" event={"ID":"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5","Type":"ContainerStarted","Data":"71b40bbee34da38162abd1bbd1c7fe286f1ea2b71d8864710f6426ee798bb91a"}
Sep 15 12:45:48.916309 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:48.916281    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dzc42" event={"ID":"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5","Type":"ContainerStarted","Data":"eb1f344622312420084ece55d394198b391525244c67309225429f34cf34b1df"}
Sep 15 12:45:48.916658 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:48.916329    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dzc42" event={"ID":"d18d2255-6fc6-4ba8-a48d-723b6a0e13f5","Type":"ContainerStarted","Data":"092d183c02f011c53d51c4e3178d5f454bfaee24cf0389f3f134b6605c39a792"}
Sep 15 12:45:48.916658 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:48.916398    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:48.956837 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:48.956781    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dzc42" podStartSLOduration=16.592119915 podStartE2EDuration="17.956761847s" totalImagesPullingTime="1.364641932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:45:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:48.956219885 +0000 UTC m=+52.677535414" watchObservedRunningTime="2026-09-15 12:45:48.956761847 +0000 UTC m=+52.678077381"
Sep 15 12:45:49.921190 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:49.921152    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2w46l" event={"ID":"64793d1d-8223-42f3-9e9a-61f328d34f29","Type":"ContainerStarted","Data":"189b902b958744d36b7b0aaccc6b097d81a522ecc4ef2c261cbfed35c3970d95"}
Sep 15 12:45:50.926270 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:50.926227    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2w46l" event={"ID":"64793d1d-8223-42f3-9e9a-61f328d34f29","Type":"ContainerStarted","Data":"006ae2fa4f08ca3922dd9c1aee17f4ef56b1faad6dd1d3559791a13d1bf01f46"}
Sep 15 12:45:55.374115 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.374058    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2w46l" podStartSLOduration=21.488590988 podStartE2EDuration="24.374041499s" totalImagesPullingTime="2.885450511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:45:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:50.966456141 +0000 UTC m=+54.687771673" watchObservedRunningTime="2026-09-15 12:45:55.374041499 +0000 UTC m=+59.095357029"
Sep 15 12:45:55.374511 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.374442    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"]
Sep 15 12:45:55.376646 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.376629    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.381817 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.381794    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 15 12:45:55.381927 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.381863    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 15 12:45:55.399532 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.399508    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 15 12:45:55.406629 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.406611    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 15 12:45:55.414874 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.414855    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 15 12:45:55.417168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.417153    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 15 12:45:55.421393 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.421377    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/64f33fad-7ccc-49b8-bb76-a0998e3c5cb3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-647b4dbfb9-rsjnc\" (UID: \"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.421449 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.421403    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpqc4\" (UniqueName: \"kubernetes.io/projected/64f33fad-7ccc-49b8-bb76-a0998e3c5cb3-kube-api-access-wpqc4\") pod \"cluster-proxy-proxy-agent-647b4dbfb9-rsjnc\" (UID: \"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.421490 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.421465    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/64f33fad-7ccc-49b8-bb76-a0998e3c5cb3-hub\") pod \"cluster-proxy-proxy-agent-647b4dbfb9-rsjnc\" (UID: \"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.421490 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.421486    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/64f33fad-7ccc-49b8-bb76-a0998e3c5cb3-ca\") pod \"cluster-proxy-proxy-agent-647b4dbfb9-rsjnc\" (UID: \"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.421561 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.421503    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/64f33fad-7ccc-49b8-bb76-a0998e3c5cb3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-647b4dbfb9-rsjnc\" (UID: \"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.421561 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.421530    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/64f33fad-7ccc-49b8-bb76-a0998e3c5cb3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-647b4dbfb9-rsjnc\" (UID: \"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.485829 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.485798    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbb948977-kwtzd"]
Sep 15 12:45:55.486996 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.486961    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 15 12:45:55.487399 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.487384    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbb948977-kwtzd"
Sep 15 12:45:55.487716 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.487699    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"]
Sep 15 12:45:55.496369 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.496352    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 15 12:45:55.522043 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.522011    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/64f33fad-7ccc-49b8-bb76-a0998e3c5cb3-hub\") pod \"cluster-proxy-proxy-agent-647b4dbfb9-rsjnc\" (UID: \"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.522154 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.522050    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/33adbc02-077d-4dbd-8010-69cffc5edae9-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cbb948977-kwtzd\" (UID: \"33adbc02-077d-4dbd-8010-69cffc5edae9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbb948977-kwtzd"
Sep 15 12:45:55.522154 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.522088    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/64f33fad-7ccc-49b8-bb76-a0998e3c5cb3-ca\") pod \"cluster-proxy-proxy-agent-647b4dbfb9-rsjnc\" (UID: \"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.522154 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.522143    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/64f33fad-7ccc-49b8-bb76-a0998e3c5cb3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-647b4dbfb9-rsjnc\" (UID: \"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.522316 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.522174    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/64f33fad-7ccc-49b8-bb76-a0998e3c5cb3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-647b4dbfb9-rsjnc\" (UID: \"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.522316 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.522206    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33adbc02-077d-4dbd-8010-69cffc5edae9-tmp\") pod \"klusterlet-addon-workmgr-6cbb948977-kwtzd\" (UID: \"33adbc02-077d-4dbd-8010-69cffc5edae9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbb948977-kwtzd"
Sep 15 12:45:55.522316 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.522238    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/64f33fad-7ccc-49b8-bb76-a0998e3c5cb3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-647b4dbfb9-rsjnc\" (UID: \"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.522316 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.522283    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdzw4\" (UniqueName: \"kubernetes.io/projected/33adbc02-077d-4dbd-8010-69cffc5edae9-kube-api-access-mdzw4\") pod \"klusterlet-addon-workmgr-6cbb948977-kwtzd\" (UID: \"33adbc02-077d-4dbd-8010-69cffc5edae9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbb948977-kwtzd"
Sep 15 12:45:55.522511 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.522373    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpqc4\" (UniqueName: \"kubernetes.io/projected/64f33fad-7ccc-49b8-bb76-a0998e3c5cb3-kube-api-access-wpqc4\") pod \"cluster-proxy-proxy-agent-647b4dbfb9-rsjnc\" (UID: \"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.523391 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.523361    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/64f33fad-7ccc-49b8-bb76-a0998e3c5cb3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-647b4dbfb9-rsjnc\" (UID: \"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.524790 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.524766    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/64f33fad-7ccc-49b8-bb76-a0998e3c5cb3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-647b4dbfb9-rsjnc\" (UID: \"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.524893 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.524772    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/64f33fad-7ccc-49b8-bb76-a0998e3c5cb3-hub\") pod \"cluster-proxy-proxy-agent-647b4dbfb9-rsjnc\" (UID: \"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.524893 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.524862    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/64f33fad-7ccc-49b8-bb76-a0998e3c5cb3-ca\") pod \"cluster-proxy-proxy-agent-647b4dbfb9-rsjnc\" (UID: \"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.525104 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.525086    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/64f33fad-7ccc-49b8-bb76-a0998e3c5cb3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-647b4dbfb9-rsjnc\" (UID: \"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.528114 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.528093    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbb948977-kwtzd"]
Sep 15 12:45:55.583783 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.583759    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpqc4\" (UniqueName: \"kubernetes.io/projected/64f33fad-7ccc-49b8-bb76-a0998e3c5cb3-kube-api-access-wpqc4\") pod \"cluster-proxy-proxy-agent-647b4dbfb9-rsjnc\" (UID: \"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.623385 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.623358    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33adbc02-077d-4dbd-8010-69cffc5edae9-tmp\") pod \"klusterlet-addon-workmgr-6cbb948977-kwtzd\" (UID: \"33adbc02-077d-4dbd-8010-69cffc5edae9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbb948977-kwtzd"
Sep 15 12:45:55.623488 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.623390    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdzw4\" (UniqueName: \"kubernetes.io/projected/33adbc02-077d-4dbd-8010-69cffc5edae9-kube-api-access-mdzw4\") pod \"klusterlet-addon-workmgr-6cbb948977-kwtzd\" (UID: \"33adbc02-077d-4dbd-8010-69cffc5edae9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbb948977-kwtzd"
Sep 15 12:45:55.623488 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.623443    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/33adbc02-077d-4dbd-8010-69cffc5edae9-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cbb948977-kwtzd\" (UID: \"33adbc02-077d-4dbd-8010-69cffc5edae9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbb948977-kwtzd"
Sep 15 12:45:55.623731 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.623708    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33adbc02-077d-4dbd-8010-69cffc5edae9-tmp\") pod \"klusterlet-addon-workmgr-6cbb948977-kwtzd\" (UID: \"33adbc02-077d-4dbd-8010-69cffc5edae9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbb948977-kwtzd"
Sep 15 12:45:55.625775 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.625728    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/33adbc02-077d-4dbd-8010-69cffc5edae9-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cbb948977-kwtzd\" (UID: \"33adbc02-077d-4dbd-8010-69cffc5edae9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbb948977-kwtzd"
Sep 15 12:45:55.673363 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.673337    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdzw4\" (UniqueName: \"kubernetes.io/projected/33adbc02-077d-4dbd-8010-69cffc5edae9-kube-api-access-mdzw4\") pod \"klusterlet-addon-workmgr-6cbb948977-kwtzd\" (UID: \"33adbc02-077d-4dbd-8010-69cffc5edae9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbb948977-kwtzd"
Sep 15 12:45:55.695349 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.695323    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"
Sep 15 12:45:55.795797 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.795760    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbb948977-kwtzd"
Sep 15 12:45:55.859138 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:55.859114    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wv7pg"
Sep 15 12:45:56.003525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:56.003502    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc"]
Sep 15 12:45:56.005961 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:45:56.005933    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64f33fad_7ccc_49b8_bb76_a0998e3c5cb3.slice/crio-2d76a75d56bc31e2f9e65f2be7bbea945542f838578b891b1bd99f3d53937a85 WatchSource:0}: Error finding container 2d76a75d56bc31e2f9e65f2be7bbea945542f838578b891b1bd99f3d53937a85: Status 404 returned error can't find the container with id 2d76a75d56bc31e2f9e65f2be7bbea945542f838578b891b1bd99f3d53937a85
Sep 15 12:45:56.086417 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:56.086392    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbb948977-kwtzd"]
Sep 15 12:45:56.089379 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:45:56.089353    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33adbc02_077d_4dbd_8010_69cffc5edae9.slice/crio-998402471dbc209bed208e9d479145ad00235046ce5bca48f6e8c20eb7b5e4b0 WatchSource:0}: Error finding container 998402471dbc209bed208e9d479145ad00235046ce5bca48f6e8c20eb7b5e4b0: Status 404 returned error can't find the container with id 998402471dbc209bed208e9d479145ad00235046ce5bca48f6e8c20eb7b5e4b0
Sep 15 12:45:56.946418 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:56.946372    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc" event={"ID":"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3","Type":"ContainerStarted","Data":"2d76a75d56bc31e2f9e65f2be7bbea945542f838578b891b1bd99f3d53937a85"}
Sep 15 12:45:56.947719 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:56.947686    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbb948977-kwtzd" event={"ID":"33adbc02-077d-4dbd-8010-69cffc5edae9","Type":"ContainerStarted","Data":"998402471dbc209bed208e9d479145ad00235046ce5bca48f6e8c20eb7b5e4b0"}
Sep 15 12:45:58.923319 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:58.923290    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dzc42"
Sep 15 12:45:59.961869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:59.961786    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc" event={"ID":"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3","Type":"ContainerStarted","Data":"2937777c2dcca76e9664d066d03eeef9a948d58e94bd432509f4f63ab6ceb50b"}
Sep 15 12:45:59.961869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:59.961830    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc" event={"ID":"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3","Type":"ContainerStarted","Data":"69abe27053b7968bb14c3813868a275df2d07f4ba1ecc18c2dd41e829998c4a3"}
Sep 15 12:45:59.961869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:59.961843    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc" event={"ID":"64f33fad-7ccc-49b8-bb76-a0998e3c5cb3","Type":"ContainerStarted","Data":"2b5b886ed0a9961d9414d44e014aefb9a945874453b15276a70d219271532153"}
Sep 15 12:45:59.988768 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:45:59.988385    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-647b4dbfb9-rsjnc" podStartSLOduration=1.292856833 podStartE2EDuration="4.988365785s" totalImagesPullingTime="3.695508952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:45:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:45:59.987123414 +0000 UTC m=+63.708438946" watchObservedRunningTime="2026-09-15 12:45:59.988365785 +0000 UTC m=+63.709681318"
Sep 15 12:46:02.374714 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.374674    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs\") pod \"network-metrics-daemon-rjf2q\" (UID: \"ae00611b-05f3-44f1-8fde-3eeb385a7ef1\") " pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:46:02.377562 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.377539    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 12:46:02.387863 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.387840    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae00611b-05f3-44f1-8fde-3eeb385a7ef1-metrics-certs\") pod \"network-metrics-daemon-rjf2q\" (UID: \"ae00611b-05f3-44f1-8fde-3eeb385a7ef1\") " pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:46:02.426411 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.426377    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w5cgx\""
Sep 15 12:46:02.434341 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.434317    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rjf2q"
Sep 15 12:46:02.475710 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.475675    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret\") pod \"global-pull-secret-syncer-4gb4s\" (UID: \"048c8d38-9a54-4ece-9887-db9382ceee1f\") " pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:46:02.475888 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.475738    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msb67\" (UniqueName: \"kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67\") pod \"network-check-target-tb86v\" (UID: \"b50eaefb-c7d0-4b42-adc8-3e1349c91875\") " pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:46:02.479411 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.479380    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 12:46:02.479411 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.479379    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 12:46:02.488723 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.488685    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/048c8d38-9a54-4ece-9887-db9382ceee1f-original-pull-secret\") pod \"global-pull-secret-syncer-4gb4s\" (UID: \"048c8d38-9a54-4ece-9887-db9382ceee1f\") " pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:46:02.489424 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.489220    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 12:46:02.499803 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.499776    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msb67\" (UniqueName: \"kubernetes.io/projected/b50eaefb-c7d0-4b42-adc8-3e1349c91875-kube-api-access-msb67\") pod \"network-check-target-tb86v\" (UID: \"b50eaefb-c7d0-4b42-adc8-3e1349c91875\") " pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:46:02.725184 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.725149    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z9dbl\""
Sep 15 12:46:02.727824 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.727807    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:46:02.727908 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.727866    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4gb4s"
Sep 15 12:46:02.806512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.806411    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rjf2q"]
Sep 15 12:46:02.810027 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:46:02.809961    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae00611b_05f3_44f1_8fde_3eeb385a7ef1.slice/crio-f3a1e252af7fc2f44c56d86510642fee344f4e0a7c80f412d5887f0a279a168c WatchSource:0}: Error finding container f3a1e252af7fc2f44c56d86510642fee344f4e0a7c80f412d5887f0a279a168c: Status 404 returned error can't find the container with id f3a1e252af7fc2f44c56d86510642fee344f4e0a7c80f412d5887f0a279a168c
Sep 15 12:46:02.973332 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.973288    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbb948977-kwtzd" event={"ID":"33adbc02-077d-4dbd-8010-69cffc5edae9","Type":"ContainerStarted","Data":"b019f1566059d02dafbb2644ec578a90bed1fc44392b58bf615fc1a949414ed4"}
Sep 15 12:46:02.973532 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.973374    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbb948977-kwtzd"
Sep 15 12:46:02.974601 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.974561    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rjf2q" event={"ID":"ae00611b-05f3-44f1-8fde-3eeb385a7ef1","Type":"ContainerStarted","Data":"f3a1e252af7fc2f44c56d86510642fee344f4e0a7c80f412d5887f0a279a168c"}
Sep 15 12:46:02.975325 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:02.975306    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbb948977-kwtzd"
Sep 15 12:46:03.012728 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:03.012599    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4gb4s"]
Sep 15 12:46:03.016705 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:46:03.016671    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod048c8d38_9a54_4ece_9887_db9382ceee1f.slice/crio-23ab1c106c0199df65060abb4477527b187032cb333185f52ca26c515e41bfd7 WatchSource:0}: Error finding container 23ab1c106c0199df65060abb4477527b187032cb333185f52ca26c515e41bfd7: Status 404 returned error can't find the container with id 23ab1c106c0199df65060abb4477527b187032cb333185f52ca26c515e41bfd7
Sep 15 12:46:03.025533 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:03.025508    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tb86v"]
Sep 15 12:46:03.025910 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:03.025865    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbb948977-kwtzd" podStartSLOduration=1.5237220200000001 podStartE2EDuration="8.02585111s" totalImagesPullingTime="6.50212909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:45:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:46:03.023197263 +0000 UTC m=+66.744512794" watchObservedRunningTime="2026-09-15 12:46:03.02585111 +0000 UTC m=+66.747166640"
Sep 15 12:46:03.026743 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:46:03.026725    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb50eaefb_c7d0_4b42_adc8_3e1349c91875.slice/crio-64a8a3ccffb4c57efa273db2b9eb3705f7df65158c42c1475dd95cf80059b1dd WatchSource:0}: Error finding container 64a8a3ccffb4c57efa273db2b9eb3705f7df65158c42c1475dd95cf80059b1dd: Status 404 returned error can't find the container with id 64a8a3ccffb4c57efa273db2b9eb3705f7df65158c42c1475dd95cf80059b1dd
Sep 15 12:46:03.980472 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:03.980429    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tb86v" event={"ID":"b50eaefb-c7d0-4b42-adc8-3e1349c91875","Type":"ContainerStarted","Data":"64a8a3ccffb4c57efa273db2b9eb3705f7df65158c42c1475dd95cf80059b1dd"}
Sep 15 12:46:03.981811 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:03.981768    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4gb4s" event={"ID":"048c8d38-9a54-4ece-9887-db9382ceee1f","Type":"ContainerStarted","Data":"23ab1c106c0199df65060abb4477527b187032cb333185f52ca26c515e41bfd7"}
Sep 15 12:46:04.989733 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:04.989692    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rjf2q" event={"ID":"ae00611b-05f3-44f1-8fde-3eeb385a7ef1","Type":"ContainerStarted","Data":"7a7ad8ff065d043d681954de62f287092a60de1edfbb4c9ebb1262bc708e1aa7"}
Sep 15 12:46:04.990211 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:04.989761    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rjf2q" event={"ID":"ae00611b-05f3-44f1-8fde-3eeb385a7ef1","Type":"ContainerStarted","Data":"d5b50d97ee02b7db684df90c738da82c1b9b002ec0319ab37b3924a8754ef87e"}
Sep 15 12:46:05.101483 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.101052    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rjf2q" podStartSLOduration=67.666660672 podStartE2EDuration="1m9.101030295s" totalImagesPullingTime="1.434369623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:46:05.037067063 +0000 UTC m=+68.758382596" watchObservedRunningTime="2026-09-15 12:46:05.101030295 +0000 UTC m=+68.822345825"
Sep 15 12:46:05.102136 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.102113    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dpdqv"]
Sep 15 12:46:05.121876 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.121801    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.127931 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.127907    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 12:46:05.127931 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.127939    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 12:46:05.128129 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.127994    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9phj7\""
Sep 15 12:46:05.128129 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.128103    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 12:46:05.132814 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.132792    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 12:46:05.133087 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.133068    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 12:46:05.133177 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.133095    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 12:46:05.198482 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.198444    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f70622b-5f37-4f27-af7e-1a1c091c31db-root\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.198698 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.198488    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f70622b-5f37-4f27-af7e-1a1c091c31db-node-exporter-wtmp\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.198698 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.198513    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f70622b-5f37-4f27-af7e-1a1c091c31db-node-exporter-accelerators-collector-config\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.198698 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.198572    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f70622b-5f37-4f27-af7e-1a1c091c31db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.198698 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.198590    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f70622b-5f37-4f27-af7e-1a1c091c31db-node-exporter-tls\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.198698 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.198608    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb5cl\" (UniqueName: \"kubernetes.io/projected/6f70622b-5f37-4f27-af7e-1a1c091c31db-kube-api-access-pb5cl\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.198698 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.198659    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f70622b-5f37-4f27-af7e-1a1c091c31db-metrics-client-ca\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.198961 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.198724    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f70622b-5f37-4f27-af7e-1a1c091c31db-sys\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.198961 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.198759    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f70622b-5f37-4f27-af7e-1a1c091c31db-node-exporter-textfile\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.299513 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.299426    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f70622b-5f37-4f27-af7e-1a1c091c31db-node-exporter-tls\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.299513 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.299481    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb5cl\" (UniqueName: \"kubernetes.io/projected/6f70622b-5f37-4f27-af7e-1a1c091c31db-kube-api-access-pb5cl\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.299513 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.299510    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f70622b-5f37-4f27-af7e-1a1c091c31db-metrics-client-ca\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.299778 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.299540    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f70622b-5f37-4f27-af7e-1a1c091c31db-sys\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.299778 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.299568    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f70622b-5f37-4f27-af7e-1a1c091c31db-node-exporter-textfile\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.299778 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.299594    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f70622b-5f37-4f27-af7e-1a1c091c31db-root\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.299778 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.299614    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f70622b-5f37-4f27-af7e-1a1c091c31db-node-exporter-wtmp\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.299778 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.299657    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f70622b-5f37-4f27-af7e-1a1c091c31db-node-exporter-accelerators-collector-config\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.299778 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.299715    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f70622b-5f37-4f27-af7e-1a1c091c31db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.300610 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.300324    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6f70622b-5f37-4f27-af7e-1a1c091c31db-root\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.300610 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.300389    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f70622b-5f37-4f27-af7e-1a1c091c31db-sys\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.300610 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.300514    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6f70622b-5f37-4f27-af7e-1a1c091c31db-node-exporter-wtmp\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.300836 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.300654    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6f70622b-5f37-4f27-af7e-1a1c091c31db-node-exporter-textfile\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.301121 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.301056    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6f70622b-5f37-4f27-af7e-1a1c091c31db-node-exporter-accelerators-collector-config\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.301502 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.301473    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f70622b-5f37-4f27-af7e-1a1c091c31db-metrics-client-ca\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.302648 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.302608    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f70622b-5f37-4f27-af7e-1a1c091c31db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.303863 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.303843    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6f70622b-5f37-4f27-af7e-1a1c091c31db-node-exporter-tls\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.348503 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.348456    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb5cl\" (UniqueName: \"kubernetes.io/projected/6f70622b-5f37-4f27-af7e-1a1c091c31db-kube-api-access-pb5cl\") pod \"node-exporter-dpdqv\" (UID: \"6f70622b-5f37-4f27-af7e-1a1c091c31db\") " pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:05.433707 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:05.433669    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dpdqv"
Sep 15 12:46:06.340362 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.340324    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 12:46:06.342788 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.342764    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.347835 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.347812    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 15 12:46:06.349340 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.349314    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 15 12:46:06.350303 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.350008    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 15 12:46:06.350386 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.350301    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 15 12:46:06.350702 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.350682    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 15 12:46:06.355379 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.355251    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-skf8d\""
Sep 15 12:46:06.355780 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.355761    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 15 12:46:06.356345 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.356329    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 15 12:46:06.356639 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.356617    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 15 12:46:06.356742 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.356692    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 15 12:46:06.371408 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.371383    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 12:46:06.409424 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.409387    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/263ce796-912e-4ac2-8302-f79b565b5937-config-out\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.409597 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.409481    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-config-volume\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.409597 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.409516    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-web-config\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.409597 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.409554    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/263ce796-912e-4ac2-8302-f79b565b5937-tls-assets\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.409597 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.409584    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.409772 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.409614    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.409772 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.409647    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/263ce796-912e-4ac2-8302-f79b565b5937-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.409772 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.409690    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/263ce796-912e-4ac2-8302-f79b565b5937-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.409772 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.409723    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm9xg\" (UniqueName: \"kubernetes.io/projected/263ce796-912e-4ac2-8302-f79b565b5937-kube-api-access-gm9xg\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.409772 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.409756    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/263ce796-912e-4ac2-8302-f79b565b5937-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.409965 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.409780    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.409965 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.409800    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.409965 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.409870    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.510291 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.510249    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/263ce796-912e-4ac2-8302-f79b565b5937-tls-assets\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.510452 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.510301    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.510452 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.510341    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.510452 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.510362    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/263ce796-912e-4ac2-8302-f79b565b5937-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.510452 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.510382    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/263ce796-912e-4ac2-8302-f79b565b5937-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.510661 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.510452    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm9xg\" (UniqueName: \"kubernetes.io/projected/263ce796-912e-4ac2-8302-f79b565b5937-kube-api-access-gm9xg\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.510661 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.510478    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/263ce796-912e-4ac2-8302-f79b565b5937-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.510661 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.510507    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.510661 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.510525    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.510661 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.510554    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.510661 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.510591    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/263ce796-912e-4ac2-8302-f79b565b5937-config-out\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.510661 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.510636    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-config-volume\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.510968 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.510664    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-web-config\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.510968 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.510957    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/263ce796-912e-4ac2-8302-f79b565b5937-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.512544 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.512510    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/263ce796-912e-4ac2-8302-f79b565b5937-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.514519 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.513376    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/263ce796-912e-4ac2-8302-f79b565b5937-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.514519 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.514108    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.515418 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.515392    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.519742 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.519709    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.519995 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.519959    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/263ce796-912e-4ac2-8302-f79b565b5937-config-out\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.520551 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.520466    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/263ce796-912e-4ac2-8302-f79b565b5937-tls-assets\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.520778 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.520736    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.521235 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.521216    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.522150 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.522125    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-web-config\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.522399 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.522380    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-config-volume\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.535158 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.535133    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm9xg\" (UniqueName: \"kubernetes.io/projected/263ce796-912e-4ac2-8302-f79b565b5937-kube-api-access-gm9xg\") pod \"alertmanager-main-0\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:06.653477 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:06.653400    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:46:07.607557 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:46:07.607526    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f70622b_5f37_4f27_af7e_1a1c091c31db.slice/crio-72dfefe4f7b8f5e816da77f6797cdb3278514071c533153aaca1be183e706161 WatchSource:0}: Error finding container 72dfefe4f7b8f5e816da77f6797cdb3278514071c533153aaca1be183e706161: Status 404 returned error can't find the container with id 72dfefe4f7b8f5e816da77f6797cdb3278514071c533153aaca1be183e706161
Sep 15 12:46:07.909825 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:07.909786    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 12:46:07.912906 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:46:07.912881    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod263ce796_912e_4ac2_8302_f79b565b5937.slice/crio-a9a00f528df3e20fa9bae9eda6ba78e4b0cac09c45cc05c58dee911e369836e3 WatchSource:0}: Error finding container a9a00f528df3e20fa9bae9eda6ba78e4b0cac09c45cc05c58dee911e369836e3: Status 404 returned error can't find the container with id a9a00f528df3e20fa9bae9eda6ba78e4b0cac09c45cc05c58dee911e369836e3
Sep 15 12:46:08.001637 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:08.001598    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4gb4s" event={"ID":"048c8d38-9a54-4ece-9887-db9382ceee1f","Type":"ContainerStarted","Data":"fcf0dd594a9ddbe74ced7940d196c9cec6ee28ef814193aeb304baf3dc04e26e"}
Sep 15 12:46:08.002797 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:08.002771    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"263ce796-912e-4ac2-8302-f79b565b5937","Type":"ContainerStarted","Data":"a9a00f528df3e20fa9bae9eda6ba78e4b0cac09c45cc05c58dee911e369836e3"}
Sep 15 12:46:08.004204 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:08.004182    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tb86v" event={"ID":"b50eaefb-c7d0-4b42-adc8-3e1349c91875","Type":"ContainerStarted","Data":"6d16e63fb741bfc3e24e97e1bc96a693c31ba547d3484beb5f26236bca2d8bad"}
Sep 15 12:46:08.004315 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:08.004228    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:46:08.005373 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:08.005354    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpdqv" event={"ID":"6f70622b-5f37-4f27-af7e-1a1c091c31db","Type":"ContainerStarted","Data":"72dfefe4f7b8f5e816da77f6797cdb3278514071c533153aaca1be183e706161"}
Sep 15 12:46:08.036178 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:08.036125    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4gb4s" podStartSLOduration=67.434915926 podStartE2EDuration="1m12.036111075s" totalImagesPullingTime="4.601195149s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 12:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:46:08.033574928 +0000 UTC m=+71.754890459" watchObservedRunningTime="2026-09-15 12:46:08.036111075 +0000 UTC m=+71.757426610"
Sep 15 12:46:08.076590 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:08.076540    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tb86v" podStartSLOduration=67.496146605 podStartE2EDuration="1m12.076524972s" totalImagesPullingTime="4.580378367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:46:08.076055448 +0000 UTC m=+71.797370979" watchObservedRunningTime="2026-09-15 12:46:08.076524972 +0000 UTC m=+71.797840509"
Sep 15 12:46:09.010191 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:09.010150    2567 generic.go:356] "Generic (PLEG): container finished" podID="6f70622b-5f37-4f27-af7e-1a1c091c31db" containerID="dc6b6ee0f9bd6bdc59b38f570e84d5dc7cadb125f500e579e6b2a4a862a01e46" exitCode=0
Sep 15 12:46:09.010593 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:09.010244    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpdqv" event={"ID":"6f70622b-5f37-4f27-af7e-1a1c091c31db","Type":"ContainerDied","Data":"dc6b6ee0f9bd6bdc59b38f570e84d5dc7cadb125f500e579e6b2a4a862a01e46"}
Sep 15 12:46:10.016968 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:10.016934    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpdqv" event={"ID":"6f70622b-5f37-4f27-af7e-1a1c091c31db","Type":"ContainerStarted","Data":"f814fa2826304742fbad4baa3c75931e4097e38692efe233a70f6b3735ee4cb7"}
Sep 15 12:46:10.017471 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:10.017052    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpdqv" event={"ID":"6f70622b-5f37-4f27-af7e-1a1c091c31db","Type":"ContainerStarted","Data":"bf8b3d9ce4433e1a3b0428c02ac69abf3c3f192e8a706ae64ddb187656f503cf"}
Sep 15 12:46:12.026034 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:12.025998    2567 generic.go:356] "Generic (PLEG): container finished" podID="263ce796-912e-4ac2-8302-f79b565b5937" containerID="60d4dc7943bff17bcb2c8f49bef108569efb9fc7dedd9a9f52eba82290008b06" exitCode=0
Sep 15 12:46:12.026414 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:12.026067    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"263ce796-912e-4ac2-8302-f79b565b5937","Type":"ContainerDied","Data":"60d4dc7943bff17bcb2c8f49bef108569efb9fc7dedd9a9f52eba82290008b06"}
Sep 15 12:46:12.058358 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:12.058283    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dpdqv" podStartSLOduration=5.966329405 podStartE2EDuration="7.058266277s" totalImagesPullingTime="1.029423094s" totalInitContainerRuntime="62.513778ms" isStatefulPod=true podCreationTimestamp="2026-09-15 12:46:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:46:10.085798703 +0000 UTC m=+73.807114233" watchObservedRunningTime="2026-09-15 12:46:12.058266277 +0000 UTC m=+75.779581828"
Sep 15 12:46:15.044138 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:15.044104    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"263ce796-912e-4ac2-8302-f79b565b5937","Type":"ContainerStarted","Data":"3e53479c1b3fb71cd8029d15fbca8655cd7d41b7e4dbd84bf293a06dd6277ef9"}
Sep 15 12:46:15.044499 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:15.044171    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"263ce796-912e-4ac2-8302-f79b565b5937","Type":"ContainerStarted","Data":"75000dafcdc1465b823bff1bf7557f1587a1eedcb429652996cd6b6be2c03af4"}
Sep 15 12:46:15.044499 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:15.044197    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"263ce796-912e-4ac2-8302-f79b565b5937","Type":"ContainerStarted","Data":"36efccfe04d9da9b75ca98d0759d68e6b8289d970b01f4868ef83fb43271a9a7"}
Sep 15 12:46:15.044499 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:15.044235    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"263ce796-912e-4ac2-8302-f79b565b5937","Type":"ContainerStarted","Data":"779eac8f66a6fb0df48e9c18202cb0ac37cbf930d110d6bbb000ca681574c59c"}
Sep 15 12:46:15.044499 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:15.044258    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"263ce796-912e-4ac2-8302-f79b565b5937","Type":"ContainerStarted","Data":"1de97d1de54e1c0e142b178c752bd3be0606bd88dc91a30d0af0ea394f615170"}
Sep 15 12:46:17.053531 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:17.053498    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"263ce796-912e-4ac2-8302-f79b565b5937","Type":"ContainerStarted","Data":"3d66e78e496bb5d27749cdf63a310cc382d51c12ca600f5542659a2fdcbfe871"}
Sep 15 12:46:17.092932 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:17.092872    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.058701274 podStartE2EDuration="11.092851728s" totalImagesPullingTime="8.015989532s" totalInitContainerRuntime="18.160922ms" isStatefulPod=false podCreationTimestamp="2026-09-15 12:46:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:46:17.091814698 +0000 UTC m=+80.813130222" watchObservedRunningTime="2026-09-15 12:46:17.092851728 +0000 UTC m=+80.814167272"
Sep 15 12:46:39.012805 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:46:39.012775    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tb86v"
Sep 15 12:47:25.888019 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:25.887963    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 12:47:25.888530 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:25.888272    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="alertmanager" containerID="cri-o://1de97d1de54e1c0e142b178c752bd3be0606bd88dc91a30d0af0ea394f615170" gracePeriod=120
Sep 15 12:47:25.888530 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:25.888300    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="prom-label-proxy" containerID="cri-o://3d66e78e496bb5d27749cdf63a310cc382d51c12ca600f5542659a2fdcbfe871" gracePeriod=120
Sep 15 12:47:25.888530 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:25.888333    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="kube-rbac-proxy-web" containerID="cri-o://36efccfe04d9da9b75ca98d0759d68e6b8289d970b01f4868ef83fb43271a9a7" gracePeriod=120
Sep 15 12:47:25.888530 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:25.888342    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="kube-rbac-proxy" containerID="cri-o://75000dafcdc1465b823bff1bf7557f1587a1eedcb429652996cd6b6be2c03af4" gracePeriod=120
Sep 15 12:47:25.888530 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:25.888386    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="config-reloader" containerID="cri-o://779eac8f66a6fb0df48e9c18202cb0ac37cbf930d110d6bbb000ca681574c59c" gracePeriod=120
Sep 15 12:47:25.888530 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:25.888342    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="kube-rbac-proxy-metric" containerID="cri-o://3e53479c1b3fb71cd8029d15fbca8655cd7d41b7e4dbd84bf293a06dd6277ef9" gracePeriod=120
Sep 15 12:47:26.285415 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:26.285385    2567 generic.go:356] "Generic (PLEG): container finished" podID="263ce796-912e-4ac2-8302-f79b565b5937" containerID="3d66e78e496bb5d27749cdf63a310cc382d51c12ca600f5542659a2fdcbfe871" exitCode=0
Sep 15 12:47:26.285415 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:26.285409    2567 generic.go:356] "Generic (PLEG): container finished" podID="263ce796-912e-4ac2-8302-f79b565b5937" containerID="3e53479c1b3fb71cd8029d15fbca8655cd7d41b7e4dbd84bf293a06dd6277ef9" exitCode=0
Sep 15 12:47:26.285415 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:26.285415    2567 generic.go:356] "Generic (PLEG): container finished" podID="263ce796-912e-4ac2-8302-f79b565b5937" containerID="75000dafcdc1465b823bff1bf7557f1587a1eedcb429652996cd6b6be2c03af4" exitCode=0
Sep 15 12:47:26.285415 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:26.285420    2567 generic.go:356] "Generic (PLEG): container finished" podID="263ce796-912e-4ac2-8302-f79b565b5937" containerID="779eac8f66a6fb0df48e9c18202cb0ac37cbf930d110d6bbb000ca681574c59c" exitCode=0
Sep 15 12:47:26.285708 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:26.285426    2567 generic.go:356] "Generic (PLEG): container finished" podID="263ce796-912e-4ac2-8302-f79b565b5937" containerID="1de97d1de54e1c0e142b178c752bd3be0606bd88dc91a30d0af0ea394f615170" exitCode=0
Sep 15 12:47:26.285708 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:26.285460    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"263ce796-912e-4ac2-8302-f79b565b5937","Type":"ContainerDied","Data":"3d66e78e496bb5d27749cdf63a310cc382d51c12ca600f5542659a2fdcbfe871"}
Sep 15 12:47:26.285708 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:26.285525    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"263ce796-912e-4ac2-8302-f79b565b5937","Type":"ContainerDied","Data":"3e53479c1b3fb71cd8029d15fbca8655cd7d41b7e4dbd84bf293a06dd6277ef9"}
Sep 15 12:47:26.285708 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:26.285552    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"263ce796-912e-4ac2-8302-f79b565b5937","Type":"ContainerDied","Data":"75000dafcdc1465b823bff1bf7557f1587a1eedcb429652996cd6b6be2c03af4"}
Sep 15 12:47:26.285708 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:26.285577    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"263ce796-912e-4ac2-8302-f79b565b5937","Type":"ContainerDied","Data":"779eac8f66a6fb0df48e9c18202cb0ac37cbf930d110d6bbb000ca681574c59c"}
Sep 15 12:47:26.285708 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:26.285601    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"263ce796-912e-4ac2-8302-f79b565b5937","Type":"ContainerDied","Data":"1de97d1de54e1c0e142b178c752bd3be0606bd88dc91a30d0af0ea394f615170"}
Sep 15 12:47:27.117494 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.117458    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.195730 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.195692    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm9xg\" (UniqueName: \"kubernetes.io/projected/263ce796-912e-4ac2-8302-f79b565b5937-kube-api-access-gm9xg\") pod \"263ce796-912e-4ac2-8302-f79b565b5937\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") "
Sep 15 12:47:27.195897 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.195743    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/263ce796-912e-4ac2-8302-f79b565b5937-metrics-client-ca\") pod \"263ce796-912e-4ac2-8302-f79b565b5937\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") "
Sep 15 12:47:27.195897 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.195782    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/263ce796-912e-4ac2-8302-f79b565b5937-tls-assets\") pod \"263ce796-912e-4ac2-8302-f79b565b5937\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") "
Sep 15 12:47:27.195897 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.195823    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-kube-rbac-proxy-web\") pod \"263ce796-912e-4ac2-8302-f79b565b5937\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") "
Sep 15 12:47:27.195897 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.195857    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-cluster-tls-config\") pod \"263ce796-912e-4ac2-8302-f79b565b5937\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") "
Sep 15 12:47:27.196127 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.196001    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/263ce796-912e-4ac2-8302-f79b565b5937-alertmanager-trusted-ca-bundle\") pod \"263ce796-912e-4ac2-8302-f79b565b5937\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") "
Sep 15 12:47:27.196127 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.196091    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/263ce796-912e-4ac2-8302-f79b565b5937-config-out\") pod \"263ce796-912e-4ac2-8302-f79b565b5937\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") "
Sep 15 12:47:27.196127 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.196121    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-kube-rbac-proxy\") pod \"263ce796-912e-4ac2-8302-f79b565b5937\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") "
Sep 15 12:47:27.196292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.196191    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-kube-rbac-proxy-metric\") pod \"263ce796-912e-4ac2-8302-f79b565b5937\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") "
Sep 15 12:47:27.196292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.196245    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-web-config\") pod \"263ce796-912e-4ac2-8302-f79b565b5937\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") "
Sep 15 12:47:27.196292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.196273    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/263ce796-912e-4ac2-8302-f79b565b5937-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "263ce796-912e-4ac2-8302-f79b565b5937" (UID: "263ce796-912e-4ac2-8302-f79b565b5937"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:47:27.196433 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.196283    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-config-volume\") pod \"263ce796-912e-4ac2-8302-f79b565b5937\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") "
Sep 15 12:47:27.196433 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.196353    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-main-tls\") pod \"263ce796-912e-4ac2-8302-f79b565b5937\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") "
Sep 15 12:47:27.196433 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.196382    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/263ce796-912e-4ac2-8302-f79b565b5937-alertmanager-main-db\") pod \"263ce796-912e-4ac2-8302-f79b565b5937\" (UID: \"263ce796-912e-4ac2-8302-f79b565b5937\") "
Sep 15 12:47:27.196603 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.196581    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/263ce796-912e-4ac2-8302-f79b565b5937-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:47:27.196665 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.196626    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/263ce796-912e-4ac2-8302-f79b565b5937-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "263ce796-912e-4ac2-8302-f79b565b5937" (UID: "263ce796-912e-4ac2-8302-f79b565b5937"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:47:27.197097 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.197067    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/263ce796-912e-4ac2-8302-f79b565b5937-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "263ce796-912e-4ac2-8302-f79b565b5937" (UID: "263ce796-912e-4ac2-8302-f79b565b5937"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:47:27.199197 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.199151    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "263ce796-912e-4ac2-8302-f79b565b5937" (UID: "263ce796-912e-4ac2-8302-f79b565b5937"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:47:27.199723 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.199524    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/263ce796-912e-4ac2-8302-f79b565b5937-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "263ce796-912e-4ac2-8302-f79b565b5937" (UID: "263ce796-912e-4ac2-8302-f79b565b5937"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:47:27.199723 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.199665    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-config-volume" (OuterVolumeSpecName: "config-volume") pod "263ce796-912e-4ac2-8302-f79b565b5937" (UID: "263ce796-912e-4ac2-8302-f79b565b5937"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:47:27.200043 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.199876    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/263ce796-912e-4ac2-8302-f79b565b5937-kube-api-access-gm9xg" (OuterVolumeSpecName: "kube-api-access-gm9xg") pod "263ce796-912e-4ac2-8302-f79b565b5937" (UID: "263ce796-912e-4ac2-8302-f79b565b5937"). InnerVolumeSpecName "kube-api-access-gm9xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:47:27.201093 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.201055    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "263ce796-912e-4ac2-8302-f79b565b5937" (UID: "263ce796-912e-4ac2-8302-f79b565b5937"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:47:27.201193 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.201149    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "263ce796-912e-4ac2-8302-f79b565b5937" (UID: "263ce796-912e-4ac2-8302-f79b565b5937"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:47:27.201401 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.201375    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/263ce796-912e-4ac2-8302-f79b565b5937-config-out" (OuterVolumeSpecName: "config-out") pod "263ce796-912e-4ac2-8302-f79b565b5937" (UID: "263ce796-912e-4ac2-8302-f79b565b5937"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:47:27.201487 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.201399    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "263ce796-912e-4ac2-8302-f79b565b5937" (UID: "263ce796-912e-4ac2-8302-f79b565b5937"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:47:27.204470 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.204440    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "263ce796-912e-4ac2-8302-f79b565b5937" (UID: "263ce796-912e-4ac2-8302-f79b565b5937"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:47:27.209146 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.209125    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-web-config" (OuterVolumeSpecName: "web-config") pod "263ce796-912e-4ac2-8302-f79b565b5937" (UID: "263ce796-912e-4ac2-8302-f79b565b5937"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:47:27.295372 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.295341    2567 generic.go:356] "Generic (PLEG): container finished" podID="263ce796-912e-4ac2-8302-f79b565b5937" containerID="36efccfe04d9da9b75ca98d0759d68e6b8289d970b01f4868ef83fb43271a9a7" exitCode=0
Sep 15 12:47:27.295521 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.295428    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.295521 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.295427    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"263ce796-912e-4ac2-8302-f79b565b5937","Type":"ContainerDied","Data":"36efccfe04d9da9b75ca98d0759d68e6b8289d970b01f4868ef83fb43271a9a7"}
Sep 15 12:47:27.295593 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.295543    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"263ce796-912e-4ac2-8302-f79b565b5937","Type":"ContainerDied","Data":"a9a00f528df3e20fa9bae9eda6ba78e4b0cac09c45cc05c58dee911e369836e3"}
Sep 15 12:47:27.295624 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.295593    2567 scope.go:117] "RemoveContainer" containerID="3d66e78e496bb5d27749cdf63a310cc382d51c12ca600f5542659a2fdcbfe871"
Sep 15 12:47:27.297092 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.297074    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:47:27.297205 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.297110    2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-web-config\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:47:27.297205 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.297119    2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-config-volume\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:47:27.297205 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.297128    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-main-tls\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:47:27.297205 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.297137    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/263ce796-912e-4ac2-8302-f79b565b5937-alertmanager-main-db\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:47:27.297205 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.297151    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm9xg\" (UniqueName: \"kubernetes.io/projected/263ce796-912e-4ac2-8302-f79b565b5937-kube-api-access-gm9xg\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:47:27.297205 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.297161    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/263ce796-912e-4ac2-8302-f79b565b5937-metrics-client-ca\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:47:27.297205 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.297168    2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/263ce796-912e-4ac2-8302-f79b565b5937-tls-assets\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:47:27.297205 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.297176    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:47:27.297205 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.297184    2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-cluster-tls-config\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:47:27.297205 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.297192    2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/263ce796-912e-4ac2-8302-f79b565b5937-config-out\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:47:27.297205 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.297200    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/263ce796-912e-4ac2-8302-f79b565b5937-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:47:27.303018 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.302966    2567 scope.go:117] "RemoveContainer" containerID="3e53479c1b3fb71cd8029d15fbca8655cd7d41b7e4dbd84bf293a06dd6277ef9"
Sep 15 12:47:27.309524 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.309509    2567 scope.go:117] "RemoveContainer" containerID="75000dafcdc1465b823bff1bf7557f1587a1eedcb429652996cd6b6be2c03af4"
Sep 15 12:47:27.315651 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.315636    2567 scope.go:117] "RemoveContainer" containerID="36efccfe04d9da9b75ca98d0759d68e6b8289d970b01f4868ef83fb43271a9a7"
Sep 15 12:47:27.320861 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.320838    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 12:47:27.322238 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.322224    2567 scope.go:117] "RemoveContainer" containerID="779eac8f66a6fb0df48e9c18202cb0ac37cbf930d110d6bbb000ca681574c59c"
Sep 15 12:47:27.328561 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.328542    2567 scope.go:117] "RemoveContainer" containerID="1de97d1de54e1c0e142b178c752bd3be0606bd88dc91a30d0af0ea394f615170"
Sep 15 12:47:27.330696 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.330618    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 12:47:27.337340 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.337325    2567 scope.go:117] "RemoveContainer" containerID="60d4dc7943bff17bcb2c8f49bef108569efb9fc7dedd9a9f52eba82290008b06"
Sep 15 12:47:27.343639 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.343622    2567 scope.go:117] "RemoveContainer" containerID="3d66e78e496bb5d27749cdf63a310cc382d51c12ca600f5542659a2fdcbfe871"
Sep 15 12:47:27.343911 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:47:27.343886    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d66e78e496bb5d27749cdf63a310cc382d51c12ca600f5542659a2fdcbfe871\": container with ID starting with 3d66e78e496bb5d27749cdf63a310cc382d51c12ca600f5542659a2fdcbfe871 not found: ID does not exist" containerID="3d66e78e496bb5d27749cdf63a310cc382d51c12ca600f5542659a2fdcbfe871"
Sep 15 12:47:27.343949 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.343914    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d66e78e496bb5d27749cdf63a310cc382d51c12ca600f5542659a2fdcbfe871"} err="failed to get container status \"3d66e78e496bb5d27749cdf63a310cc382d51c12ca600f5542659a2fdcbfe871\": rpc error: code = NotFound desc = could not find container \"3d66e78e496bb5d27749cdf63a310cc382d51c12ca600f5542659a2fdcbfe871\": container with ID starting with 3d66e78e496bb5d27749cdf63a310cc382d51c12ca600f5542659a2fdcbfe871 not found: ID does not exist"
Sep 15 12:47:27.343949 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.343945    2567 scope.go:117] "RemoveContainer" containerID="3e53479c1b3fb71cd8029d15fbca8655cd7d41b7e4dbd84bf293a06dd6277ef9"
Sep 15 12:47:27.344191 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:47:27.344177    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e53479c1b3fb71cd8029d15fbca8655cd7d41b7e4dbd84bf293a06dd6277ef9\": container with ID starting with 3e53479c1b3fb71cd8029d15fbca8655cd7d41b7e4dbd84bf293a06dd6277ef9 not found: ID does not exist" containerID="3e53479c1b3fb71cd8029d15fbca8655cd7d41b7e4dbd84bf293a06dd6277ef9"
Sep 15 12:47:27.344244 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.344195    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e53479c1b3fb71cd8029d15fbca8655cd7d41b7e4dbd84bf293a06dd6277ef9"} err="failed to get container status \"3e53479c1b3fb71cd8029d15fbca8655cd7d41b7e4dbd84bf293a06dd6277ef9\": rpc error: code = NotFound desc = could not find container \"3e53479c1b3fb71cd8029d15fbca8655cd7d41b7e4dbd84bf293a06dd6277ef9\": container with ID starting with 3e53479c1b3fb71cd8029d15fbca8655cd7d41b7e4dbd84bf293a06dd6277ef9 not found: ID does not exist"
Sep 15 12:47:27.344244 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.344207    2567 scope.go:117] "RemoveContainer" containerID="75000dafcdc1465b823bff1bf7557f1587a1eedcb429652996cd6b6be2c03af4"
Sep 15 12:47:27.344453 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:47:27.344437    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75000dafcdc1465b823bff1bf7557f1587a1eedcb429652996cd6b6be2c03af4\": container with ID starting with 75000dafcdc1465b823bff1bf7557f1587a1eedcb429652996cd6b6be2c03af4 not found: ID does not exist" containerID="75000dafcdc1465b823bff1bf7557f1587a1eedcb429652996cd6b6be2c03af4"
Sep 15 12:47:27.344494 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.344458    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75000dafcdc1465b823bff1bf7557f1587a1eedcb429652996cd6b6be2c03af4"} err="failed to get container status \"75000dafcdc1465b823bff1bf7557f1587a1eedcb429652996cd6b6be2c03af4\": rpc error: code = NotFound desc = could not find container \"75000dafcdc1465b823bff1bf7557f1587a1eedcb429652996cd6b6be2c03af4\": container with ID starting with 75000dafcdc1465b823bff1bf7557f1587a1eedcb429652996cd6b6be2c03af4 not found: ID does not exist"
Sep 15 12:47:27.344494 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.344474    2567 scope.go:117] "RemoveContainer" containerID="36efccfe04d9da9b75ca98d0759d68e6b8289d970b01f4868ef83fb43271a9a7"
Sep 15 12:47:27.344733 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:47:27.344714    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36efccfe04d9da9b75ca98d0759d68e6b8289d970b01f4868ef83fb43271a9a7\": container with ID starting with 36efccfe04d9da9b75ca98d0759d68e6b8289d970b01f4868ef83fb43271a9a7 not found: ID does not exist" containerID="36efccfe04d9da9b75ca98d0759d68e6b8289d970b01f4868ef83fb43271a9a7"
Sep 15 12:47:27.344785 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.344736    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36efccfe04d9da9b75ca98d0759d68e6b8289d970b01f4868ef83fb43271a9a7"} err="failed to get container status \"36efccfe04d9da9b75ca98d0759d68e6b8289d970b01f4868ef83fb43271a9a7\": rpc error: code = NotFound desc = could not find container \"36efccfe04d9da9b75ca98d0759d68e6b8289d970b01f4868ef83fb43271a9a7\": container with ID starting with 36efccfe04d9da9b75ca98d0759d68e6b8289d970b01f4868ef83fb43271a9a7 not found: ID does not exist"
Sep 15 12:47:27.344785 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.344750    2567 scope.go:117] "RemoveContainer" containerID="779eac8f66a6fb0df48e9c18202cb0ac37cbf930d110d6bbb000ca681574c59c"
Sep 15 12:47:27.344971 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:47:27.344958    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"779eac8f66a6fb0df48e9c18202cb0ac37cbf930d110d6bbb000ca681574c59c\": container with ID starting with 779eac8f66a6fb0df48e9c18202cb0ac37cbf930d110d6bbb000ca681574c59c not found: ID does not exist" containerID="779eac8f66a6fb0df48e9c18202cb0ac37cbf930d110d6bbb000ca681574c59c"
Sep 15 12:47:27.345029 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.344987    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"779eac8f66a6fb0df48e9c18202cb0ac37cbf930d110d6bbb000ca681574c59c"} err="failed to get container status \"779eac8f66a6fb0df48e9c18202cb0ac37cbf930d110d6bbb000ca681574c59c\": rpc error: code = NotFound desc = could not find container \"779eac8f66a6fb0df48e9c18202cb0ac37cbf930d110d6bbb000ca681574c59c\": container with ID starting with 779eac8f66a6fb0df48e9c18202cb0ac37cbf930d110d6bbb000ca681574c59c not found: ID does not exist"
Sep 15 12:47:27.345029 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.345004    2567 scope.go:117] "RemoveContainer" containerID="1de97d1de54e1c0e142b178c752bd3be0606bd88dc91a30d0af0ea394f615170"
Sep 15 12:47:27.345232 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:47:27.345216    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1de97d1de54e1c0e142b178c752bd3be0606bd88dc91a30d0af0ea394f615170\": container with ID starting with 1de97d1de54e1c0e142b178c752bd3be0606bd88dc91a30d0af0ea394f615170 not found: ID does not exist" containerID="1de97d1de54e1c0e142b178c752bd3be0606bd88dc91a30d0af0ea394f615170"
Sep 15 12:47:27.345267 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.345235    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1de97d1de54e1c0e142b178c752bd3be0606bd88dc91a30d0af0ea394f615170"} err="failed to get container status \"1de97d1de54e1c0e142b178c752bd3be0606bd88dc91a30d0af0ea394f615170\": rpc error: code = NotFound desc = could not find container \"1de97d1de54e1c0e142b178c752bd3be0606bd88dc91a30d0af0ea394f615170\": container with ID starting with 1de97d1de54e1c0e142b178c752bd3be0606bd88dc91a30d0af0ea394f615170 not found: ID does not exist"
Sep 15 12:47:27.345267 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.345248    2567 scope.go:117] "RemoveContainer" containerID="60d4dc7943bff17bcb2c8f49bef108569efb9fc7dedd9a9f52eba82290008b06"
Sep 15 12:47:27.345484 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:47:27.345461    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60d4dc7943bff17bcb2c8f49bef108569efb9fc7dedd9a9f52eba82290008b06\": container with ID starting with 60d4dc7943bff17bcb2c8f49bef108569efb9fc7dedd9a9f52eba82290008b06 not found: ID does not exist" containerID="60d4dc7943bff17bcb2c8f49bef108569efb9fc7dedd9a9f52eba82290008b06"
Sep 15 12:47:27.345538 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.345486    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60d4dc7943bff17bcb2c8f49bef108569efb9fc7dedd9a9f52eba82290008b06"} err="failed to get container status \"60d4dc7943bff17bcb2c8f49bef108569efb9fc7dedd9a9f52eba82290008b06\": rpc error: code = NotFound desc = could not find container \"60d4dc7943bff17bcb2c8f49bef108569efb9fc7dedd9a9f52eba82290008b06\": container with ID starting with 60d4dc7943bff17bcb2c8f49bef108569efb9fc7dedd9a9f52eba82290008b06 not found: ID does not exist"
Sep 15 12:47:27.363612 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363589    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 12:47:27.363811 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363798    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="init-config-reloader"
Sep 15 12:47:27.363850 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363813    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="init-config-reloader"
Sep 15 12:47:27.363850 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363842    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="alertmanager"
Sep 15 12:47:27.363850 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363848    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="alertmanager"
Sep 15 12:47:27.363940 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363855    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="kube-rbac-proxy-metric"
Sep 15 12:47:27.363940 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363860    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="kube-rbac-proxy-metric"
Sep 15 12:47:27.363940 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363867    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="config-reloader"
Sep 15 12:47:27.363940 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363872    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="config-reloader"
Sep 15 12:47:27.363940 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363879    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="kube-rbac-proxy-web"
Sep 15 12:47:27.363940 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363884    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="kube-rbac-proxy-web"
Sep 15 12:47:27.363940 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363891    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="prom-label-proxy"
Sep 15 12:47:27.363940 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363895    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="prom-label-proxy"
Sep 15 12:47:27.363940 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363902    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="kube-rbac-proxy"
Sep 15 12:47:27.363940 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363907    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="kube-rbac-proxy"
Sep 15 12:47:27.363940 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363942    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="config-reloader"
Sep 15 12:47:27.364249 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363949    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="alertmanager"
Sep 15 12:47:27.364249 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363955    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="kube-rbac-proxy"
Sep 15 12:47:27.364249 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363961    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="kube-rbac-proxy-web"
Sep 15 12:47:27.364249 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363967    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="prom-label-proxy"
Sep 15 12:47:27.364249 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.363992    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="263ce796-912e-4ac2-8302-f79b565b5937" containerName="kube-rbac-proxy-metric"
Sep 15 12:47:27.367408 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.367393    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.369631 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.369611    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 15 12:47:27.369724 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.369677    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 15 12:47:27.369793 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.369720    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 15 12:47:27.369846 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.369809    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 15 12:47:27.369990 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.369950    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 15 12:47:27.369990 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.369961    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 15 12:47:27.370155 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.370058    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 15 12:47:27.370155 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.370144    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-skf8d\""
Sep 15 12:47:27.370483 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.370466    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 15 12:47:27.376592 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.376570    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 15 12:47:27.386438 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.386416    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 12:47:27.398336 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.398316    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.398422 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.398342    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-web-config\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.398422 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.398368    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.398488 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.398416    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.398488 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.398456    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.398488 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.398477    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.398579 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.398501    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.398579 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.398528    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.398579 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.398551    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-config-volume\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.398579 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.398569    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.398705 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.398585    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.398705 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.398609    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgbsx\" (UniqueName: \"kubernetes.io/projected/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-kube-api-access-vgbsx\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.398705 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.398634    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-config-out\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.499270 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.499184    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-config-volume\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.499270 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.499221    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.499270 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.499239    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.499270 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.499259    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgbsx\" (UniqueName: \"kubernetes.io/projected/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-kube-api-access-vgbsx\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.499571 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.499289    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-config-out\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.499571 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.499327    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.499571 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.499450    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-web-config\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.499571 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.499516    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.499571 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.499543    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.499814 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.499578    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.499873 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.499814    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.500517 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.500138    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.500517 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.500176    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.500517 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.500430    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.500517 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.500428    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.500517 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.500500    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.502366 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.502339    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-config-out\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.502473 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.502403    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.502525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.502466    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.502840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.502801    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-config-volume\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.502840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.502829    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.502963 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.502863    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-web-config\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.503162 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.503139    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.503695 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.503678    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.503808 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.503789    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.508592 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.508574    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgbsx\" (UniqueName: \"kubernetes.io/projected/8155cb57-9298-4bf5-99b4-a3ddbca3ae5a-kube-api-access-vgbsx\") pod \"alertmanager-main-0\" (UID: \"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.678291 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.678246    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 15 12:47:27.955621 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:27.955586    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 15 12:47:27.957273 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:47:27.957244    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8155cb57_9298_4bf5_99b4_a3ddbca3ae5a.slice/crio-1668bd3b9dfd9e81bd7c797089f4a14c2a9471f75f11f505bff8b7f6d317865d WatchSource:0}: Error finding container 1668bd3b9dfd9e81bd7c797089f4a14c2a9471f75f11f505bff8b7f6d317865d: Status 404 returned error can't find the container with id 1668bd3b9dfd9e81bd7c797089f4a14c2a9471f75f11f505bff8b7f6d317865d
Sep 15 12:47:28.301434 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:28.301346    2567 generic.go:356] "Generic (PLEG): container finished" podID="8155cb57-9298-4bf5-99b4-a3ddbca3ae5a" containerID="871f84ab7a6e70dde4ff1fb6f5344a08f8ad09866d5a74aa720df6d3be1a0626" exitCode=0
Sep 15 12:47:28.301434 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:28.301405    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a","Type":"ContainerDied","Data":"871f84ab7a6e70dde4ff1fb6f5344a08f8ad09866d5a74aa720df6d3be1a0626"}
Sep 15 12:47:28.301833 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:28.301458    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a","Type":"ContainerStarted","Data":"1668bd3b9dfd9e81bd7c797089f4a14c2a9471f75f11f505bff8b7f6d317865d"}
Sep 15 12:47:28.711446 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:28.711417    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="263ce796-912e-4ac2-8302-f79b565b5937" path="/var/lib/kubelet/pods/263ce796-912e-4ac2-8302-f79b565b5937/volumes"
Sep 15 12:47:29.307769 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:29.307732    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a","Type":"ContainerStarted","Data":"2f1bb1808ebef3bcc288d6b4ab58a1397346b6bef367696f5e3f2ae0cc6e420d"}
Sep 15 12:47:29.308157 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:29.307826    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a","Type":"ContainerStarted","Data":"c627c59c7cddbf7c95ad696d4ef561ecfd8c79d8fbdafd5c6222da138ae5df0a"}
Sep 15 12:47:29.308157 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:29.307857    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a","Type":"ContainerStarted","Data":"7d99a8b78fecc8549e3f16c277aeeb6d13bb145ecf2508f17abf2b133957e7ce"}
Sep 15 12:47:29.308157 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:29.307886    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a","Type":"ContainerStarted","Data":"8fdc27ba2d1d983b425adce1cffae53453f0d27d9f445d67f8c979ce46500188"}
Sep 15 12:47:29.308157 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:29.307913    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a","Type":"ContainerStarted","Data":"1327858f2eb4c9cca45ca9920b37dce262c7b39d42db3e4ca1de302959b116eb"}
Sep 15 12:47:29.308157 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:29.307939    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8155cb57-9298-4bf5-99b4-a3ddbca3ae5a","Type":"ContainerStarted","Data":"5b2d85fdebf74b66332fa10ae7b1adacb2be96b30d6c07726dbde64bd6451679"}
Sep 15 12:47:29.348817 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:29.348771    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.330609478 podStartE2EDuration="2.348756933s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.147455ms" isStatefulPod=false podCreationTimestamp="2026-09-15 12:47:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:47:29.347313388 +0000 UTC m=+153.068628921" watchObservedRunningTime="2026-09-15 12:47:29.348756933 +0000 UTC m=+153.070072464"
Sep 15 12:47:30.070457 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.070422    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-b87466bdc-2gbq5"]
Sep 15 12:47:30.073049 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.073033    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.075356 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.075335    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 15 12:47:30.075560 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.075546    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 15 12:47:30.075796 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.075763    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 15 12:47:30.075940 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.075793    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 15 12:47:30.076049 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.076036    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-f972c\""
Sep 15 12:47:30.076507 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.076463    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 15 12:47:30.081620 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.081598    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 15 12:47:30.090807 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.090786    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b87466bdc-2gbq5"]
Sep 15 12:47:30.119635 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.119606    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ckn6\" (UniqueName: \"kubernetes.io/projected/545ed919-0186-4899-af48-82621ab11143-kube-api-access-2ckn6\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.119750 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.119644    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/545ed919-0186-4899-af48-82621ab11143-serving-certs-ca-bundle\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.119750 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.119667    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/545ed919-0186-4899-af48-82621ab11143-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.119835 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.119756    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/545ed919-0186-4899-af48-82621ab11143-federate-client-tls\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.119835 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.119787    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/545ed919-0186-4899-af48-82621ab11143-secret-telemeter-client\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.119835 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.119814    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/545ed919-0186-4899-af48-82621ab11143-metrics-client-ca\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.119927 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.119874    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/545ed919-0186-4899-af48-82621ab11143-telemeter-client-tls\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.119927 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.119915    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/545ed919-0186-4899-af48-82621ab11143-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.220964 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.220929    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/545ed919-0186-4899-af48-82621ab11143-metrics-client-ca\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.220964 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.220969    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/545ed919-0186-4899-af48-82621ab11143-telemeter-client-tls\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.221150 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.221022    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/545ed919-0186-4899-af48-82621ab11143-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.221150 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.221040    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ckn6\" (UniqueName: \"kubernetes.io/projected/545ed919-0186-4899-af48-82621ab11143-kube-api-access-2ckn6\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.221150 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.221063    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/545ed919-0186-4899-af48-82621ab11143-serving-certs-ca-bundle\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.221150 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.221089    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/545ed919-0186-4899-af48-82621ab11143-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.221150 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.221140    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/545ed919-0186-4899-af48-82621ab11143-federate-client-tls\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.221396 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.221182    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/545ed919-0186-4899-af48-82621ab11143-secret-telemeter-client\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.221892 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.221861    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/545ed919-0186-4899-af48-82621ab11143-metrics-client-ca\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.222022 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.221930    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/545ed919-0186-4899-af48-82621ab11143-serving-certs-ca-bundle\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.222094 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.222039    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/545ed919-0186-4899-af48-82621ab11143-telemeter-trusted-ca-bundle\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.223601 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.223581    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/545ed919-0186-4899-af48-82621ab11143-telemeter-client-tls\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.223711 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.223689    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/545ed919-0186-4899-af48-82621ab11143-secret-telemeter-client\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.223905 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.223887    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/545ed919-0186-4899-af48-82621ab11143-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.224090 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.224070    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/545ed919-0186-4899-af48-82621ab11143-federate-client-tls\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.229573 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.229551    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ckn6\" (UniqueName: \"kubernetes.io/projected/545ed919-0186-4899-af48-82621ab11143-kube-api-access-2ckn6\") pod \"telemeter-client-b87466bdc-2gbq5\" (UID: \"545ed919-0186-4899-af48-82621ab11143\") " pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.382828 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.382754    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5"
Sep 15 12:47:30.654847 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:30.654826    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-b87466bdc-2gbq5"]
Sep 15 12:47:30.656730 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:47:30.656698    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545ed919_0186_4899_af48_82621ab11143.slice/crio-4a7a4f376d485eab2b0664dd694f0083528a07e38688e60bfc1840c01c3d0229 WatchSource:0}: Error finding container 4a7a4f376d485eab2b0664dd694f0083528a07e38688e60bfc1840c01c3d0229: Status 404 returned error can't find the container with id 4a7a4f376d485eab2b0664dd694f0083528a07e38688e60bfc1840c01c3d0229
Sep 15 12:47:31.316689 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:31.316656    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5" event={"ID":"545ed919-0186-4899-af48-82621ab11143","Type":"ContainerStarted","Data":"4a7a4f376d485eab2b0664dd694f0083528a07e38688e60bfc1840c01c3d0229"}
Sep 15 12:47:33.326744 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:33.326673    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5" event={"ID":"545ed919-0186-4899-af48-82621ab11143","Type":"ContainerStarted","Data":"86d42c3d04d6f7c11bed67d158a8e537d655e62c6a1f0f19d5a2bf07a275594e"}
Sep 15 12:47:33.327137 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:33.326778    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5" event={"ID":"545ed919-0186-4899-af48-82621ab11143","Type":"ContainerStarted","Data":"f46fa92776a5a9084fa010addcb07b5294e65f922c95d97b394e52be28ebcb0e"}
Sep 15 12:47:33.327137 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:33.326809    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5" event={"ID":"545ed919-0186-4899-af48-82621ab11143","Type":"ContainerStarted","Data":"c8ed54a3ef634aafd770750bb3cabbf22b4f0e015d94d64a7d7b9eb42983e393"}
Sep 15 12:47:33.353954 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:47:33.353909    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-b87466bdc-2gbq5" podStartSLOduration=1.534437539 podStartE2EDuration="3.353896018s" totalImagesPullingTime="1.819458479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:47:33.35296804 +0000 UTC m=+157.074283572" watchObservedRunningTime="2026-09-15 12:47:33.353896018 +0000 UTC m=+157.075211549"
Sep 15 12:49:56.601552 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:49:56.601521    2567 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 12:50:52.188306 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:50:52.188220    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4lvcx"]
Sep 15 12:50:52.191393 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:50:52.191374    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4lvcx"
Sep 15 12:50:52.194897 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:50:52.194878    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 15 12:50:52.194897 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:50:52.194892    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 15 12:50:52.195079 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:50:52.194934    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-qt47t\""
Sep 15 12:50:52.207842 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:50:52.207820    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4lvcx"]
Sep 15 12:50:52.224187 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:50:52.224160    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c48ebf1-6bc9-47ca-9948-7da6fc2b55ee-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4lvcx\" (UID: \"3c48ebf1-6bc9-47ca-9948-7da6fc2b55ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4lvcx"
Sep 15 12:50:52.224290 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:50:52.224250    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpgtr\" (UniqueName: \"kubernetes.io/projected/3c48ebf1-6bc9-47ca-9948-7da6fc2b55ee-kube-api-access-hpgtr\") pod \"cert-manager-cainjector-559cdd8c87-4lvcx\" (UID: \"3c48ebf1-6bc9-47ca-9948-7da6fc2b55ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4lvcx"
Sep 15 12:50:52.325398 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:50:52.325373    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpgtr\" (UniqueName: \"kubernetes.io/projected/3c48ebf1-6bc9-47ca-9948-7da6fc2b55ee-kube-api-access-hpgtr\") pod \"cert-manager-cainjector-559cdd8c87-4lvcx\" (UID: \"3c48ebf1-6bc9-47ca-9948-7da6fc2b55ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4lvcx"
Sep 15 12:50:52.325488 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:50:52.325412    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c48ebf1-6bc9-47ca-9948-7da6fc2b55ee-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4lvcx\" (UID: \"3c48ebf1-6bc9-47ca-9948-7da6fc2b55ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4lvcx"
Sep 15 12:50:52.334986 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:50:52.334943    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3c48ebf1-6bc9-47ca-9948-7da6fc2b55ee-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4lvcx\" (UID: \"3c48ebf1-6bc9-47ca-9948-7da6fc2b55ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4lvcx"
Sep 15 12:50:52.335065 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:50:52.335032    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpgtr\" (UniqueName: \"kubernetes.io/projected/3c48ebf1-6bc9-47ca-9948-7da6fc2b55ee-kube-api-access-hpgtr\") pod \"cert-manager-cainjector-559cdd8c87-4lvcx\" (UID: \"3c48ebf1-6bc9-47ca-9948-7da6fc2b55ee\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4lvcx"
Sep 15 12:50:52.499743 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:50:52.499670    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4lvcx"
Sep 15 12:50:52.767352 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:50:52.767151    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4lvcx"]
Sep 15 12:50:52.769841 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:50:52.769814    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c48ebf1_6bc9_47ca_9948_7da6fc2b55ee.slice/crio-5b9201c91af070f02ecd8ee2eb0602eb94c6ae7ca830d367dd9b3dfd670d5309 WatchSource:0}: Error finding container 5b9201c91af070f02ecd8ee2eb0602eb94c6ae7ca830d367dd9b3dfd670d5309: Status 404 returned error can't find the container with id 5b9201c91af070f02ecd8ee2eb0602eb94c6ae7ca830d367dd9b3dfd670d5309
Sep 15 12:50:52.771999 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:50:52.771968    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 12:50:52.999537 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:50:52.999504    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4lvcx" event={"ID":"3c48ebf1-6bc9-47ca-9948-7da6fc2b55ee","Type":"ContainerStarted","Data":"5b9201c91af070f02ecd8ee2eb0602eb94c6ae7ca830d367dd9b3dfd670d5309"}
Sep 15 12:51:01.029674 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:01.029579    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4lvcx" event={"ID":"3c48ebf1-6bc9-47ca-9948-7da6fc2b55ee","Type":"ContainerStarted","Data":"c0b43c52c6c382bdc0a6a2c470d8418c68cab4a21e549b2f62b487a58851a786"}
Sep 15 12:51:01.046853 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:01.046793    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4lvcx" podStartSLOduration=1.098185864 podStartE2EDuration="9.046779017s" totalImagesPullingTime="7.948593153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:51:01.045224875 +0000 UTC m=+364.766540406" watchObservedRunningTime="2026-09-15 12:51:01.046779017 +0000 UTC m=+364.768094549"
Sep 15 12:51:26.540663 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.540627    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"]
Sep 15 12:51:26.543682 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.543664    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"
Sep 15 12:51:26.546673 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.546650    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 15 12:51:26.546804 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.546652    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 15 12:51:26.546804 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.546776    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 15 12:51:26.546938 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.546920    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-g67c7\""
Sep 15 12:51:26.547193 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.547178    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 15 12:51:26.596109 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.596083    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"]
Sep 15 12:51:26.676484 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.676447    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a86abf55-31d6-40cc-a26e-c194e363788a-webhook-cert\") pod \"opendatahub-operator-controller-manager-79946fddd6-psd6d\" (UID: \"a86abf55-31d6-40cc-a26e-c194e363788a\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"
Sep 15 12:51:26.676650 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.676496    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92kpx\" (UniqueName: \"kubernetes.io/projected/a86abf55-31d6-40cc-a26e-c194e363788a-kube-api-access-92kpx\") pod \"opendatahub-operator-controller-manager-79946fddd6-psd6d\" (UID: \"a86abf55-31d6-40cc-a26e-c194e363788a\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"
Sep 15 12:51:26.676650 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.676529    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a86abf55-31d6-40cc-a26e-c194e363788a-tmp\") pod \"opendatahub-operator-controller-manager-79946fddd6-psd6d\" (UID: \"a86abf55-31d6-40cc-a26e-c194e363788a\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"
Sep 15 12:51:26.676650 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.676555    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a86abf55-31d6-40cc-a26e-c194e363788a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79946fddd6-psd6d\" (UID: \"a86abf55-31d6-40cc-a26e-c194e363788a\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"
Sep 15 12:51:26.676650 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.676589    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a86abf55-31d6-40cc-a26e-c194e363788a-manifests\") pod \"opendatahub-operator-controller-manager-79946fddd6-psd6d\" (UID: \"a86abf55-31d6-40cc-a26e-c194e363788a\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"
Sep 15 12:51:26.777596 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.777565    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a86abf55-31d6-40cc-a26e-c194e363788a-webhook-cert\") pod \"opendatahub-operator-controller-manager-79946fddd6-psd6d\" (UID: \"a86abf55-31d6-40cc-a26e-c194e363788a\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"
Sep 15 12:51:26.777791 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.777601    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92kpx\" (UniqueName: \"kubernetes.io/projected/a86abf55-31d6-40cc-a26e-c194e363788a-kube-api-access-92kpx\") pod \"opendatahub-operator-controller-manager-79946fddd6-psd6d\" (UID: \"a86abf55-31d6-40cc-a26e-c194e363788a\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"
Sep 15 12:51:26.777791 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.777636    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a86abf55-31d6-40cc-a26e-c194e363788a-tmp\") pod \"opendatahub-operator-controller-manager-79946fddd6-psd6d\" (UID: \"a86abf55-31d6-40cc-a26e-c194e363788a\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"
Sep 15 12:51:26.777791 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.777660    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a86abf55-31d6-40cc-a26e-c194e363788a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79946fddd6-psd6d\" (UID: \"a86abf55-31d6-40cc-a26e-c194e363788a\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"
Sep 15 12:51:26.777791 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.777699    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a86abf55-31d6-40cc-a26e-c194e363788a-manifests\") pod \"opendatahub-operator-controller-manager-79946fddd6-psd6d\" (UID: \"a86abf55-31d6-40cc-a26e-c194e363788a\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"
Sep 15 12:51:26.778116 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.778094    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a86abf55-31d6-40cc-a26e-c194e363788a-manifests\") pod \"opendatahub-operator-controller-manager-79946fddd6-psd6d\" (UID: \"a86abf55-31d6-40cc-a26e-c194e363788a\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"
Sep 15 12:51:26.779819 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.779800    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a86abf55-31d6-40cc-a26e-c194e363788a-tmp\") pod \"opendatahub-operator-controller-manager-79946fddd6-psd6d\" (UID: \"a86abf55-31d6-40cc-a26e-c194e363788a\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"
Sep 15 12:51:26.780153 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.780133    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a86abf55-31d6-40cc-a26e-c194e363788a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79946fddd6-psd6d\" (UID: \"a86abf55-31d6-40cc-a26e-c194e363788a\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"
Sep 15 12:51:26.780219 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.780151    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a86abf55-31d6-40cc-a26e-c194e363788a-webhook-cert\") pod \"opendatahub-operator-controller-manager-79946fddd6-psd6d\" (UID: \"a86abf55-31d6-40cc-a26e-c194e363788a\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"
Sep 15 12:51:26.788698 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.788669    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92kpx\" (UniqueName: \"kubernetes.io/projected/a86abf55-31d6-40cc-a26e-c194e363788a-kube-api-access-92kpx\") pod \"opendatahub-operator-controller-manager-79946fddd6-psd6d\" (UID: \"a86abf55-31d6-40cc-a26e-c194e363788a\") " pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"
Sep 15 12:51:26.853793 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:26.853707    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"
Sep 15 12:51:27.129276 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:27.129250    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"]
Sep 15 12:51:27.133537 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:51:27.133506    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda86abf55_31d6_40cc_a26e_c194e363788a.slice/crio-96cdcbba83b6f5ca9658380b37798ec27bb917c055bdfdfce071a67090bd47dd WatchSource:0}: Error finding container 96cdcbba83b6f5ca9658380b37798ec27bb917c055bdfdfce071a67090bd47dd: Status 404 returned error can't find the container with id 96cdcbba83b6f5ca9658380b37798ec27bb917c055bdfdfce071a67090bd47dd
Sep 15 12:51:28.124066 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:28.124025    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d" event={"ID":"a86abf55-31d6-40cc-a26e-c194e363788a","Type":"ContainerStarted","Data":"96cdcbba83b6f5ca9658380b37798ec27bb917c055bdfdfce071a67090bd47dd"}
Sep 15 12:51:31.137471 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:31.137430    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d" event={"ID":"a86abf55-31d6-40cc-a26e-c194e363788a","Type":"ContainerStarted","Data":"461ec1115ca9a6dbce8b8f54306ca6f1ec39cb791520b77558c20c3b87c55da7"}
Sep 15 12:51:32.142408 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:32.142374    2567 generic.go:356] "Generic (PLEG): container finished" podID="a86abf55-31d6-40cc-a26e-c194e363788a" containerID="461ec1115ca9a6dbce8b8f54306ca6f1ec39cb791520b77558c20c3b87c55da7" exitCode=0
Sep 15 12:51:32.142856 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:32.142461    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d" event={"ID":"a86abf55-31d6-40cc-a26e-c194e363788a","Type":"ContainerDied","Data":"461ec1115ca9a6dbce8b8f54306ca6f1ec39cb791520b77558c20c3b87c55da7"}
Sep 15 12:51:33.147757 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:33.147713    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d" event={"ID":"a86abf55-31d6-40cc-a26e-c194e363788a","Type":"ContainerStarted","Data":"918456f40fed580bca52aaeb5d7234e0859af4ad964abdf1bb310f39dca2924d"}
Sep 15 12:51:33.148250 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:33.147832    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"
Sep 15 12:51:44.154459 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:44.154426    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d"
Sep 15 12:51:44.179947 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:44.179896    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79946fddd6-psd6d" podStartSLOduration=13.761082278 podStartE2EDuration="18.179879338s" totalImagesPullingTime="3.385903586s" totalInitContainerRuntime="1.032893474s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:51:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:51:33.191176255 +0000 UTC m=+396.912491786" watchObservedRunningTime="2026-09-15 12:51:44.179879338 +0000 UTC m=+407.901194868"
Sep 15 12:51:46.492918 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:46.492884    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7cfb95df68-n7v4d"]
Sep 15 12:51:46.502846 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:46.502820    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cfb95df68-n7v4d"
Sep 15 12:51:46.514446 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:46.514428    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 15 12:51:46.520486 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:46.520467    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 12:51:46.520659 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:46.520648    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 15 12:51:46.521048 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:46.521033    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 12:51:46.549885 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:46.549860    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cfb95df68-n7v4d"]
Sep 15 12:51:46.641536 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:46.641497    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fprlp\" (UniqueName: \"kubernetes.io/projected/9682dc5b-5b44-4e08-9eb1-4cc4cf00f396-kube-api-access-fprlp\") pod \"kube-auth-proxy-7cfb95df68-n7v4d\" (UID: \"9682dc5b-5b44-4e08-9eb1-4cc4cf00f396\") " pod="openshift-ingress/kube-auth-proxy-7cfb95df68-n7v4d"
Sep 15 12:51:46.641536 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:46.641540    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9682dc5b-5b44-4e08-9eb1-4cc4cf00f396-tmp\") pod \"kube-auth-proxy-7cfb95df68-n7v4d\" (UID: \"9682dc5b-5b44-4e08-9eb1-4cc4cf00f396\") " pod="openshift-ingress/kube-auth-proxy-7cfb95df68-n7v4d"
Sep 15 12:51:46.641740 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:46.641604    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9682dc5b-5b44-4e08-9eb1-4cc4cf00f396-tls-certs\") pod \"kube-auth-proxy-7cfb95df68-n7v4d\" (UID: \"9682dc5b-5b44-4e08-9eb1-4cc4cf00f396\") " pod="openshift-ingress/kube-auth-proxy-7cfb95df68-n7v4d"
Sep 15 12:51:46.742619 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:46.742591    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9682dc5b-5b44-4e08-9eb1-4cc4cf00f396-tls-certs\") pod \"kube-auth-proxy-7cfb95df68-n7v4d\" (UID: \"9682dc5b-5b44-4e08-9eb1-4cc4cf00f396\") " pod="openshift-ingress/kube-auth-proxy-7cfb95df68-n7v4d"
Sep 15 12:51:46.742781 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:46.742636    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fprlp\" (UniqueName: \"kubernetes.io/projected/9682dc5b-5b44-4e08-9eb1-4cc4cf00f396-kube-api-access-fprlp\") pod \"kube-auth-proxy-7cfb95df68-n7v4d\" (UID: \"9682dc5b-5b44-4e08-9eb1-4cc4cf00f396\") " pod="openshift-ingress/kube-auth-proxy-7cfb95df68-n7v4d"
Sep 15 12:51:46.742781 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:46.742659    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9682dc5b-5b44-4e08-9eb1-4cc4cf00f396-tmp\") pod \"kube-auth-proxy-7cfb95df68-n7v4d\" (UID: \"9682dc5b-5b44-4e08-9eb1-4cc4cf00f396\") " pod="openshift-ingress/kube-auth-proxy-7cfb95df68-n7v4d"
Sep 15 12:51:46.744809 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:46.744759    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9682dc5b-5b44-4e08-9eb1-4cc4cf00f396-tmp\") pod \"kube-auth-proxy-7cfb95df68-n7v4d\" (UID: \"9682dc5b-5b44-4e08-9eb1-4cc4cf00f396\") " pod="openshift-ingress/kube-auth-proxy-7cfb95df68-n7v4d"
Sep 15 12:51:46.745046 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:46.745030    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9682dc5b-5b44-4e08-9eb1-4cc4cf00f396-tls-certs\") pod \"kube-auth-proxy-7cfb95df68-n7v4d\" (UID: \"9682dc5b-5b44-4e08-9eb1-4cc4cf00f396\") " pod="openshift-ingress/kube-auth-proxy-7cfb95df68-n7v4d"
Sep 15 12:51:46.756922 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:46.756899    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fprlp\" (UniqueName: \"kubernetes.io/projected/9682dc5b-5b44-4e08-9eb1-4cc4cf00f396-kube-api-access-fprlp\") pod \"kube-auth-proxy-7cfb95df68-n7v4d\" (UID: \"9682dc5b-5b44-4e08-9eb1-4cc4cf00f396\") " pod="openshift-ingress/kube-auth-proxy-7cfb95df68-n7v4d"
Sep 15 12:51:46.812210 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:46.812175    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cfb95df68-n7v4d"
Sep 15 12:51:47.102868 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:47.102797    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cfb95df68-n7v4d"]
Sep 15 12:51:47.114606 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:51:47.114573    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9682dc5b_5b44_4e08_9eb1_4cc4cf00f396.slice/crio-16a47fbd9277c2eac4e3fa7d32b5db77757fd8d74b3728407ff84d7a2cf5dd8b WatchSource:0}: Error finding container 16a47fbd9277c2eac4e3fa7d32b5db77757fd8d74b3728407ff84d7a2cf5dd8b: Status 404 returned error can't find the container with id 16a47fbd9277c2eac4e3fa7d32b5db77757fd8d74b3728407ff84d7a2cf5dd8b
Sep 15 12:51:47.200306 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:47.200269    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cfb95df68-n7v4d" event={"ID":"9682dc5b-5b44-4e08-9eb1-4cc4cf00f396","Type":"ContainerStarted","Data":"16a47fbd9277c2eac4e3fa7d32b5db77757fd8d74b3728407ff84d7a2cf5dd8b"}
Sep 15 12:51:48.413078 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.413035    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"]
Sep 15 12:51:48.416476 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.416426    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.419518 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.419311    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 15 12:51:48.420105 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.419691    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 15 12:51:48.420105 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.419885    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 15 12:51:48.420105 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.420097    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-z6t4h\""
Sep 15 12:51:48.421108 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.420926    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 12:51:48.433817 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.433765    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"]
Sep 15 12:51:48.557861 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.557823    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw5xf\" (UniqueName: \"kubernetes.io/projected/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-kube-api-access-dw5xf\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.558066 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.557878    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.558066 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.557906    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.558066 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.557950    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.558066 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.558030    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.558290 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.558066    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.558290 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.558111    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.659330 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.659290    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.659512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.659355    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw5xf\" (UniqueName: \"kubernetes.io/projected/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-kube-api-access-dw5xf\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.659512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.659389    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.659512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.659412    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.659512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.659450    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.659512 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.659492    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.659775 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.659526    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.660538 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.660474    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.662428 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.662376    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.662539 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.662431    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.662539 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.662477    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.663163 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.663108    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.676648 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.676387    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.682912 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.682882    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw5xf\" (UniqueName: \"kubernetes.io/projected/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-kube-api-access-dw5xf\") pod \"istiod-openshift-gateway-7b7995d5cd-jx8zv\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:48.729253 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:48.729219    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:50.058672 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:50.058590    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"]
Sep 15 12:51:50.061595 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:51:50.061562    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffa6e1d4_12b2_489b_ae34_e1d911b889c4.slice/crio-a0a5c5c795d9447951be219f8d6a76ab0399dd85db6d7328343b59c73f9dda3b WatchSource:0}: Error finding container a0a5c5c795d9447951be219f8d6a76ab0399dd85db6d7328343b59c73f9dda3b: Status 404 returned error can't find the container with id a0a5c5c795d9447951be219f8d6a76ab0399dd85db6d7328343b59c73f9dda3b
Sep 15 12:51:50.214911 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:50.214865    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cfb95df68-n7v4d" event={"ID":"9682dc5b-5b44-4e08-9eb1-4cc4cf00f396","Type":"ContainerStarted","Data":"04ca697d63903da65929535171bc6afe0912c50a0387d18f258318e04aa3bd5b"}
Sep 15 12:51:50.216108 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:50.216082    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv" event={"ID":"ffa6e1d4-12b2-489b-ae34-e1d911b889c4","Type":"ContainerStarted","Data":"a0a5c5c795d9447951be219f8d6a76ab0399dd85db6d7328343b59c73f9dda3b"}
Sep 15 12:51:50.247036 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:50.246953    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7cfb95df68-n7v4d" podStartSLOduration=1.5332017119999999 podStartE2EDuration="4.24693668s" totalImagesPullingTime="2.713734968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:51:50.245621763 +0000 UTC m=+413.966937294" watchObservedRunningTime="2026-09-15 12:51:50.24693668 +0000 UTC m=+413.968252210"
Sep 15 12:51:52.770917 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:52.770871    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 12:51:52.771202 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:52.770950    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 12:51:53.233155 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:53.233092    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv" event={"ID":"ffa6e1d4-12b2-489b-ae34-e1d911b889c4","Type":"ContainerStarted","Data":"981b1d170e1f6deb05769faf395b41718c679371371913d2386cc0764d8ec132"}
Sep 15 12:51:53.235266 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:53.234143    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:51:53.236297 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:53.236021    2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-jx8zv container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 12:51:53.236297 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:53.236075    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv" podUID="ffa6e1d4-12b2-489b-ae34-e1d911b889c4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 12:51:53.259730 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:53.259671    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv" podStartSLOduration=2.55271269 podStartE2EDuration="5.259649384s" totalImagesPullingTime="2.706936694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:51:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:51:53.258135274 +0000 UTC m=+416.979450807" watchObservedRunningTime="2026-09-15 12:51:53.259649384 +0000 UTC m=+416.980964919"
Sep 15 12:51:54.237298 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:51:54.237264    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:52:05.160727 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.160694    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"]
Sep 15 12:52:05.171015 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.170993    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.178530 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.178501    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"]
Sep 15 12:52:05.191819 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.191786    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.191948 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.191825    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.191948 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.191864    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.191948 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.191901    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvlzf\" (UniqueName: \"kubernetes.io/projected/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-kube-api-access-kvlzf\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.192135 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.191952    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.192135 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.192034    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.192135 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.192059    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.292763 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.292732    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvlzf\" (UniqueName: \"kubernetes.io/projected/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-kube-api-access-kvlzf\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.292763 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.292768    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.293063 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.292788    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.293063 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.292803    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.293063 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.292837    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.293063 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.292852    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.293063 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.292876    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.293790 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.293759    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.295314 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.295278    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.295417 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.295326    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.295417 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.295339    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.295530 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.295430    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.303348 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.303324    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvlzf\" (UniqueName: \"kubernetes.io/projected/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-kube-api-access-kvlzf\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.304045 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.304027    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4b35ed2-1140-4126-9a04-d0a6e4dcdd56-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-62ldp\" (UID: \"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.479760 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.479677    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:05.792840 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.792662    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"]
Sep 15 12:52:05.795377 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:52:05.795350    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4b35ed2_1140_4126_9a04_d0a6e4dcdd56.slice/crio-4a6bb20e25c4b57d6ad9f4501c93bd2bf0f47a8b915a7ec8f8b983ba1cff1885 WatchSource:0}: Error finding container 4a6bb20e25c4b57d6ad9f4501c93bd2bf0f47a8b915a7ec8f8b983ba1cff1885: Status 404 returned error can't find the container with id 4a6bb20e25c4b57d6ad9f4501c93bd2bf0f47a8b915a7ec8f8b983ba1cff1885
Sep 15 12:52:05.797493 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.797464    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 12:52:05.797552 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:05.797522    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 15 12:52:06.282538 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:06.282506    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp" event={"ID":"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56","Type":"ContainerStarted","Data":"00597019f82bdebaefd5317d504287503214f86de90a0b6fb31d63c846d9b60c"}
Sep 15 12:52:06.282938 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:06.282555    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp" event={"ID":"a4b35ed2-1140-4126-9a04-d0a6e4dcdd56","Type":"ContainerStarted","Data":"4a6bb20e25c4b57d6ad9f4501c93bd2bf0f47a8b915a7ec8f8b983ba1cff1885"}
Sep 15 12:52:06.282938 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:06.282664    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:06.284339 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:06.284314    2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-62ldp container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 12:52:06.284435 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:06.284362    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp" podUID="a4b35ed2-1140-4126-9a04-d0a6e4dcdd56" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 12:52:06.307389 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:06.307334    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp" podStartSLOduration=1.3073084289999999 podStartE2EDuration="1.307308429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:52:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:52:06.304958755 +0000 UTC m=+430.026274287" watchObservedRunningTime="2026-09-15 12:52:06.307308429 +0000 UTC m=+430.028623960"
Sep 15 12:52:07.287108 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.287068    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-62ldp"
Sep 15 12:52:07.411276 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.411245    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"]
Sep 15 12:52:07.411459 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.411438    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv" podUID="ffa6e1d4-12b2-489b-ae34-e1d911b889c4" containerName="discovery" containerID="cri-o://981b1d170e1f6deb05769faf395b41718c679371371913d2386cc0764d8ec132" gracePeriod=30
Sep 15 12:52:07.659817 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.659791    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:52:07.712597 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.712569    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw5xf\" (UniqueName: \"kubernetes.io/projected/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-kube-api-access-dw5xf\") pod \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") "
Sep 15 12:52:07.712752 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.712601    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-kubeconfig\") pod \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") "
Sep 15 12:52:07.712752 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.712629    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-csr-dns-cert\") pod \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") "
Sep 15 12:52:07.712752 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.712661    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-local-certs\") pod \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") "
Sep 15 12:52:07.712752 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.712695    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-token\") pod \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") "
Sep 15 12:52:07.712752 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.712731    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-csr-ca-configmap\") pod \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") "
Sep 15 12:52:07.713047 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.712781    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-cacerts\") pod \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\" (UID: \"ffa6e1d4-12b2-489b-ae34-e1d911b889c4\") "
Sep 15 12:52:07.713483 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.713452    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "ffa6e1d4-12b2-489b-ae34-e1d911b889c4" (UID: "ffa6e1d4-12b2-489b-ae34-e1d911b889c4"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:52:07.715306 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.715281    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-cacerts" (OuterVolumeSpecName: "cacerts") pod "ffa6e1d4-12b2-489b-ae34-e1d911b889c4" (UID: "ffa6e1d4-12b2-489b-ae34-e1d911b889c4"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:52:07.715393 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.715349    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-kube-api-access-dw5xf" (OuterVolumeSpecName: "kube-api-access-dw5xf") pod "ffa6e1d4-12b2-489b-ae34-e1d911b889c4" (UID: "ffa6e1d4-12b2-489b-ae34-e1d911b889c4"). InnerVolumeSpecName "kube-api-access-dw5xf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:52:07.715490 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.715460    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "ffa6e1d4-12b2-489b-ae34-e1d911b889c4" (UID: "ffa6e1d4-12b2-489b-ae34-e1d911b889c4"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:52:07.715539 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.715517    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-local-certs" (OuterVolumeSpecName: "local-certs") pod "ffa6e1d4-12b2-489b-ae34-e1d911b889c4" (UID: "ffa6e1d4-12b2-489b-ae34-e1d911b889c4"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 12:52:07.715589 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.715554    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-token" (OuterVolumeSpecName: "istio-token") pod "ffa6e1d4-12b2-489b-ae34-e1d911b889c4" (UID: "ffa6e1d4-12b2-489b-ae34-e1d911b889c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:52:07.716014 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.715998    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "ffa6e1d4-12b2-489b-ae34-e1d911b889c4" (UID: "ffa6e1d4-12b2-489b-ae34-e1d911b889c4"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:52:07.813737 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.813686    2567 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-cacerts\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:52:07.813737 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.813730    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw5xf\" (UniqueName: \"kubernetes.io/projected/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-kube-api-access-dw5xf\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:52:07.813737 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.813744    2567 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-kubeconfig\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:52:07.813737 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.813753    2567 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-csr-dns-cert\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:52:07.814043 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.813762    2567 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-local-certs\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:52:07.814043 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.813771    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-token\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:52:07.814043 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:07.813782    2567 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ffa6e1d4-12b2-489b-ae34-e1d911b889c4-istio-csr-ca-configmap\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:52:08.291522 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:08.291486    2567 generic.go:356] "Generic (PLEG): container finished" podID="ffa6e1d4-12b2-489b-ae34-e1d911b889c4" containerID="981b1d170e1f6deb05769faf395b41718c679371371913d2386cc0764d8ec132" exitCode=0
Sep 15 12:52:08.292008 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:08.291530    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"
Sep 15 12:52:08.292008 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:08.291586    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv" event={"ID":"ffa6e1d4-12b2-489b-ae34-e1d911b889c4","Type":"ContainerDied","Data":"981b1d170e1f6deb05769faf395b41718c679371371913d2386cc0764d8ec132"}
Sep 15 12:52:08.292008 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:08.291645    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv" event={"ID":"ffa6e1d4-12b2-489b-ae34-e1d911b889c4","Type":"ContainerDied","Data":"a0a5c5c795d9447951be219f8d6a76ab0399dd85db6d7328343b59c73f9dda3b"}
Sep 15 12:52:08.292008 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:08.291671    2567 scope.go:117] "RemoveContainer" containerID="981b1d170e1f6deb05769faf395b41718c679371371913d2386cc0764d8ec132"
Sep 15 12:52:08.300569 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:08.300546    2567 scope.go:117] "RemoveContainer" containerID="981b1d170e1f6deb05769faf395b41718c679371371913d2386cc0764d8ec132"
Sep 15 12:52:08.300882 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:52:08.300860    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"981b1d170e1f6deb05769faf395b41718c679371371913d2386cc0764d8ec132\": container with ID starting with 981b1d170e1f6deb05769faf395b41718c679371371913d2386cc0764d8ec132 not found: ID does not exist" containerID="981b1d170e1f6deb05769faf395b41718c679371371913d2386cc0764d8ec132"
Sep 15 12:52:08.300937 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:08.300895    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"981b1d170e1f6deb05769faf395b41718c679371371913d2386cc0764d8ec132"} err="failed to get container status \"981b1d170e1f6deb05769faf395b41718c679371371913d2386cc0764d8ec132\": rpc error: code = NotFound desc = could not find container \"981b1d170e1f6deb05769faf395b41718c679371371913d2386cc0764d8ec132\": container with ID starting with 981b1d170e1f6deb05769faf395b41718c679371371913d2386cc0764d8ec132 not found: ID does not exist"
Sep 15 12:52:08.335027 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:08.334993    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"]
Sep 15 12:52:08.340624 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:08.340601    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-jx8zv"]
Sep 15 12:52:08.712482 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:52:08.712452    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffa6e1d4-12b2-489b-ae34-e1d911b889c4" path="/var/lib/kubelet/pods/ffa6e1d4-12b2-489b-ae34-e1d911b889c4/volumes"
Sep 15 12:53:18.142841 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:18.142806    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-rhzkt"]
Sep 15 12:53:18.143250 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:18.143098    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffa6e1d4-12b2-489b-ae34-e1d911b889c4" containerName="discovery"
Sep 15 12:53:18.143250 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:18.143109    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffa6e1d4-12b2-489b-ae34-e1d911b889c4" containerName="discovery"
Sep 15 12:53:18.143250 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:18.143155    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffa6e1d4-12b2-489b-ae34-e1d911b889c4" containerName="discovery"
Sep 15 12:53:18.147080 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:18.147064    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-rhzkt"
Sep 15 12:53:18.149218 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:18.149198    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 15 12:53:18.149308 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:18.149290    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 15 12:53:18.149308 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:18.149304    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zdqkp\""
Sep 15 12:53:18.159487 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:18.159465    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-rhzkt"]
Sep 15 12:53:18.242354 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:18.242320    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpbj6\" (UniqueName: \"kubernetes.io/projected/212ad554-4504-4582-ac83-d5d1f7ef605e-kube-api-access-fpbj6\") pod \"authorino-operator-76b478bd78-rhzkt\" (UID: \"212ad554-4504-4582-ac83-d5d1f7ef605e\") " pod="kuadrant-system/authorino-operator-76b478bd78-rhzkt"
Sep 15 12:53:18.343582 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:18.343555    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpbj6\" (UniqueName: \"kubernetes.io/projected/212ad554-4504-4582-ac83-d5d1f7ef605e-kube-api-access-fpbj6\") pod \"authorino-operator-76b478bd78-rhzkt\" (UID: \"212ad554-4504-4582-ac83-d5d1f7ef605e\") " pod="kuadrant-system/authorino-operator-76b478bd78-rhzkt"
Sep 15 12:53:18.357870 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:18.357844    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpbj6\" (UniqueName: \"kubernetes.io/projected/212ad554-4504-4582-ac83-d5d1f7ef605e-kube-api-access-fpbj6\") pod \"authorino-operator-76b478bd78-rhzkt\" (UID: \"212ad554-4504-4582-ac83-d5d1f7ef605e\") " pod="kuadrant-system/authorino-operator-76b478bd78-rhzkt"
Sep 15 12:53:18.456714 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:18.456681    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-rhzkt"
Sep 15 12:53:18.738875 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:18.738851    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-rhzkt"]
Sep 15 12:53:18.740350 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:53:18.740325    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod212ad554_4504_4582_ac83_d5d1f7ef605e.slice/crio-ce4bce616f9d6b871c2a021b6b46af43eb089b49f3efd1f12a5b4b670126e315 WatchSource:0}: Error finding container ce4bce616f9d6b871c2a021b6b46af43eb089b49f3efd1f12a5b4b670126e315: Status 404 returned error can't find the container with id ce4bce616f9d6b871c2a021b6b46af43eb089b49f3efd1f12a5b4b670126e315
Sep 15 12:53:19.558648 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:19.558604    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-rhzkt" event={"ID":"212ad554-4504-4582-ac83-d5d1f7ef605e","Type":"ContainerStarted","Data":"ce4bce616f9d6b871c2a021b6b46af43eb089b49f3efd1f12a5b4b670126e315"}
Sep 15 12:53:22.573305 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:22.573266    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-rhzkt" event={"ID":"212ad554-4504-4582-ac83-d5d1f7ef605e","Type":"ContainerStarted","Data":"25e0892663dfc96b9900f828969a489e02c154eed383d8bb9c652ce736553747"}
Sep 15 12:53:22.573689 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:22.573400    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-rhzkt"
Sep 15 12:53:22.601960 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:22.601917    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-rhzkt" podStartSLOduration=1.476822331 podStartE2EDuration="4.601899827s" totalImagesPullingTime="3.125077496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:53:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:53:22.600440131 +0000 UTC m=+506.321755673" watchObservedRunningTime="2026-09-15 12:53:22.601899827 +0000 UTC m=+506.323215358"
Sep 15 12:53:22.928802 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:22.928773    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"]
Sep 15 12:53:22.931915 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:22.931898    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"
Sep 15 12:53:22.934764 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:53:22.934733    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vpzpq\" is forbidden: User \"system:node:ip-10-0-129-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-48.ec2.internal' and this object" podUID="a7e43a14-7cea-41aa-a480-10921d8812d4" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"
Sep 15 12:53:22.934890 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:53:22.934783    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"limitador-operator-controller-manager-dockercfg-592fk\" is forbidden: User \"system:node:ip-10-0-129-48.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-48.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-592fk\"" type="*v1.Secret"
Sep 15 12:53:22.947776 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:22.947756    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"]
Sep 15 12:53:22.978497 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:22.978473    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c946\" (UniqueName: \"kubernetes.io/projected/a7e43a14-7cea-41aa-a480-10921d8812d4-kube-api-access-2c946\") pod \"limitador-operator-controller-manager-74495c69f8-vpzpq\" (UID: \"a7e43a14-7cea-41aa-a480-10921d8812d4\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"
Sep 15 12:53:23.079075 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:23.079036    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c946\" (UniqueName: \"kubernetes.io/projected/a7e43a14-7cea-41aa-a480-10921d8812d4-kube-api-access-2c946\") pod \"limitador-operator-controller-manager-74495c69f8-vpzpq\" (UID: \"a7e43a14-7cea-41aa-a480-10921d8812d4\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"
Sep 15 12:53:23.100394 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:23.100369    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c946\" (UniqueName: \"kubernetes.io/projected/a7e43a14-7cea-41aa-a480-10921d8812d4-kube-api-access-2c946\") pod \"limitador-operator-controller-manager-74495c69f8-vpzpq\" (UID: \"a7e43a14-7cea-41aa-a480-10921d8812d4\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"
Sep 15 12:53:24.210225 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:24.210195    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-592fk\""
Sep 15 12:53:24.211249 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:24.211227    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"
Sep 15 12:53:24.506234 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:24.506208    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"]
Sep 15 12:53:24.508805 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:53:24.508778    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e43a14_7cea_41aa_a480_10921d8812d4.slice/crio-daa7690d8caebf4f37034f509da96f6237d5ec7d13f14896c567dbdcdf1cfdd5 WatchSource:0}: Error finding container daa7690d8caebf4f37034f509da96f6237d5ec7d13f14896c567dbdcdf1cfdd5: Status 404 returned error can't find the container with id daa7690d8caebf4f37034f509da96f6237d5ec7d13f14896c567dbdcdf1cfdd5
Sep 15 12:53:24.582579 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:24.582546    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq" event={"ID":"a7e43a14-7cea-41aa-a480-10921d8812d4","Type":"ContainerStarted","Data":"daa7690d8caebf4f37034f509da96f6237d5ec7d13f14896c567dbdcdf1cfdd5"}
Sep 15 12:53:26.593078 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:26.593041    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq" event={"ID":"a7e43a14-7cea-41aa-a480-10921d8812d4","Type":"ContainerStarted","Data":"21b7e1b304164ee8b3c9747fad9fb3bdfccbd6db9fe115787d71561355b83e88"}
Sep 15 12:53:26.593464 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:26.593171    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"
Sep 15 12:53:26.615445 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:26.615402    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq" podStartSLOduration=3.216985245 podStartE2EDuration="4.615387375s" totalImagesPullingTime="1.39840213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:53:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:53:26.613958889 +0000 UTC m=+510.335274419" watchObservedRunningTime="2026-09-15 12:53:26.615387375 +0000 UTC m=+510.336702906"
Sep 15 12:53:33.579456 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:33.579424    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-rhzkt"
Sep 15 12:53:35.105398 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:35.105356    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-896q5"]
Sep 15 12:53:35.108673 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:35.108653    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-896q5"
Sep 15 12:53:35.110818 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:35.110788    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 15 12:53:35.111098 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:35.111082    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 15 12:53:35.111196 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:35.111179    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-w5ghz\""
Sep 15 12:53:35.121414 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:35.121391    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-896q5"]
Sep 15 12:53:35.182210 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:35.182183    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e730322-0d4f-4941-bc9b-c036787c235e-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-896q5\" (UID: \"7e730322-0d4f-4941-bc9b-c036787c235e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-896q5"
Sep 15 12:53:35.182353 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:35.182227    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdjq2\" (UniqueName: \"kubernetes.io/projected/7e730322-0d4f-4941-bc9b-c036787c235e-kube-api-access-jdjq2\") pod \"kuadrant-console-plugin-fbdd4f445-896q5\" (UID: \"7e730322-0d4f-4941-bc9b-c036787c235e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-896q5"
Sep 15 12:53:35.182353 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:35.182308    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e730322-0d4f-4941-bc9b-c036787c235e-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-896q5\" (UID: \"7e730322-0d4f-4941-bc9b-c036787c235e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-896q5"
Sep 15 12:53:35.283605 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:35.283572    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e730322-0d4f-4941-bc9b-c036787c235e-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-896q5\" (UID: \"7e730322-0d4f-4941-bc9b-c036787c235e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-896q5"
Sep 15 12:53:35.283752 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:35.283626    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e730322-0d4f-4941-bc9b-c036787c235e-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-896q5\" (UID: \"7e730322-0d4f-4941-bc9b-c036787c235e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-896q5"
Sep 15 12:53:35.283752 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:35.283656    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdjq2\" (UniqueName: \"kubernetes.io/projected/7e730322-0d4f-4941-bc9b-c036787c235e-kube-api-access-jdjq2\") pod \"kuadrant-console-plugin-fbdd4f445-896q5\" (UID: \"7e730322-0d4f-4941-bc9b-c036787c235e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-896q5"
Sep 15 12:53:35.284344 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:35.284314    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7e730322-0d4f-4941-bc9b-c036787c235e-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-896q5\" (UID: \"7e730322-0d4f-4941-bc9b-c036787c235e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-896q5"
Sep 15 12:53:35.286025 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:35.286004    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7e730322-0d4f-4941-bc9b-c036787c235e-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-896q5\" (UID: \"7e730322-0d4f-4941-bc9b-c036787c235e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-896q5"
Sep 15 12:53:35.293669 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:35.293642    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdjq2\" (UniqueName: \"kubernetes.io/projected/7e730322-0d4f-4941-bc9b-c036787c235e-kube-api-access-jdjq2\") pod \"kuadrant-console-plugin-fbdd4f445-896q5\" (UID: \"7e730322-0d4f-4941-bc9b-c036787c235e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-896q5"
Sep 15 12:53:35.417230 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:35.417209    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-896q5"
Sep 15 12:53:35.691259 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:35.691232    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-896q5"]
Sep 15 12:53:35.693427 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:53:35.693396    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e730322_0d4f_4941_bc9b_c036787c235e.slice/crio-82a9c0cccaa6849993b997b586cca2c73982e279a76668cf4c911cfe4e4ad4b0 WatchSource:0}: Error finding container 82a9c0cccaa6849993b997b586cca2c73982e279a76668cf4c911cfe4e4ad4b0: Status 404 returned error can't find the container with id 82a9c0cccaa6849993b997b586cca2c73982e279a76668cf4c911cfe4e4ad4b0
Sep 15 12:53:36.636938 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:36.636898    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-896q5" event={"ID":"7e730322-0d4f-4941-bc9b-c036787c235e","Type":"ContainerStarted","Data":"82a9c0cccaa6849993b997b586cca2c73982e279a76668cf4c911cfe4e4ad4b0"}
Sep 15 12:53:37.599805 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:37.599772    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"
Sep 15 12:53:40.659418 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:40.659381    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-896q5" event={"ID":"7e730322-0d4f-4941-bc9b-c036787c235e","Type":"ContainerStarted","Data":"721baa1141d4659a1338a653ef63a3fe2288bc8f0860d90753ad8f8c46614230"}
Sep 15 12:53:40.680084 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:40.680025    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-896q5" podStartSLOduration=1.047552891 podStartE2EDuration="5.680009682s" totalImagesPullingTime="4.632456791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:53:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:53:40.678285838 +0000 UTC m=+524.399601368" watchObservedRunningTime="2026-09-15 12:53:40.680009682 +0000 UTC m=+524.401325213"
Sep 15 12:53:45.383139 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.383106    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"]
Sep 15 12:53:45.383518 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.383296    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq" podUID="a7e43a14-7cea-41aa-a480-10921d8812d4" containerName="manager" containerID="cri-o://21b7e1b304164ee8b3c9747fad9fb3bdfccbd6db9fe115787d71561355b83e88" gracePeriod=2
Sep 15 12:53:45.389332 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.389303    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"]
Sep 15 12:53:45.418900 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.418876    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rkhwg"]
Sep 15 12:53:45.419259 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.419243    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e43a14-7cea-41aa-a480-10921d8812d4" containerName="manager"
Sep 15 12:53:45.419313 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.419262    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e43a14-7cea-41aa-a480-10921d8812d4" containerName="manager"
Sep 15 12:53:45.419352 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.419335    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7e43a14-7cea-41aa-a480-10921d8812d4" containerName="manager"
Sep 15 12:53:45.422207 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.422188    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rkhwg"
Sep 15 12:53:45.425600 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:53:45.425564    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vpzpq\" is forbidden: User \"system:node:ip-10-0-129-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-48.ec2.internal' and this object" podUID="a7e43a14-7cea-41aa-a480-10921d8812d4" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"
Sep 15 12:53:45.436444 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.436421    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rkhwg"]
Sep 15 12:53:45.574681 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.574649    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnhrv\" (UniqueName: \"kubernetes.io/projected/b0079bb3-5eed-447b-99a3-97965833a504-kube-api-access-cnhrv\") pod \"limitador-operator-controller-manager-74495c69f8-rkhwg\" (UID: \"b0079bb3-5eed-447b-99a3-97965833a504\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rkhwg"
Sep 15 12:53:45.615739 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.615718    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"
Sep 15 12:53:45.617880 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:53:45.617853    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vpzpq\" is forbidden: User \"system:node:ip-10-0-129-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-48.ec2.internal' and this object" podUID="a7e43a14-7cea-41aa-a480-10921d8812d4" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"
Sep 15 12:53:45.675251 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.675228    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnhrv\" (UniqueName: \"kubernetes.io/projected/b0079bb3-5eed-447b-99a3-97965833a504-kube-api-access-cnhrv\") pod \"limitador-operator-controller-manager-74495c69f8-rkhwg\" (UID: \"b0079bb3-5eed-447b-99a3-97965833a504\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rkhwg"
Sep 15 12:53:45.681597 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.681569    2567 generic.go:356] "Generic (PLEG): container finished" podID="a7e43a14-7cea-41aa-a480-10921d8812d4" containerID="21b7e1b304164ee8b3c9747fad9fb3bdfccbd6db9fe115787d71561355b83e88" exitCode=0
Sep 15 12:53:45.681693 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.681615    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"
Sep 15 12:53:45.681737 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.681617    2567 scope.go:117] "RemoveContainer" containerID="21b7e1b304164ee8b3c9747fad9fb3bdfccbd6db9fe115787d71561355b83e88"
Sep 15 12:53:45.686468 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:53:45.686445    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vpzpq\" is forbidden: User \"system:node:ip-10-0-129-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-48.ec2.internal' and this object" podUID="a7e43a14-7cea-41aa-a480-10921d8812d4" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"
Sep 15 12:53:45.687446 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.687428    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnhrv\" (UniqueName: \"kubernetes.io/projected/b0079bb3-5eed-447b-99a3-97965833a504-kube-api-access-cnhrv\") pod \"limitador-operator-controller-manager-74495c69f8-rkhwg\" (UID: \"b0079bb3-5eed-447b-99a3-97965833a504\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rkhwg"
Sep 15 12:53:45.689939 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.689923    2567 scope.go:117] "RemoveContainer" containerID="21b7e1b304164ee8b3c9747fad9fb3bdfccbd6db9fe115787d71561355b83e88"
Sep 15 12:53:45.690211 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:53:45.690191    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21b7e1b304164ee8b3c9747fad9fb3bdfccbd6db9fe115787d71561355b83e88\": container with ID starting with 21b7e1b304164ee8b3c9747fad9fb3bdfccbd6db9fe115787d71561355b83e88 not found: ID does not exist" containerID="21b7e1b304164ee8b3c9747fad9fb3bdfccbd6db9fe115787d71561355b83e88"
Sep 15 12:53:45.690274 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.690220    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21b7e1b304164ee8b3c9747fad9fb3bdfccbd6db9fe115787d71561355b83e88"} err="failed to get container status \"21b7e1b304164ee8b3c9747fad9fb3bdfccbd6db9fe115787d71561355b83e88\": rpc error: code = NotFound desc = could not find container \"21b7e1b304164ee8b3c9747fad9fb3bdfccbd6db9fe115787d71561355b83e88\": container with ID starting with 21b7e1b304164ee8b3c9747fad9fb3bdfccbd6db9fe115787d71561355b83e88 not found: ID does not exist"
Sep 15 12:53:45.759625 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.759598    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rkhwg"
Sep 15 12:53:45.775560 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.775538    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2c946\" (UniqueName: \"kubernetes.io/projected/a7e43a14-7cea-41aa-a480-10921d8812d4-kube-api-access-2c946\") pod \"a7e43a14-7cea-41aa-a480-10921d8812d4\" (UID: \"a7e43a14-7cea-41aa-a480-10921d8812d4\") "
Sep 15 12:53:45.777576 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.777536    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7e43a14-7cea-41aa-a480-10921d8812d4-kube-api-access-2c946" (OuterVolumeSpecName: "kube-api-access-2c946") pod "a7e43a14-7cea-41aa-a480-10921d8812d4" (UID: "a7e43a14-7cea-41aa-a480-10921d8812d4"). InnerVolumeSpecName "kube-api-access-2c946". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:53:45.876531 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:45.876494    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2c946\" (UniqueName: \"kubernetes.io/projected/a7e43a14-7cea-41aa-a480-10921d8812d4-kube-api-access-2c946\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:53:45.992053 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:53:45.992020    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vpzpq\" is forbidden: User \"system:node:ip-10-0-129-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-48.ec2.internal' and this object" podUID="a7e43a14-7cea-41aa-a480-10921d8812d4" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"
Sep 15 12:53:46.033031 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:46.033006    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rkhwg"]
Sep 15 12:53:46.035591 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:53:46.035563    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0079bb3_5eed_447b_99a3_97965833a504.slice/crio-74a1321914f395293a9a080674f353b9dcd48441ab3e9c4181da31c7a613721c WatchSource:0}: Error finding container 74a1321914f395293a9a080674f353b9dcd48441ab3e9c4181da31c7a613721c: Status 404 returned error can't find the container with id 74a1321914f395293a9a080674f353b9dcd48441ab3e9c4181da31c7a613721c
Sep 15 12:53:46.688164 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:46.688130    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rkhwg" event={"ID":"b0079bb3-5eed-447b-99a3-97965833a504","Type":"ContainerStarted","Data":"3a76feddf42eff725a02cebfbe01d6aa770635f89d84d7c1880d2caffe75694b"}
Sep 15 12:53:46.688575 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:46.688185    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rkhwg" event={"ID":"b0079bb3-5eed-447b-99a3-97965833a504","Type":"ContainerStarted","Data":"74a1321914f395293a9a080674f353b9dcd48441ab3e9c4181da31c7a613721c"}
Sep 15 12:53:46.688575 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:46.688228    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rkhwg"
Sep 15 12:53:46.690408 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:53:46.690380    2567 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vpzpq\" is forbidden: User \"system:node:ip-10-0-129-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-48.ec2.internal' and this object" podUID="a7e43a14-7cea-41aa-a480-10921d8812d4" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vpzpq"
Sep 15 12:53:46.712267 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:46.712237    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7e43a14-7cea-41aa-a480-10921d8812d4" path="/var/lib/kubelet/pods/a7e43a14-7cea-41aa-a480-10921d8812d4/volumes"
Sep 15 12:53:46.743264 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:46.743220    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rkhwg" podStartSLOduration=1.743202405 podStartE2EDuration="1.743202405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:53:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:53:46.735343951 +0000 UTC m=+530.456659482" watchObservedRunningTime="2026-09-15 12:53:46.743202405 +0000 UTC m=+530.464517935"
Sep 15 12:53:57.700088 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:53:57.700053    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rkhwg"
Sep 15 12:54:16.554501 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:16.554462    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wqfqd"]
Sep 15 12:54:16.571499 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:16.571460    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-wqfqd"
Sep 15 12:54:16.572434 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:16.572408    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wqfqd"]
Sep 15 12:54:16.576498 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:16.576474    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 15 12:54:16.623468 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:16.623435    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smzc7\" (UniqueName: \"kubernetes.io/projected/207be89e-07e3-48a7-a36c-68e8cf4a6c24-kube-api-access-smzc7\") pod \"limitador-limitador-8588749977-wqfqd\" (UID: \"207be89e-07e3-48a7-a36c-68e8cf4a6c24\") " pod="kuadrant-system/limitador-limitador-8588749977-wqfqd"
Sep 15 12:54:16.623468 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:16.623470    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/207be89e-07e3-48a7-a36c-68e8cf4a6c24-config-file\") pod \"limitador-limitador-8588749977-wqfqd\" (UID: \"207be89e-07e3-48a7-a36c-68e8cf4a6c24\") " pod="kuadrant-system/limitador-limitador-8588749977-wqfqd"
Sep 15 12:54:16.639198 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:16.639168    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wqfqd"]
Sep 15 12:54:16.724328 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:16.724298    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smzc7\" (UniqueName: \"kubernetes.io/projected/207be89e-07e3-48a7-a36c-68e8cf4a6c24-kube-api-access-smzc7\") pod \"limitador-limitador-8588749977-wqfqd\" (UID: \"207be89e-07e3-48a7-a36c-68e8cf4a6c24\") " pod="kuadrant-system/limitador-limitador-8588749977-wqfqd"
Sep 15 12:54:16.724490 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:16.724335    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/207be89e-07e3-48a7-a36c-68e8cf4a6c24-config-file\") pod \"limitador-limitador-8588749977-wqfqd\" (UID: \"207be89e-07e3-48a7-a36c-68e8cf4a6c24\") " pod="kuadrant-system/limitador-limitador-8588749977-wqfqd"
Sep 15 12:54:16.724881 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:16.724864    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/207be89e-07e3-48a7-a36c-68e8cf4a6c24-config-file\") pod \"limitador-limitador-8588749977-wqfqd\" (UID: \"207be89e-07e3-48a7-a36c-68e8cf4a6c24\") " pod="kuadrant-system/limitador-limitador-8588749977-wqfqd"
Sep 15 12:54:16.736731 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:16.736704    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smzc7\" (UniqueName: \"kubernetes.io/projected/207be89e-07e3-48a7-a36c-68e8cf4a6c24-kube-api-access-smzc7\") pod \"limitador-limitador-8588749977-wqfqd\" (UID: \"207be89e-07e3-48a7-a36c-68e8cf4a6c24\") " pod="kuadrant-system/limitador-limitador-8588749977-wqfqd"
Sep 15 12:54:16.884537 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:16.884464    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-wqfqd"
Sep 15 12:54:17.158205 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:17.158183    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wqfqd"]
Sep 15 12:54:17.160452 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:54:17.160427    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod207be89e_07e3_48a7_a36c_68e8cf4a6c24.slice/crio-f06466e35abe8434044e1eeaf81c6d074ab2f05c6aa321b05b15e5edeba40e24 WatchSource:0}: Error finding container f06466e35abe8434044e1eeaf81c6d074ab2f05c6aa321b05b15e5edeba40e24: Status 404 returned error can't find the container with id f06466e35abe8434044e1eeaf81c6d074ab2f05c6aa321b05b15e5edeba40e24
Sep 15 12:54:17.817909 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:17.817875    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-wqfqd" event={"ID":"207be89e-07e3-48a7-a36c-68e8cf4a6c24","Type":"ContainerStarted","Data":"f06466e35abe8434044e1eeaf81c6d074ab2f05c6aa321b05b15e5edeba40e24"}
Sep 15 12:54:20.831945 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:20.831862    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-wqfqd" event={"ID":"207be89e-07e3-48a7-a36c-68e8cf4a6c24","Type":"ContainerStarted","Data":"fb9a93e92f0e18b7e5a51dacd88f123b64dd5664cd958dc122a1f5f6ccfa1ef9"}
Sep 15 12:54:20.832324 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:20.832011    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-wqfqd"
Sep 15 12:54:30.490303 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:30.490240    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-wqfqd" podStartSLOduration=11.174661154 podStartE2EDuration="14.490220661s" totalImagesPullingTime="3.315559507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:54:20.854010256 +0000 UTC m=+564.575325783" watchObservedRunningTime="2026-09-15 12:54:30.490220661 +0000 UTC m=+574.211536191"
Sep 15 12:54:30.490913 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:30.490845    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wqfqd"]
Sep 15 12:54:30.491145 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:30.491120    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-wqfqd" podUID="207be89e-07e3-48a7-a36c-68e8cf4a6c24" containerName="limitador" containerID="cri-o://fb9a93e92f0e18b7e5a51dacd88f123b64dd5664cd958dc122a1f5f6ccfa1ef9" gracePeriod=30
Sep 15 12:54:30.491966 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:30.491758    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-wqfqd"
Sep 15 12:54:30.873552 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:30.873519    2567 generic.go:356] "Generic (PLEG): container finished" podID="207be89e-07e3-48a7-a36c-68e8cf4a6c24" containerID="fb9a93e92f0e18b7e5a51dacd88f123b64dd5664cd958dc122a1f5f6ccfa1ef9" exitCode=0
Sep 15 12:54:30.873552 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:30.873557    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-wqfqd" event={"ID":"207be89e-07e3-48a7-a36c-68e8cf4a6c24","Type":"ContainerDied","Data":"fb9a93e92f0e18b7e5a51dacd88f123b64dd5664cd958dc122a1f5f6ccfa1ef9"}
Sep 15 12:54:31.430358 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:31.430328    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-wqfqd"
Sep 15 12:54:31.545315 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:31.545282    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/207be89e-07e3-48a7-a36c-68e8cf4a6c24-config-file\") pod \"207be89e-07e3-48a7-a36c-68e8cf4a6c24\" (UID: \"207be89e-07e3-48a7-a36c-68e8cf4a6c24\") "
Sep 15 12:54:31.545772 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:31.545332    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smzc7\" (UniqueName: \"kubernetes.io/projected/207be89e-07e3-48a7-a36c-68e8cf4a6c24-kube-api-access-smzc7\") pod \"207be89e-07e3-48a7-a36c-68e8cf4a6c24\" (UID: \"207be89e-07e3-48a7-a36c-68e8cf4a6c24\") "
Sep 15 12:54:31.545772 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:31.545718    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/207be89e-07e3-48a7-a36c-68e8cf4a6c24-config-file" (OuterVolumeSpecName: "config-file") pod "207be89e-07e3-48a7-a36c-68e8cf4a6c24" (UID: "207be89e-07e3-48a7-a36c-68e8cf4a6c24"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:54:31.547372 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:31.547351    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/207be89e-07e3-48a7-a36c-68e8cf4a6c24-kube-api-access-smzc7" (OuterVolumeSpecName: "kube-api-access-smzc7") pod "207be89e-07e3-48a7-a36c-68e8cf4a6c24" (UID: "207be89e-07e3-48a7-a36c-68e8cf4a6c24"). InnerVolumeSpecName "kube-api-access-smzc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:54:31.646711 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:31.646621    2567 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/207be89e-07e3-48a7-a36c-68e8cf4a6c24-config-file\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:54:31.646711 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:31.646662    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smzc7\" (UniqueName: \"kubernetes.io/projected/207be89e-07e3-48a7-a36c-68e8cf4a6c24-kube-api-access-smzc7\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:54:31.878646 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:31.878612    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-wqfqd" event={"ID":"207be89e-07e3-48a7-a36c-68e8cf4a6c24","Type":"ContainerDied","Data":"f06466e35abe8434044e1eeaf81c6d074ab2f05c6aa321b05b15e5edeba40e24"}
Sep 15 12:54:31.878646 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:31.878635    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-wqfqd"
Sep 15 12:54:31.878877 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:31.878683    2567 scope.go:117] "RemoveContainer" containerID="fb9a93e92f0e18b7e5a51dacd88f123b64dd5664cd958dc122a1f5f6ccfa1ef9"
Sep 15 12:54:31.901159 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:31.901106    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wqfqd"]
Sep 15 12:54:31.905696 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:31.905676    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-wqfqd"]
Sep 15 12:54:32.712528 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:32.712494    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="207be89e-07e3-48a7-a36c-68e8cf4a6c24" path="/var/lib/kubelet/pods/207be89e-07e3-48a7-a36c-68e8cf4a6c24/volumes"
Sep 15 12:54:33.023425 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:33.023336    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xb47s"]
Sep 15 12:54:33.023648 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:33.023635    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="207be89e-07e3-48a7-a36c-68e8cf4a6c24" containerName="limitador"
Sep 15 12:54:33.023648 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:33.023648    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="207be89e-07e3-48a7-a36c-68e8cf4a6c24" containerName="limitador"
Sep 15 12:54:33.023796 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:33.023699    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="207be89e-07e3-48a7-a36c-68e8cf4a6c24" containerName="limitador"
Sep 15 12:54:33.028051 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:33.028026    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xb47s"
Sep 15 12:54:33.030335 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:33.030314    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 12:54:33.030440 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:33.030314    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 12:54:33.030988 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:33.030957    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-w4rp2\""
Sep 15 12:54:33.031067 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:33.031026    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 15 12:54:33.050338 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:33.048455    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xb47s"]
Sep 15 12:54:33.158674 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:33.158640    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btt48\" (UniqueName: \"kubernetes.io/projected/dd186e9c-fce3-4bd4-a3c9-2fff14942f9b-kube-api-access-btt48\") pod \"postgres-69fb4594cf-xb47s\" (UID: \"dd186e9c-fce3-4bd4-a3c9-2fff14942f9b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xb47s"
Sep 15 12:54:33.158834 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:33.158683    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dd186e9c-fce3-4bd4-a3c9-2fff14942f9b-data\") pod \"postgres-69fb4594cf-xb47s\" (UID: \"dd186e9c-fce3-4bd4-a3c9-2fff14942f9b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xb47s"
Sep 15 12:54:33.259935 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:33.259890    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btt48\" (UniqueName: \"kubernetes.io/projected/dd186e9c-fce3-4bd4-a3c9-2fff14942f9b-kube-api-access-btt48\") pod \"postgres-69fb4594cf-xb47s\" (UID: \"dd186e9c-fce3-4bd4-a3c9-2fff14942f9b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xb47s"
Sep 15 12:54:33.260114 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:33.259942    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dd186e9c-fce3-4bd4-a3c9-2fff14942f9b-data\") pod \"postgres-69fb4594cf-xb47s\" (UID: \"dd186e9c-fce3-4bd4-a3c9-2fff14942f9b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xb47s"
Sep 15 12:54:33.260290 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:33.260274    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dd186e9c-fce3-4bd4-a3c9-2fff14942f9b-data\") pod \"postgres-69fb4594cf-xb47s\" (UID: \"dd186e9c-fce3-4bd4-a3c9-2fff14942f9b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xb47s"
Sep 15 12:54:33.268866 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:33.268833    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btt48\" (UniqueName: \"kubernetes.io/projected/dd186e9c-fce3-4bd4-a3c9-2fff14942f9b-kube-api-access-btt48\") pod \"postgres-69fb4594cf-xb47s\" (UID: \"dd186e9c-fce3-4bd4-a3c9-2fff14942f9b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xb47s"
Sep 15 12:54:33.340628 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:33.340552    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xb47s"
Sep 15 12:54:33.638702 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:33.638612    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xb47s"]
Sep 15 12:54:33.641494 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:54:33.641465    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd186e9c_fce3_4bd4_a3c9_2fff14942f9b.slice/crio-f90cdabfb4175c346581007ea21a658197132041716ba517459c77f09b0cd17a WatchSource:0}: Error finding container f90cdabfb4175c346581007ea21a658197132041716ba517459c77f09b0cd17a: Status 404 returned error can't find the container with id f90cdabfb4175c346581007ea21a658197132041716ba517459c77f09b0cd17a
Sep 15 12:54:33.889191 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:33.889105    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xb47s" event={"ID":"dd186e9c-fce3-4bd4-a3c9-2fff14942f9b","Type":"ContainerStarted","Data":"f90cdabfb4175c346581007ea21a658197132041716ba517459c77f09b0cd17a"}
Sep 15 12:54:36.904508 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:36.904473    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xb47s" event={"ID":"dd186e9c-fce3-4bd4-a3c9-2fff14942f9b","Type":"ContainerStarted","Data":"29a447310caa79b5ed156a2198d131eaa116ef5343c5eded50a8b8cbda91e3e6"}
Sep 15 12:54:36.904882 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:36.904559    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xb47s"
Sep 15 12:54:36.924503 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:36.924458    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xb47s" podStartSLOduration=1.5520222769999998 podStartE2EDuration="3.924441787s" totalImagesPullingTime="2.37241951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:54:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:54:36.923604522 +0000 UTC m=+580.644920053" watchObservedRunningTime="2026-09-15 12:54:36.924441787 +0000 UTC m=+580.645757318"
Sep 15 12:54:42.937168 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:42.937138    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xb47s"
Sep 15 12:54:50.915884 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:50.915839    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bf48cd9d-9ttff"]
Sep 15 12:54:50.921528 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:50.921496    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bf48cd9d-9ttff"
Sep 15 12:54:50.923525 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:50.923503    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 12:54:50.923689 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:50.923609    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 12:54:50.923689 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:50.923666    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 12:54:50.923802 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:50.923754    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-s85lm\""
Sep 15 12:54:50.938026 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:50.938001    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bf48cd9d-9ttff"]
Sep 15 12:54:51.010855 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.010817    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35618f96-7a99-4c72-84fc-f4868036fa41-webhook-cert\") pod \"maas-controller-bf48cd9d-9ttff\" (UID: \"35618f96-7a99-4c72-84fc-f4868036fa41\") " pod="opendatahub/maas-controller-bf48cd9d-9ttff"
Sep 15 12:54:51.011066 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.010920    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35618f96-7a99-4c72-84fc-f4868036fa41-metrics-certs\") pod \"maas-controller-bf48cd9d-9ttff\" (UID: \"35618f96-7a99-4c72-84fc-f4868036fa41\") " pod="opendatahub/maas-controller-bf48cd9d-9ttff"
Sep 15 12:54:51.011066 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.010958    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pqgk\" (UniqueName: \"kubernetes.io/projected/35618f96-7a99-4c72-84fc-f4868036fa41-kube-api-access-6pqgk\") pod \"maas-controller-bf48cd9d-9ttff\" (UID: \"35618f96-7a99-4c72-84fc-f4868036fa41\") " pod="opendatahub/maas-controller-bf48cd9d-9ttff"
Sep 15 12:54:51.078944 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.078909    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f4dcdf76b-qvlrj"]
Sep 15 12:54:51.081284 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.081268    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj"
Sep 15 12:54:51.094849 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.094821    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f4dcdf76b-qvlrj"]
Sep 15 12:54:51.111826 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.111795    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35618f96-7a99-4c72-84fc-f4868036fa41-metrics-certs\") pod \"maas-controller-bf48cd9d-9ttff\" (UID: \"35618f96-7a99-4c72-84fc-f4868036fa41\") " pod="opendatahub/maas-controller-bf48cd9d-9ttff"
Sep 15 12:54:51.111961 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.111838    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pqgk\" (UniqueName: \"kubernetes.io/projected/35618f96-7a99-4c72-84fc-f4868036fa41-kube-api-access-6pqgk\") pod \"maas-controller-bf48cd9d-9ttff\" (UID: \"35618f96-7a99-4c72-84fc-f4868036fa41\") " pod="opendatahub/maas-controller-bf48cd9d-9ttff"
Sep 15 12:54:51.111961 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.111865    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35618f96-7a99-4c72-84fc-f4868036fa41-webhook-cert\") pod \"maas-controller-bf48cd9d-9ttff\" (UID: \"35618f96-7a99-4c72-84fc-f4868036fa41\") " pod="opendatahub/maas-controller-bf48cd9d-9ttff"
Sep 15 12:54:51.112051 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:54:51.111965    2567 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 15 12:54:51.112051 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:54:51.112043    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35618f96-7a99-4c72-84fc-f4868036fa41-webhook-cert podName:35618f96-7a99-4c72-84fc-f4868036fa41 nodeName:}" failed. No retries permitted until 2026-09-15 12:54:51.612026576 +0000 UTC m=+595.333342099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/35618f96-7a99-4c72-84fc-f4868036fa41-webhook-cert") pod "maas-controller-bf48cd9d-9ttff" (UID: "35618f96-7a99-4c72-84fc-f4868036fa41") : secret "maas-controller-webhook-cert" not found
Sep 15 12:54:51.114361 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.114342    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35618f96-7a99-4c72-84fc-f4868036fa41-metrics-certs\") pod \"maas-controller-bf48cd9d-9ttff\" (UID: \"35618f96-7a99-4c72-84fc-f4868036fa41\") " pod="opendatahub/maas-controller-bf48cd9d-9ttff"
Sep 15 12:54:51.122728 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.122700    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pqgk\" (UniqueName: \"kubernetes.io/projected/35618f96-7a99-4c72-84fc-f4868036fa41-kube-api-access-6pqgk\") pod \"maas-controller-bf48cd9d-9ttff\" (UID: \"35618f96-7a99-4c72-84fc-f4868036fa41\") " pod="opendatahub/maas-controller-bf48cd9d-9ttff"
Sep 15 12:54:51.213409 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.213294    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23ff1b7e-5a87-439b-8416-e57d057bc08f-metrics-certs\") pod \"maas-controller-5f4dcdf76b-qvlrj\" (UID: \"23ff1b7e-5a87-439b-8416-e57d057bc08f\") " pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj"
Sep 15 12:54:51.213409 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.213350    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfjtg\" (UniqueName: \"kubernetes.io/projected/23ff1b7e-5a87-439b-8416-e57d057bc08f-kube-api-access-xfjtg\") pod \"maas-controller-5f4dcdf76b-qvlrj\" (UID: \"23ff1b7e-5a87-439b-8416-e57d057bc08f\") " pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj"
Sep 15 12:54:51.213599 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.213443    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23ff1b7e-5a87-439b-8416-e57d057bc08f-webhook-cert\") pod \"maas-controller-5f4dcdf76b-qvlrj\" (UID: \"23ff1b7e-5a87-439b-8416-e57d057bc08f\") " pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj"
Sep 15 12:54:51.314039 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.313962    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23ff1b7e-5a87-439b-8416-e57d057bc08f-metrics-certs\") pod \"maas-controller-5f4dcdf76b-qvlrj\" (UID: \"23ff1b7e-5a87-439b-8416-e57d057bc08f\") " pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj"
Sep 15 12:54:51.314221 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.314060    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfjtg\" (UniqueName: \"kubernetes.io/projected/23ff1b7e-5a87-439b-8416-e57d057bc08f-kube-api-access-xfjtg\") pod \"maas-controller-5f4dcdf76b-qvlrj\" (UID: \"23ff1b7e-5a87-439b-8416-e57d057bc08f\") " pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj"
Sep 15 12:54:51.314221 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.314106    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23ff1b7e-5a87-439b-8416-e57d057bc08f-webhook-cert\") pod \"maas-controller-5f4dcdf76b-qvlrj\" (UID: \"23ff1b7e-5a87-439b-8416-e57d057bc08f\") " pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj"
Sep 15 12:54:51.316488 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.316453    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23ff1b7e-5a87-439b-8416-e57d057bc08f-webhook-cert\") pod \"maas-controller-5f4dcdf76b-qvlrj\" (UID: \"23ff1b7e-5a87-439b-8416-e57d057bc08f\") " pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj"
Sep 15 12:54:51.316627 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.316545    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23ff1b7e-5a87-439b-8416-e57d057bc08f-metrics-certs\") pod \"maas-controller-5f4dcdf76b-qvlrj\" (UID: \"23ff1b7e-5a87-439b-8416-e57d057bc08f\") " pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj"
Sep 15 12:54:51.323604 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.323573    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfjtg\" (UniqueName: \"kubernetes.io/projected/23ff1b7e-5a87-439b-8416-e57d057bc08f-kube-api-access-xfjtg\") pod \"maas-controller-5f4dcdf76b-qvlrj\" (UID: \"23ff1b7e-5a87-439b-8416-e57d057bc08f\") " pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj"
Sep 15 12:54:51.391159 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.391119    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj"
Sep 15 12:54:51.616078 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.615956    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35618f96-7a99-4c72-84fc-f4868036fa41-webhook-cert\") pod \"maas-controller-bf48cd9d-9ttff\" (UID: \"35618f96-7a99-4c72-84fc-f4868036fa41\") " pod="opendatahub/maas-controller-bf48cd9d-9ttff"
Sep 15 12:54:51.618332 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.618311    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35618f96-7a99-4c72-84fc-f4868036fa41-webhook-cert\") pod \"maas-controller-bf48cd9d-9ttff\" (UID: \"35618f96-7a99-4c72-84fc-f4868036fa41\") " pod="opendatahub/maas-controller-bf48cd9d-9ttff"
Sep 15 12:54:51.678094 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.678062    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f4dcdf76b-qvlrj"]
Sep 15 12:54:51.681314 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:54:51.681288    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ff1b7e_5a87_439b_8416_e57d057bc08f.slice/crio-3abc5ea1d1985669408f002d94e50b7abb03d90e3572f255fc67638c24173053 WatchSource:0}: Error finding container 3abc5ea1d1985669408f002d94e50b7abb03d90e3572f255fc67638c24173053: Status 404 returned error can't find the container with id 3abc5ea1d1985669408f002d94e50b7abb03d90e3572f255fc67638c24173053
Sep 15 12:54:51.831462 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.831434    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bf48cd9d-9ttff"
Sep 15 12:54:51.969271 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:51.969238    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj" event={"ID":"23ff1b7e-5a87-439b-8416-e57d057bc08f","Type":"ContainerStarted","Data":"3abc5ea1d1985669408f002d94e50b7abb03d90e3572f255fc67638c24173053"}
Sep 15 12:54:52.126839 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:52.126758    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bf48cd9d-9ttff"]
Sep 15 12:54:52.129708 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:54:52.129680    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35618f96_7a99_4c72_84fc_f4868036fa41.slice/crio-208660bab8efbc3f1c3c756aca9b2f871eb755cba0d64550fb2f11f143ad6fa5 WatchSource:0}: Error finding container 208660bab8efbc3f1c3c756aca9b2f871eb755cba0d64550fb2f11f143ad6fa5: Status 404 returned error can't find the container with id 208660bab8efbc3f1c3c756aca9b2f871eb755cba0d64550fb2f11f143ad6fa5
Sep 15 12:54:52.976255 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:52.976031    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bf48cd9d-9ttff" event={"ID":"35618f96-7a99-4c72-84fc-f4868036fa41","Type":"ContainerStarted","Data":"208660bab8efbc3f1c3c756aca9b2f871eb755cba0d64550fb2f11f143ad6fa5"}
Sep 15 12:54:54.985160 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:54.985120    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bf48cd9d-9ttff" event={"ID":"35618f96-7a99-4c72-84fc-f4868036fa41","Type":"ContainerStarted","Data":"e0e91ff53912b1b6d9e26066c9ba2aabeb056945dd31d85e9508950f5c34f553"}
Sep 15 12:54:54.985624 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:54.985181    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bf48cd9d-9ttff"
Sep 15 12:54:54.986673 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:54.986651    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj" event={"ID":"23ff1b7e-5a87-439b-8416-e57d057bc08f","Type":"ContainerStarted","Data":"9167ab902528e5cd1688b803faff265e921bafbfd6cd0add1a35279ac7c6c2d8"}
Sep 15 12:54:54.986761 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:54.986702    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj"
Sep 15 12:54:55.005985 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:55.005940    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bf48cd9d-9ttff" podStartSLOduration=2.98234466 podStartE2EDuration="5.005924134s" totalImagesPullingTime="2.023579474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:54:55.004225907 +0000 UTC m=+598.725541438" watchObservedRunningTime="2026-09-15 12:54:55.005924134 +0000 UTC m=+598.727239665"
Sep 15 12:54:55.048690 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:54:55.048637    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj" podStartSLOduration=1.581702709 podStartE2EDuration="4.0486194s" totalImagesPullingTime="2.466916691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:54:55.046900471 +0000 UTC m=+598.768216002" watchObservedRunningTime="2026-09-15 12:54:55.0486194 +0000 UTC m=+598.769934930"
Sep 15 12:55:05.993088 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:05.993056    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bf48cd9d-9ttff"
Sep 15 12:55:05.993561 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:05.993149    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj"
Sep 15 12:55:06.081524 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:06.081484    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bf48cd9d-9ttff"]
Sep 15 12:55:06.081775 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:06.081745    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-bf48cd9d-9ttff" podUID="35618f96-7a99-4c72-84fc-f4868036fa41" containerName="manager" containerID="cri-o://e0e91ff53912b1b6d9e26066c9ba2aabeb056945dd31d85e9508950f5c34f553" gracePeriod=30
Sep 15 12:55:06.316464 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:06.316440    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bf48cd9d-9ttff"
Sep 15 12:55:06.335527 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:06.335489    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35618f96-7a99-4c72-84fc-f4868036fa41-webhook-cert\") pod \"35618f96-7a99-4c72-84fc-f4868036fa41\" (UID: \"35618f96-7a99-4c72-84fc-f4868036fa41\") "
Sep 15 12:55:06.335702 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:06.335560    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pqgk\" (UniqueName: \"kubernetes.io/projected/35618f96-7a99-4c72-84fc-f4868036fa41-kube-api-access-6pqgk\") pod \"35618f96-7a99-4c72-84fc-f4868036fa41\" (UID: \"35618f96-7a99-4c72-84fc-f4868036fa41\") "
Sep 15 12:55:06.335702 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:06.335619    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35618f96-7a99-4c72-84fc-f4868036fa41-metrics-certs\") pod \"35618f96-7a99-4c72-84fc-f4868036fa41\" (UID: \"35618f96-7a99-4c72-84fc-f4868036fa41\") "
Sep 15 12:55:06.337747 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:06.337708    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35618f96-7a99-4c72-84fc-f4868036fa41-kube-api-access-6pqgk" (OuterVolumeSpecName: "kube-api-access-6pqgk") pod "35618f96-7a99-4c72-84fc-f4868036fa41" (UID: "35618f96-7a99-4c72-84fc-f4868036fa41"). InnerVolumeSpecName "kube-api-access-6pqgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:55:06.337747 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:06.337734    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35618f96-7a99-4c72-84fc-f4868036fa41-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "35618f96-7a99-4c72-84fc-f4868036fa41" (UID: "35618f96-7a99-4c72-84fc-f4868036fa41"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:55:06.337893 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:06.337753    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35618f96-7a99-4c72-84fc-f4868036fa41-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "35618f96-7a99-4c72-84fc-f4868036fa41" (UID: "35618f96-7a99-4c72-84fc-f4868036fa41"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:55:06.436254 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:06.436212    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pqgk\" (UniqueName: \"kubernetes.io/projected/35618f96-7a99-4c72-84fc-f4868036fa41-kube-api-access-6pqgk\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:55:06.436254 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:06.436246    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35618f96-7a99-4c72-84fc-f4868036fa41-metrics-certs\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:55:06.436254 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:06.436256    2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/35618f96-7a99-4c72-84fc-f4868036fa41-webhook-cert\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:55:07.038259 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:07.038173    2567 generic.go:356] "Generic (PLEG): container finished" podID="35618f96-7a99-4c72-84fc-f4868036fa41" containerID="e0e91ff53912b1b6d9e26066c9ba2aabeb056945dd31d85e9508950f5c34f553" exitCode=0
Sep 15 12:55:07.038259 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:07.038217    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bf48cd9d-9ttff"
Sep 15 12:55:07.038678 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:07.038251    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bf48cd9d-9ttff" event={"ID":"35618f96-7a99-4c72-84fc-f4868036fa41","Type":"ContainerDied","Data":"e0e91ff53912b1b6d9e26066c9ba2aabeb056945dd31d85e9508950f5c34f553"}
Sep 15 12:55:07.038678 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:07.038306    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bf48cd9d-9ttff" event={"ID":"35618f96-7a99-4c72-84fc-f4868036fa41","Type":"ContainerDied","Data":"208660bab8efbc3f1c3c756aca9b2f871eb755cba0d64550fb2f11f143ad6fa5"}
Sep 15 12:55:07.038678 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:07.038330    2567 scope.go:117] "RemoveContainer" containerID="e0e91ff53912b1b6d9e26066c9ba2aabeb056945dd31d85e9508950f5c34f553"
Sep 15 12:55:07.046549 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:07.046528    2567 scope.go:117] "RemoveContainer" containerID="e0e91ff53912b1b6d9e26066c9ba2aabeb056945dd31d85e9508950f5c34f553"
Sep 15 12:55:07.046846 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:55:07.046822    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0e91ff53912b1b6d9e26066c9ba2aabeb056945dd31d85e9508950f5c34f553\": container with ID starting with e0e91ff53912b1b6d9e26066c9ba2aabeb056945dd31d85e9508950f5c34f553 not found: ID does not exist" containerID="e0e91ff53912b1b6d9e26066c9ba2aabeb056945dd31d85e9508950f5c34f553"
Sep 15 12:55:07.046900 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:07.046860    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e91ff53912b1b6d9e26066c9ba2aabeb056945dd31d85e9508950f5c34f553"} err="failed to get container status \"e0e91ff53912b1b6d9e26066c9ba2aabeb056945dd31d85e9508950f5c34f553\": rpc error: code = NotFound desc = could not find container \"e0e91ff53912b1b6d9e26066c9ba2aabeb056945dd31d85e9508950f5c34f553\": container with ID starting with e0e91ff53912b1b6d9e26066c9ba2aabeb056945dd31d85e9508950f5c34f553 not found: ID does not exist"
Sep 15 12:55:07.054066 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:07.054042    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bf48cd9d-9ttff"]
Sep 15 12:55:07.058264 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:07.058242    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bf48cd9d-9ttff"]
Sep 15 12:55:08.713125 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:08.713087    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35618f96-7a99-4c72-84fc-f4868036fa41" path="/var/lib/kubelet/pods/35618f96-7a99-4c72-84fc-f4868036fa41/volumes"
Sep 15 12:55:28.626024 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.625927    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7"]
Sep 15 12:55:28.626376 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.626259    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35618f96-7a99-4c72-84fc-f4868036fa41" containerName="manager"
Sep 15 12:55:28.626376 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.626270    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="35618f96-7a99-4c72-84fc-f4868036fa41" containerName="manager"
Sep 15 12:55:28.626376 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.626332    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="35618f96-7a99-4c72-84fc-f4868036fa41" containerName="manager"
Sep 15 12:55:28.631838 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.631823    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7"
Sep 15 12:55:28.634004 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.633963    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 15 12:55:28.634458 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.634436    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 12:55:28.634458 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.634443    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fdkj6\""
Sep 15 12:55:28.643246 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.643223    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7"]
Sep 15 12:55:28.699437 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.699401    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88803825-7ae4-4766-b505-366de9b09870-openshift-service-ca\") pod \"maas-api-786fdf86ff-mmkr7\" (UID: \"88803825-7ae4-4766-b505-366de9b09870\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7"
Sep 15 12:55:28.699575 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.699456    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmcp4\" (UniqueName: \"kubernetes.io/projected/88803825-7ae4-4766-b505-366de9b09870-kube-api-access-hmcp4\") pod \"maas-api-786fdf86ff-mmkr7\" (UID: \"88803825-7ae4-4766-b505-366de9b09870\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7"
Sep 15 12:55:28.699575 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.699536    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88803825-7ae4-4766-b505-366de9b09870-maas-api-tls\") pod \"maas-api-786fdf86ff-mmkr7\" (UID: \"88803825-7ae4-4766-b505-366de9b09870\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7"
Sep 15 12:55:28.699679 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.699575    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88803825-7ae4-4766-b505-366de9b09870-metrics-certs\") pod \"maas-api-786fdf86ff-mmkr7\" (UID: \"88803825-7ae4-4766-b505-366de9b09870\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7"
Sep 15 12:55:28.800630 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.800586    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88803825-7ae4-4766-b505-366de9b09870-openshift-service-ca\") pod \"maas-api-786fdf86ff-mmkr7\" (UID: \"88803825-7ae4-4766-b505-366de9b09870\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7"
Sep 15 12:55:28.800804 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.800653    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmcp4\" (UniqueName: \"kubernetes.io/projected/88803825-7ae4-4766-b505-366de9b09870-kube-api-access-hmcp4\") pod \"maas-api-786fdf86ff-mmkr7\" (UID: \"88803825-7ae4-4766-b505-366de9b09870\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7"
Sep 15 12:55:28.800804 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.800724    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88803825-7ae4-4766-b505-366de9b09870-maas-api-tls\") pod \"maas-api-786fdf86ff-mmkr7\" (UID: \"88803825-7ae4-4766-b505-366de9b09870\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7"
Sep 15 12:55:28.800804 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.800760    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88803825-7ae4-4766-b505-366de9b09870-metrics-certs\") pod \"maas-api-786fdf86ff-mmkr7\" (UID: \"88803825-7ae4-4766-b505-366de9b09870\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7"
Sep 15 12:55:28.801415 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.801383    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88803825-7ae4-4766-b505-366de9b09870-openshift-service-ca\") pod \"maas-api-786fdf86ff-mmkr7\" (UID: \"88803825-7ae4-4766-b505-366de9b09870\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7"
Sep 15 12:55:28.803264 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.803242    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88803825-7ae4-4766-b505-366de9b09870-metrics-certs\") pod \"maas-api-786fdf86ff-mmkr7\" (UID: \"88803825-7ae4-4766-b505-366de9b09870\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7"
Sep 15 12:55:28.803373 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.803352    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88803825-7ae4-4766-b505-366de9b09870-maas-api-tls\") pod \"maas-api-786fdf86ff-mmkr7\" (UID: \"88803825-7ae4-4766-b505-366de9b09870\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7"
Sep 15 12:55:28.808701 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.808682    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmcp4\" (UniqueName: \"kubernetes.io/projected/88803825-7ae4-4766-b505-366de9b09870-kube-api-access-hmcp4\") pod \"maas-api-786fdf86ff-mmkr7\" (UID: \"88803825-7ae4-4766-b505-366de9b09870\") " pod="odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7"
Sep 15 12:55:28.941791 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:28.941761    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7"
Sep 15 12:55:29.134425 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:29.134392    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-45tlr"]
Sep 15 12:55:29.137803 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:29.137777    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-45tlr"
Sep 15 12:55:29.139866 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:29.139844    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kldb5\""
Sep 15 12:55:29.139996 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:29.139910    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 15 12:55:29.157027 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:29.157004    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-45tlr"]
Sep 15 12:55:29.204022 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:29.203926    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn6mq\" (UniqueName: \"kubernetes.io/projected/c13fe9f2-5622-4ad6-9c64-bf4a7e20f440-kube-api-access-xn6mq\") pod \"payload-processing-5b54b7fbb7-45tlr\" (UID: \"c13fe9f2-5622-4ad6-9c64-bf4a7e20f440\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-45tlr"
Sep 15 12:55:29.204022 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:29.203992    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c13fe9f2-5622-4ad6-9c64-bf4a7e20f440-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-45tlr\" (UID: \"c13fe9f2-5622-4ad6-9c64-bf4a7e20f440\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-45tlr"
Sep 15 12:55:29.220497 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:29.220415    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7"]
Sep 15 12:55:29.223204 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:55:29.223168    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88803825_7ae4_4766_b505_366de9b09870.slice/crio-ec49ae30012dfb7f1223923ea8594adcb2a414c94e6421868c5f39b745e72441 WatchSource:0}: Error finding container ec49ae30012dfb7f1223923ea8594adcb2a414c94e6421868c5f39b745e72441: Status 404 returned error can't find the container with id ec49ae30012dfb7f1223923ea8594adcb2a414c94e6421868c5f39b745e72441
Sep 15 12:55:29.304483 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:29.304442    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn6mq\" (UniqueName: \"kubernetes.io/projected/c13fe9f2-5622-4ad6-9c64-bf4a7e20f440-kube-api-access-xn6mq\") pod \"payload-processing-5b54b7fbb7-45tlr\" (UID: \"c13fe9f2-5622-4ad6-9c64-bf4a7e20f440\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-45tlr"
Sep 15 12:55:29.304669 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:29.304538    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c13fe9f2-5622-4ad6-9c64-bf4a7e20f440-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-45tlr\" (UID: \"c13fe9f2-5622-4ad6-9c64-bf4a7e20f440\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-45tlr"
Sep 15 12:55:29.305534 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:29.305508    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c13fe9f2-5622-4ad6-9c64-bf4a7e20f440-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-45tlr\" (UID: \"c13fe9f2-5622-4ad6-9c64-bf4a7e20f440\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-45tlr"
Sep 15 12:55:29.311757 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:29.311734    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn6mq\" (UniqueName: \"kubernetes.io/projected/c13fe9f2-5622-4ad6-9c64-bf4a7e20f440-kube-api-access-xn6mq\") pod \"payload-processing-5b54b7fbb7-45tlr\" (UID: \"c13fe9f2-5622-4ad6-9c64-bf4a7e20f440\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-45tlr"
Sep 15 12:55:29.448126 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:29.448098    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-45tlr"
Sep 15 12:55:29.752251 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:29.751455    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-45tlr"]
Sep 15 12:55:29.754992 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:55:29.754886    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc13fe9f2_5622_4ad6_9c64_bf4a7e20f440.slice/crio-b8108536fdaad996800e719d7927999417a3093eb93a271e77eaca744ca72ae7 WatchSource:0}: Error finding container b8108536fdaad996800e719d7927999417a3093eb93a271e77eaca744ca72ae7: Status 404 returned error can't find the container with id b8108536fdaad996800e719d7927999417a3093eb93a271e77eaca744ca72ae7
Sep 15 12:55:30.143028 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:30.142880    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7" event={"ID":"88803825-7ae4-4766-b505-366de9b09870","Type":"ContainerStarted","Data":"ec49ae30012dfb7f1223923ea8594adcb2a414c94e6421868c5f39b745e72441"}
Sep 15 12:55:30.144794 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:30.144737    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-45tlr" event={"ID":"c13fe9f2-5622-4ad6-9c64-bf4a7e20f440","Type":"ContainerStarted","Data":"b8108536fdaad996800e719d7927999417a3093eb93a271e77eaca744ca72ae7"}
Sep 15 12:55:32.156858 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:32.156773    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-45tlr" event={"ID":"c13fe9f2-5622-4ad6-9c64-bf4a7e20f440","Type":"ContainerStarted","Data":"f6adea7350ad6b0941887d00f1908badd05454b7c5f58776a18b7587a21be3f2"}
Sep 15 12:55:32.156858 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:32.156844    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-45tlr"
Sep 15 12:55:32.158398 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:32.158375    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7" event={"ID":"88803825-7ae4-4766-b505-366de9b09870","Type":"ContainerStarted","Data":"c26c655e244d2b96eb7e014233bc4c66b955a1b7cfb18297d8e995b044e4656e"}
Sep 15 12:55:32.158496 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:32.158447    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7"
Sep 15 12:55:32.180370 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:32.180328    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-45tlr" podStartSLOduration=1.152864031 podStartE2EDuration="3.180314855s" totalImagesPullingTime="2.027450824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:55:32.178515076 +0000 UTC m=+635.899830606" watchObservedRunningTime="2026-09-15 12:55:32.180314855 +0000 UTC m=+635.901630385"
Sep 15 12:55:32.208403 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:32.208360    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7" podStartSLOduration=1.647065661 podStartE2EDuration="4.208341938s" totalImagesPullingTime="2.561276277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:55:32.206910506 +0000 UTC m=+635.928226044" watchObservedRunningTime="2026-09-15 12:55:32.208341938 +0000 UTC m=+635.929657472"
Sep 15 12:55:38.170697 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:38.170668    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-786fdf86ff-mmkr7"
Sep 15 12:55:43.165156 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:43.165125    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-45tlr"
Sep 15 12:55:51.084419 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.084383    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"]
Sep 15 12:55:51.087572 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.087553    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.089959 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.089933    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 15 12:55:51.090098 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.089987    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 15 12:55:51.090502 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.090485    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6p47f\""
Sep 15 12:55:51.090587 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.090554    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 15 12:55:51.101934 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.101911    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"]
Sep 15 12:55:51.187107 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.187073    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb\" (UID: \"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.187107 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.187105    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb\" (UID: \"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.187305 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.187139    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb\" (UID: \"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.187305 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.187158    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb\" (UID: \"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.187305 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.187177    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8zcs\" (UniqueName: \"kubernetes.io/projected/53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2-kube-api-access-p8zcs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb\" (UID: \"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.187305 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.187198    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb\" (UID: \"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.288584 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.288553    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb\" (UID: \"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.288584 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.288582    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb\" (UID: \"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.288804 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.288610    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb\" (UID: \"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.288804 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.288627    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb\" (UID: \"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.288804 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.288647    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8zcs\" (UniqueName: \"kubernetes.io/projected/53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2-kube-api-access-p8zcs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb\" (UID: \"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.288804 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.288675    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb\" (UID: \"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.289075 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.289052    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb\" (UID: \"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.289153 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.289102    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb\" (UID: \"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.289153 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.289127    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb\" (UID: \"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.290883 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.290867    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb\" (UID: \"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.291055 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.291037    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb\" (UID: \"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.295754 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.295734    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8zcs\" (UniqueName: \"kubernetes.io/projected/53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2-kube-api-access-p8zcs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb\" (UID: \"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.398175 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.398111    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:55:51.670106 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:51.670081    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"]
Sep 15 12:55:51.672486 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:55:51.672461    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e88ec6_c2b4_49b9_8c45_071d3d7ed2c2.slice/crio-fbaf0af7bffa3c2228097672f72c43a2572be636adbe1e69975df35806547de1 WatchSource:0}: Error finding container fbaf0af7bffa3c2228097672f72c43a2572be636adbe1e69975df35806547de1: Status 404 returned error can't find the container with id fbaf0af7bffa3c2228097672f72c43a2572be636adbe1e69975df35806547de1
Sep 15 12:55:52.251111 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:52.251069    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb" event={"ID":"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2","Type":"ContainerStarted","Data":"fbaf0af7bffa3c2228097672f72c43a2572be636adbe1e69975df35806547de1"}
Sep 15 12:55:53.256708 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:53.256671    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb" event={"ID":"53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2","Type":"ContainerStarted","Data":"5d6362eb4e1627ef508aa33741ee31c76c57a4ddc73904d078ab6d5845271a66"}
Sep 15 12:55:53.275501 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:55:53.275456    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb" podStartSLOduration=1.19713982 podStartE2EDuration="2.275440312s" totalImagesPullingTime="1.078300492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:55:53.273647045 +0000 UTC m=+656.994962575" watchObservedRunningTime="2026-09-15 12:55:53.275440312 +0000 UTC m=+656.996755843"
Sep 15 12:56:01.399071 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:01.399030    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:56:01.399450 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:01.399101    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:56:01.411462 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:01.411440    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:56:02.306074 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:02.306045    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb"
Sep 15 12:56:07.877735 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:07.877703    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"]
Sep 15 12:56:07.891413 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:07.891384    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:07.894415 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:07.894369    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 15 12:56:07.895573 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:07.895546    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"]
Sep 15 12:56:07.927629 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:07.927605    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0455b622-172b-43b8-a98a-cd757c2a84a2-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48\" (UID: \"0455b622-172b-43b8-a98a-cd757c2a84a2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:07.927762 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:07.927650    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0455b622-172b-43b8-a98a-cd757c2a84a2-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48\" (UID: \"0455b622-172b-43b8-a98a-cd757c2a84a2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:07.927762 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:07.927672    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0455b622-172b-43b8-a98a-cd757c2a84a2-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48\" (UID: \"0455b622-172b-43b8-a98a-cd757c2a84a2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:07.927853 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:07.927748    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0455b622-172b-43b8-a98a-cd757c2a84a2-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48\" (UID: \"0455b622-172b-43b8-a98a-cd757c2a84a2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:07.927911 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:07.927861    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0455b622-172b-43b8-a98a-cd757c2a84a2-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48\" (UID: \"0455b622-172b-43b8-a98a-cd757c2a84a2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:07.927911 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:07.927894    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7mgd\" (UniqueName: \"kubernetes.io/projected/0455b622-172b-43b8-a98a-cd757c2a84a2-kube-api-access-l7mgd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48\" (UID: \"0455b622-172b-43b8-a98a-cd757c2a84a2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:08.028949 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:08.028906    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0455b622-172b-43b8-a98a-cd757c2a84a2-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48\" (UID: \"0455b622-172b-43b8-a98a-cd757c2a84a2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:08.029160 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:08.028998    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0455b622-172b-43b8-a98a-cd757c2a84a2-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48\" (UID: \"0455b622-172b-43b8-a98a-cd757c2a84a2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:08.029160 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:08.029027    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0455b622-172b-43b8-a98a-cd757c2a84a2-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48\" (UID: \"0455b622-172b-43b8-a98a-cd757c2a84a2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:08.029160 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:08.029056    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0455b622-172b-43b8-a98a-cd757c2a84a2-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48\" (UID: \"0455b622-172b-43b8-a98a-cd757c2a84a2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:08.029160 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:08.029125    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0455b622-172b-43b8-a98a-cd757c2a84a2-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48\" (UID: \"0455b622-172b-43b8-a98a-cd757c2a84a2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:08.029160 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:08.029147    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7mgd\" (UniqueName: \"kubernetes.io/projected/0455b622-172b-43b8-a98a-cd757c2a84a2-kube-api-access-l7mgd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48\" (UID: \"0455b622-172b-43b8-a98a-cd757c2a84a2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:08.029462 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:08.029437    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0455b622-172b-43b8-a98a-cd757c2a84a2-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48\" (UID: \"0455b622-172b-43b8-a98a-cd757c2a84a2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:08.029521 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:08.029485    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0455b622-172b-43b8-a98a-cd757c2a84a2-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48\" (UID: \"0455b622-172b-43b8-a98a-cd757c2a84a2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:08.029585 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:08.029562    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0455b622-172b-43b8-a98a-cd757c2a84a2-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48\" (UID: \"0455b622-172b-43b8-a98a-cd757c2a84a2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:08.031353 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:08.031332    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0455b622-172b-43b8-a98a-cd757c2a84a2-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48\" (UID: \"0455b622-172b-43b8-a98a-cd757c2a84a2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:08.031590 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:08.031572    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0455b622-172b-43b8-a98a-cd757c2a84a2-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48\" (UID: \"0455b622-172b-43b8-a98a-cd757c2a84a2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:08.037293 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:08.037270    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7mgd\" (UniqueName: \"kubernetes.io/projected/0455b622-172b-43b8-a98a-cd757c2a84a2-kube-api-access-l7mgd\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48\" (UID: \"0455b622-172b-43b8-a98a-cd757c2a84a2\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:08.205114 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:08.205080    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:08.478647 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:08.478624    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"]
Sep 15 12:56:08.481006 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:56:08.480965    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0455b622_172b_43b8_a98a_cd757c2a84a2.slice/crio-b950722d3b67ae7b44fee3fdc53ec8a4afd46d0d4fe9470941d4a276935afb47 WatchSource:0}: Error finding container b950722d3b67ae7b44fee3fdc53ec8a4afd46d0d4fe9470941d4a276935afb47: Status 404 returned error can't find the container with id b950722d3b67ae7b44fee3fdc53ec8a4afd46d0d4fe9470941d4a276935afb47
Sep 15 12:56:08.482318 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:08.482301    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 12:56:09.326153 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:09.326115    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48" event={"ID":"0455b622-172b-43b8-a98a-cd757c2a84a2","Type":"ContainerStarted","Data":"7c51693ade2edf249e454535169d1e0432e8aa6ee2c0eaed0f0d506a413d14bd"}
Sep 15 12:56:09.326619 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:09.326172    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48" event={"ID":"0455b622-172b-43b8-a98a-cd757c2a84a2","Type":"ContainerStarted","Data":"b950722d3b67ae7b44fee3fdc53ec8a4afd46d0d4fe9470941d4a276935afb47"}
Sep 15 12:56:09.343006 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:09.342938    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48" podStartSLOduration=2.137901457 podStartE2EDuration="2.342919393s" totalImagesPullingTime="205.017936ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:56:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:56:09.342098234 +0000 UTC m=+673.063413766" watchObservedRunningTime="2026-09-15 12:56:09.342919393 +0000 UTC m=+673.064234923"
Sep 15 12:56:18.206156 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:18.206123    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:18.206568 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:18.206178    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:18.218580 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:18.218556    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:18.384280 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:18.384253    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48"
Sep 15 12:56:28.284517 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.284478    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"]
Sep 15 12:56:28.287751 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.287728    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.290007 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.289984    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 15 12:56:28.299571 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.299544    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"]
Sep 15 12:56:28.394117 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.394083    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e4a6863-e587-4646-9670-6965d78cbb7c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rj7j\" (UID: \"7e4a6863-e587-4646-9670-6965d78cbb7c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.394283 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.394134    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e4a6863-e587-4646-9670-6965d78cbb7c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rj7j\" (UID: \"7e4a6863-e587-4646-9670-6965d78cbb7c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.394283 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.394194    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnsff\" (UniqueName: \"kubernetes.io/projected/7e4a6863-e587-4646-9670-6965d78cbb7c-kube-api-access-gnsff\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rj7j\" (UID: \"7e4a6863-e587-4646-9670-6965d78cbb7c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.394283 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.394225    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e4a6863-e587-4646-9670-6965d78cbb7c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rj7j\" (UID: \"7e4a6863-e587-4646-9670-6965d78cbb7c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.394283 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.394265    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e4a6863-e587-4646-9670-6965d78cbb7c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rj7j\" (UID: \"7e4a6863-e587-4646-9670-6965d78cbb7c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.394472 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.394345    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e4a6863-e587-4646-9670-6965d78cbb7c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rj7j\" (UID: \"7e4a6863-e587-4646-9670-6965d78cbb7c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.495406 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.495376    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e4a6863-e587-4646-9670-6965d78cbb7c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rj7j\" (UID: \"7e4a6863-e587-4646-9670-6965d78cbb7c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.495586 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.495423    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e4a6863-e587-4646-9670-6965d78cbb7c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rj7j\" (UID: \"7e4a6863-e587-4646-9670-6965d78cbb7c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.495586 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.495443    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnsff\" (UniqueName: \"kubernetes.io/projected/7e4a6863-e587-4646-9670-6965d78cbb7c-kube-api-access-gnsff\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rj7j\" (UID: \"7e4a6863-e587-4646-9670-6965d78cbb7c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.495586 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.495470    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e4a6863-e587-4646-9670-6965d78cbb7c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rj7j\" (UID: \"7e4a6863-e587-4646-9670-6965d78cbb7c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.495586 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.495511    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e4a6863-e587-4646-9670-6965d78cbb7c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rj7j\" (UID: \"7e4a6863-e587-4646-9670-6965d78cbb7c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.495586 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.495552    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e4a6863-e587-4646-9670-6965d78cbb7c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rj7j\" (UID: \"7e4a6863-e587-4646-9670-6965d78cbb7c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.495916 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.495895    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e4a6863-e587-4646-9670-6965d78cbb7c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rj7j\" (UID: \"7e4a6863-e587-4646-9670-6965d78cbb7c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.495916 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.495912    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e4a6863-e587-4646-9670-6965d78cbb7c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rj7j\" (UID: \"7e4a6863-e587-4646-9670-6965d78cbb7c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.496063 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.495960    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e4a6863-e587-4646-9670-6965d78cbb7c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rj7j\" (UID: \"7e4a6863-e587-4646-9670-6965d78cbb7c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.497666 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.497642    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e4a6863-e587-4646-9670-6965d78cbb7c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rj7j\" (UID: \"7e4a6863-e587-4646-9670-6965d78cbb7c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.497924 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.497906    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e4a6863-e587-4646-9670-6965d78cbb7c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rj7j\" (UID: \"7e4a6863-e587-4646-9670-6965d78cbb7c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.502957 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.502934    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnsff\" (UniqueName: \"kubernetes.io/projected/7e4a6863-e587-4646-9670-6965d78cbb7c-kube-api-access-gnsff\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4rj7j\" (UID: \"7e4a6863-e587-4646-9670-6965d78cbb7c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.599024 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.598951    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:28.872614 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:28.872581    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"]
Sep 15 12:56:28.874679 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:56:28.874652    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e4a6863_e587_4646_9670_6965d78cbb7c.slice/crio-c9cb52aa2d8904efaac6de0a6bef12346be581ea12bd7ef5e488e9cebb7d2ef0 WatchSource:0}: Error finding container c9cb52aa2d8904efaac6de0a6bef12346be581ea12bd7ef5e488e9cebb7d2ef0: Status 404 returned error can't find the container with id c9cb52aa2d8904efaac6de0a6bef12346be581ea12bd7ef5e488e9cebb7d2ef0
Sep 15 12:56:29.421873 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:29.421839    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j" event={"ID":"7e4a6863-e587-4646-9670-6965d78cbb7c","Type":"ContainerStarted","Data":"d10097db1c35c5da15882b6520703c5211107392f482543dcfeb4097b28b08c5"}
Sep 15 12:56:29.422292 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:29.421916    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j" event={"ID":"7e4a6863-e587-4646-9670-6965d78cbb7c","Type":"ContainerStarted","Data":"c9cb52aa2d8904efaac6de0a6bef12346be581ea12bd7ef5e488e9cebb7d2ef0"}
Sep 15 12:56:29.451516 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:29.451464    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j" podStartSLOduration=1.270506333 podStartE2EDuration="1.451447717s" totalImagesPullingTime="180.941384ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:56:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:56:29.449601328 +0000 UTC m=+693.170916860" watchObservedRunningTime="2026-09-15 12:56:29.451447717 +0000 UTC m=+693.172763312"
Sep 15 12:56:38.599406 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:38.599371    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:38.599819 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:38.599433    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:38.611872 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:38.611844    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:56:39.476381 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:56:39.476350    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4rj7j"
Sep 15 12:58:17.904299 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:17.904263    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"]
Sep 15 12:58:17.907988 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:17.907953    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"
Sep 15 12:58:17.910080 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:17.910059    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-2af9a3-serving-cert\""
Sep 15 12:58:17.921914 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:17.921884    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"]
Sep 15 12:58:18.026306 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:18.026270    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb665f5e-aa83-4aa7-b855-2df48f524c64-maas-api-tls\") pod \"maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9\" (UID: \"bb665f5e-aa83-4aa7-b855-2df48f524c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"
Sep 15 12:58:18.026306 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:18.026313    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb665f5e-aa83-4aa7-b855-2df48f524c64-metrics-certs\") pod \"maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9\" (UID: \"bb665f5e-aa83-4aa7-b855-2df48f524c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"
Sep 15 12:58:18.026510 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:18.026333    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27lwg\" (UniqueName: \"kubernetes.io/projected/bb665f5e-aa83-4aa7-b855-2df48f524c64-kube-api-access-27lwg\") pod \"maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9\" (UID: \"bb665f5e-aa83-4aa7-b855-2df48f524c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"
Sep 15 12:58:18.026510 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:18.026460    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb665f5e-aa83-4aa7-b855-2df48f524c64-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9\" (UID: \"bb665f5e-aa83-4aa7-b855-2df48f524c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"
Sep 15 12:58:18.127090 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:18.127049    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb665f5e-aa83-4aa7-b855-2df48f524c64-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9\" (UID: \"bb665f5e-aa83-4aa7-b855-2df48f524c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"
Sep 15 12:58:18.127272 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:18.127130    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb665f5e-aa83-4aa7-b855-2df48f524c64-maas-api-tls\") pod \"maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9\" (UID: \"bb665f5e-aa83-4aa7-b855-2df48f524c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"
Sep 15 12:58:18.127272 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:18.127162    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb665f5e-aa83-4aa7-b855-2df48f524c64-metrics-certs\") pod \"maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9\" (UID: \"bb665f5e-aa83-4aa7-b855-2df48f524c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"
Sep 15 12:58:18.127272 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:18.127188    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27lwg\" (UniqueName: \"kubernetes.io/projected/bb665f5e-aa83-4aa7-b855-2df48f524c64-kube-api-access-27lwg\") pod \"maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9\" (UID: \"bb665f5e-aa83-4aa7-b855-2df48f524c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"
Sep 15 12:58:18.127437 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:58:18.127269    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-serving-cert: secret "maas-api-e2e-worker-w4-2af9a3-serving-cert" not found
Sep 15 12:58:18.127437 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:58:18.127362    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb665f5e-aa83-4aa7-b855-2df48f524c64-maas-api-tls podName:bb665f5e-aa83-4aa7-b855-2df48f524c64 nodeName:}" failed. No retries permitted until 2026-09-15 12:58:18.627331659 +0000 UTC m=+802.348647181 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bb665f5e-aa83-4aa7-b855-2df48f524c64-maas-api-tls") pod "maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9" (UID: "bb665f5e-aa83-4aa7-b855-2df48f524c64") : secret "maas-api-e2e-worker-w4-2af9a3-serving-cert" not found
Sep 15 12:58:18.127699 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:18.127680    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb665f5e-aa83-4aa7-b855-2df48f524c64-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9\" (UID: \"bb665f5e-aa83-4aa7-b855-2df48f524c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"
Sep 15 12:58:18.129564 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:18.129543    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb665f5e-aa83-4aa7-b855-2df48f524c64-metrics-certs\") pod \"maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9\" (UID: \"bb665f5e-aa83-4aa7-b855-2df48f524c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"
Sep 15 12:58:18.137734 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:18.137705    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27lwg\" (UniqueName: \"kubernetes.io/projected/bb665f5e-aa83-4aa7-b855-2df48f524c64-kube-api-access-27lwg\") pod \"maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9\" (UID: \"bb665f5e-aa83-4aa7-b855-2df48f524c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"
Sep 15 12:58:18.632521 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:18.632482    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb665f5e-aa83-4aa7-b855-2df48f524c64-maas-api-tls\") pod \"maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9\" (UID: \"bb665f5e-aa83-4aa7-b855-2df48f524c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"
Sep 15 12:58:18.634825 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:18.634793    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb665f5e-aa83-4aa7-b855-2df48f524c64-maas-api-tls\") pod \"maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9\" (UID: \"bb665f5e-aa83-4aa7-b855-2df48f524c64\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"
Sep 15 12:58:18.820349 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:18.820317    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"
Sep 15 12:58:19.103229 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.103203    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"]
Sep 15 12:58:19.104442 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:58:19.104419    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb665f5e_aa83_4aa7_b855_2df48f524c64.slice/crio-adb9528c348758af7320f68aaff3f5bb545d8e8236e34cd91acf444129ac3afc WatchSource:0}: Error finding container adb9528c348758af7320f68aaff3f5bb545d8e8236e34cd91acf444129ac3afc: Status 404 returned error can't find the container with id adb9528c348758af7320f68aaff3f5bb545d8e8236e34cd91acf444129ac3afc
Sep 15 12:58:19.578501 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.578466    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"]
Sep 15 12:58:19.582393 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.582369    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"
Sep 15 12:58:19.585108 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.585081    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-6c9f0b-serving-cert\""
Sep 15 12:58:19.601928 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.601883    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"]
Sep 15 12:58:19.640702 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.640669    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c51aca84-b2fa-4d8b-9f36-e668a5182363-maas-api-tls\") pod \"maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66\" (UID: \"c51aca84-b2fa-4d8b-9f36-e668a5182363\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"
Sep 15 12:58:19.640839 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.640711    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whd9d\" (UniqueName: \"kubernetes.io/projected/c51aca84-b2fa-4d8b-9f36-e668a5182363-kube-api-access-whd9d\") pod \"maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66\" (UID: \"c51aca84-b2fa-4d8b-9f36-e668a5182363\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"
Sep 15 12:58:19.640839 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.640731    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c51aca84-b2fa-4d8b-9f36-e668a5182363-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66\" (UID: \"c51aca84-b2fa-4d8b-9f36-e668a5182363\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"
Sep 15 12:58:19.640915 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.640876    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c51aca84-b2fa-4d8b-9f36-e668a5182363-metrics-certs\") pod \"maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66\" (UID: \"c51aca84-b2fa-4d8b-9f36-e668a5182363\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"
Sep 15 12:58:19.742215 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.742134    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c51aca84-b2fa-4d8b-9f36-e668a5182363-metrics-certs\") pod \"maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66\" (UID: \"c51aca84-b2fa-4d8b-9f36-e668a5182363\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"
Sep 15 12:58:19.742215 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.742174    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c51aca84-b2fa-4d8b-9f36-e668a5182363-maas-api-tls\") pod \"maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66\" (UID: \"c51aca84-b2fa-4d8b-9f36-e668a5182363\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"
Sep 15 12:58:19.742215 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.742198    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whd9d\" (UniqueName: \"kubernetes.io/projected/c51aca84-b2fa-4d8b-9f36-e668a5182363-kube-api-access-whd9d\") pod \"maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66\" (UID: \"c51aca84-b2fa-4d8b-9f36-e668a5182363\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"
Sep 15 12:58:19.742215 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.742215    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c51aca84-b2fa-4d8b-9f36-e668a5182363-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66\" (UID: \"c51aca84-b2fa-4d8b-9f36-e668a5182363\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"
Sep 15 12:58:19.742503 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:58:19.742320    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-serving-cert: secret "maas-api-e2e-worker-w0-6c9f0b-serving-cert" not found
Sep 15 12:58:19.742503 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:58:19.742393    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c51aca84-b2fa-4d8b-9f36-e668a5182363-maas-api-tls podName:c51aca84-b2fa-4d8b-9f36-e668a5182363 nodeName:}" failed. No retries permitted until 2026-09-15 12:58:20.24237583 +0000 UTC m=+803.963691339 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c51aca84-b2fa-4d8b-9f36-e668a5182363-maas-api-tls") pod "maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66" (UID: "c51aca84-b2fa-4d8b-9f36-e668a5182363") : secret "maas-api-e2e-worker-w0-6c9f0b-serving-cert" not found
Sep 15 12:58:19.742836 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.742810    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c51aca84-b2fa-4d8b-9f36-e668a5182363-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66\" (UID: \"c51aca84-b2fa-4d8b-9f36-e668a5182363\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"
Sep 15 12:58:19.744642 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.744624    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c51aca84-b2fa-4d8b-9f36-e668a5182363-metrics-certs\") pod \"maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66\" (UID: \"c51aca84-b2fa-4d8b-9f36-e668a5182363\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"
Sep 15 12:58:19.752387 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.752363    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whd9d\" (UniqueName: \"kubernetes.io/projected/c51aca84-b2fa-4d8b-9f36-e668a5182363-kube-api-access-whd9d\") pod \"maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66\" (UID: \"c51aca84-b2fa-4d8b-9f36-e668a5182363\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"
Sep 15 12:58:19.917233 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.917192    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9" event={"ID":"bb665f5e-aa83-4aa7-b855-2df48f524c64","Type":"ContainerStarted","Data":"3e447d737afe27da0583f77092baf6e83b4996603eedeb201e4a113bd527d742"}
Sep 15 12:58:19.917431 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.917252    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9" event={"ID":"bb665f5e-aa83-4aa7-b855-2df48f524c64","Type":"ContainerStarted","Data":"adb9528c348758af7320f68aaff3f5bb545d8e8236e34cd91acf444129ac3afc"}
Sep 15 12:58:19.917431 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.917359    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"
Sep 15 12:58:19.943778 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:19.943730    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9" podStartSLOduration=2.592496517 podStartE2EDuration="2.943714521s" totalImagesPullingTime="351.218004ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:19.942076196 +0000 UTC m=+803.663391728" watchObservedRunningTime="2026-09-15 12:58:19.943714521 +0000 UTC m=+803.665030073"
Sep 15 12:58:20.245706 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.245672    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c51aca84-b2fa-4d8b-9f36-e668a5182363-maas-api-tls\") pod \"maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66\" (UID: \"c51aca84-b2fa-4d8b-9f36-e668a5182363\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"
Sep 15 12:58:20.248101 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.248078    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c51aca84-b2fa-4d8b-9f36-e668a5182363-maas-api-tls\") pod \"maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66\" (UID: \"c51aca84-b2fa-4d8b-9f36-e668a5182363\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"
Sep 15 12:58:20.341829 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.341793    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr"]
Sep 15 12:58:20.345394 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.345375    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr"
Sep 15 12:58:20.347480 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.347461    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-6c9f0b\""
Sep 15 12:58:20.347600 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.347488    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-6c9f0b-dockercfg-dpr9m\""
Sep 15 12:58:20.357966 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.357944    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr"]
Sep 15 12:58:20.447534 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.447496    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8639557c-c952-443b-a6d8-412e2a219dd9-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr\" (UID: \"8639557c-c952-443b-a6d8-412e2a219dd9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr"
Sep 15 12:58:20.447689 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.447601    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlntb\" (UniqueName: \"kubernetes.io/projected/8639557c-c952-443b-a6d8-412e2a219dd9-kube-api-access-zlntb\") pod \"payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr\" (UID: \"8639557c-c952-443b-a6d8-412e2a219dd9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr"
Sep 15 12:58:20.492947 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.492912    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"
Sep 15 12:58:20.549008 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.548519    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlntb\" (UniqueName: \"kubernetes.io/projected/8639557c-c952-443b-a6d8-412e2a219dd9-kube-api-access-zlntb\") pod \"payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr\" (UID: \"8639557c-c952-443b-a6d8-412e2a219dd9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr"
Sep 15 12:58:20.549008 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.548572    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8639557c-c952-443b-a6d8-412e2a219dd9-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr\" (UID: \"8639557c-c952-443b-a6d8-412e2a219dd9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr"
Sep 15 12:58:20.549708 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.549625    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8639557c-c952-443b-a6d8-412e2a219dd9-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr\" (UID: \"8639557c-c952-443b-a6d8-412e2a219dd9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr"
Sep 15 12:58:20.570568 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.570540    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlntb\" (UniqueName: \"kubernetes.io/projected/8639557c-c952-443b-a6d8-412e2a219dd9-kube-api-access-zlntb\") pod \"payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr\" (UID: \"8639557c-c952-443b-a6d8-412e2a219dd9\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr"
Sep 15 12:58:20.574622 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.574600    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm"]
Sep 15 12:58:20.579395 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.579376    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm"
Sep 15 12:58:20.581148 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.581127    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-528f6b-serving-cert\""
Sep 15 12:58:20.589482 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.589362    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm"]
Sep 15 12:58:20.649043 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.649013    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9320923-d5fa-4442-bd26-855a306c2baa-maas-api-tls\") pod \"maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm\" (UID: \"a9320923-d5fa-4442-bd26-855a306c2baa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm"
Sep 15 12:58:20.649206 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.649046    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9320923-d5fa-4442-bd26-855a306c2baa-openshift-service-ca\") pod \"maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm\" (UID: \"a9320923-d5fa-4442-bd26-855a306c2baa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm"
Sep 15 12:58:20.649206 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.649087    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9320923-d5fa-4442-bd26-855a306c2baa-metrics-certs\") pod \"maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm\" (UID: \"a9320923-d5fa-4442-bd26-855a306c2baa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm"
Sep 15 12:58:20.649206 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.649127    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc7lh\" (UniqueName: \"kubernetes.io/projected/a9320923-d5fa-4442-bd26-855a306c2baa-kube-api-access-xc7lh\") pod \"maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm\" (UID: \"a9320923-d5fa-4442-bd26-855a306c2baa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm"
Sep 15 12:58:20.655891 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.655865    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr"
Sep 15 12:58:20.750383 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.750320    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9320923-d5fa-4442-bd26-855a306c2baa-maas-api-tls\") pod \"maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm\" (UID: \"a9320923-d5fa-4442-bd26-855a306c2baa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm"
Sep 15 12:58:20.750383 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.750352    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9320923-d5fa-4442-bd26-855a306c2baa-openshift-service-ca\") pod \"maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm\" (UID: \"a9320923-d5fa-4442-bd26-855a306c2baa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm"
Sep 15 12:58:20.750548 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.750461    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9320923-d5fa-4442-bd26-855a306c2baa-metrics-certs\") pod \"maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm\" (UID: \"a9320923-d5fa-4442-bd26-855a306c2baa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm"
Sep 15 12:58:20.750548 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.750495    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc7lh\" (UniqueName: \"kubernetes.io/projected/a9320923-d5fa-4442-bd26-855a306c2baa-kube-api-access-xc7lh\") pod \"maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm\" (UID: \"a9320923-d5fa-4442-bd26-855a306c2baa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm"
Sep 15 12:58:20.751216 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.751190    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9320923-d5fa-4442-bd26-855a306c2baa-openshift-service-ca\") pod \"maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm\" (UID: \"a9320923-d5fa-4442-bd26-855a306c2baa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm"
Sep 15 12:58:20.753203 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.753183    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9320923-d5fa-4442-bd26-855a306c2baa-maas-api-tls\") pod \"maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm\" (UID: \"a9320923-d5fa-4442-bd26-855a306c2baa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm"
Sep 15 12:58:20.753203 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.753193    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9320923-d5fa-4442-bd26-855a306c2baa-metrics-certs\") pod \"maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm\" (UID: \"a9320923-d5fa-4442-bd26-855a306c2baa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm"
Sep 15 12:58:20.760544 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.760522    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc7lh\" (UniqueName: \"kubernetes.io/projected/a9320923-d5fa-4442-bd26-855a306c2baa-kube-api-access-xc7lh\") pod \"maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm\" (UID: \"a9320923-d5fa-4442-bd26-855a306c2baa\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm"
Sep 15 12:58:20.775809 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.775785    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"]
Sep 15 12:58:20.778718 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:58:20.778695    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc51aca84_b2fa_4d8b_9f36_e668a5182363.slice/crio-8821921a90dfec995eb35962ca418600f21e00f085949a403f08c4aeecf0c4a2 WatchSource:0}: Error finding container 8821921a90dfec995eb35962ca418600f21e00f085949a403f08c4aeecf0c4a2: Status 404 returned error can't find the container with id 8821921a90dfec995eb35962ca418600f21e00f085949a403f08c4aeecf0c4a2
Sep 15 12:58:20.893226 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.893194    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm"
Sep 15 12:58:20.922628 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.922592    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66" event={"ID":"c51aca84-b2fa-4d8b-9f36-e668a5182363","Type":"ContainerStarted","Data":"8821921a90dfec995eb35962ca418600f21e00f085949a403f08c4aeecf0c4a2"}
Sep 15 12:58:20.934191 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:20.934115    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr"]
Sep 15 12:58:20.936489 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:58:20.936465    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8639557c_c952_443b_a6d8_412e2a219dd9.slice/crio-0269f4b81988eeadcc08ad7f665f0207a4a829886287313e8aad550b44a4b234 WatchSource:0}: Error finding container 0269f4b81988eeadcc08ad7f665f0207a4a829886287313e8aad550b44a4b234: Status 404 returned error can't find the container with id 0269f4b81988eeadcc08ad7f665f0207a4a829886287313e8aad550b44a4b234
Sep 15 12:58:21.169023 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:21.168995    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm"]
Sep 15 12:58:21.170851 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:58:21.170823    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9320923_d5fa_4442_bd26_855a306c2baa.slice/crio-67849caba01fe7d74ec866429049d745c972f403c9840a3a17773a1d30c517fb WatchSource:0}: Error finding container 67849caba01fe7d74ec866429049d745c972f403c9840a3a17773a1d30c517fb: Status 404 returned error can't find the container with id 67849caba01fe7d74ec866429049d745c972f403c9840a3a17773a1d30c517fb
Sep 15 12:58:21.928781 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:21.928745    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr" event={"ID":"8639557c-c952-443b-a6d8-412e2a219dd9","Type":"ContainerStarted","Data":"9cb657115928e5e5e5313ce59052937d985ab9e61ddb14551d17dfc866bb07ce"}
Sep 15 12:58:21.929258 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:21.928805    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr" event={"ID":"8639557c-c952-443b-a6d8-412e2a219dd9","Type":"ContainerStarted","Data":"0269f4b81988eeadcc08ad7f665f0207a4a829886287313e8aad550b44a4b234"}
Sep 15 12:58:21.929258 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:21.928834    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr"
Sep 15 12:58:21.930023 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:21.930000    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm" event={"ID":"a9320923-d5fa-4442-bd26-855a306c2baa","Type":"ContainerStarted","Data":"67849caba01fe7d74ec866429049d745c972f403c9840a3a17773a1d30c517fb"}
Sep 15 12:58:21.931553 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:21.931533    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66" event={"ID":"c51aca84-b2fa-4d8b-9f36-e668a5182363","Type":"ContainerStarted","Data":"1b87ade968ce920e845113afc955c2eaff4827193ed1cb18d7850ef74f7c0933"}
Sep 15 12:58:21.931691 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:21.931679    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"
Sep 15 12:58:21.947034 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:21.946995    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr" podStartSLOduration=1.946967992 podStartE2EDuration="1.946967992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:21.944553765 +0000 UTC m=+805.665869296" watchObservedRunningTime="2026-09-15 12:58:21.946967992 +0000 UTC m=+805.668283514"
Sep 15 12:58:21.965912 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:21.965863    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66" podStartSLOduration=2.690544631 podStartE2EDuration="2.965849991s" totalImagesPullingTime="275.30536ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:21.963225286 +0000 UTC m=+805.684540816" watchObservedRunningTime="2026-09-15 12:58:21.965849991 +0000 UTC m=+805.687165569"
Sep 15 12:58:23.942582 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:23.942545    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm" event={"ID":"a9320923-d5fa-4442-bd26-855a306c2baa","Type":"ContainerStarted","Data":"de278cc03cb4ea47c16d8f55d2ad2f8d564efde4fbd1477e21071030848d8cf5"}
Sep 15 12:58:23.942996 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:23.942608    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm"
Sep 15 12:58:23.975965 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:23.971875    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm" podStartSLOduration=1.5031605099999998 podStartE2EDuration="3.971853426s" totalImagesPullingTime="2.468692916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:23.966231023 +0000 UTC m=+807.687546578" watchObservedRunningTime="2026-09-15 12:58:23.971853426 +0000 UTC m=+807.693168961"
Sep 15 12:58:25.927676 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:25.927649    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9"
Sep 15 12:58:27.941914 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:27.941887    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66"
Sep 15 12:58:29.676424 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:29.676391    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"]
Sep 15 12:58:29.680224 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:29.680196    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"
Sep 15 12:58:29.682422 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:29.682397    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-08701e10-serving-cert\""
Sep 15 12:58:29.682578 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:29.682465    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"]
Sep 15 12:58:29.835714 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:29.835676    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2vxl\" (UniqueName: \"kubernetes.io/projected/e8e2adfc-3cec-42a3-8282-bde3f9116f30-kube-api-access-s2vxl\") pod \"maas-api-e2e-ait-08701e10-586b96dbcd-m65tb\" (UID: \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"
Sep 15 12:58:29.835885 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:29.835740    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e2adfc-3cec-42a3-8282-bde3f9116f30-openshift-service-ca\") pod \"maas-api-e2e-ait-08701e10-586b96dbcd-m65tb\" (UID: \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"
Sep 15 12:58:29.835885 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:29.835826    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8e2adfc-3cec-42a3-8282-bde3f9116f30-maas-api-tls\") pod \"maas-api-e2e-ait-08701e10-586b96dbcd-m65tb\" (UID: \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"
Sep 15 12:58:29.835957 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:29.835907    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8e2adfc-3cec-42a3-8282-bde3f9116f30-metrics-certs\") pod \"maas-api-e2e-ait-08701e10-586b96dbcd-m65tb\" (UID: \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"
Sep 15 12:58:29.936508 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:29.936420    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8e2adfc-3cec-42a3-8282-bde3f9116f30-maas-api-tls\") pod \"maas-api-e2e-ait-08701e10-586b96dbcd-m65tb\" (UID: \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"
Sep 15 12:58:29.936508 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:29.936494    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8e2adfc-3cec-42a3-8282-bde3f9116f30-metrics-certs\") pod \"maas-api-e2e-ait-08701e10-586b96dbcd-m65tb\" (UID: \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"
Sep 15 12:58:29.936698 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:29.936546    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2vxl\" (UniqueName: \"kubernetes.io/projected/e8e2adfc-3cec-42a3-8282-bde3f9116f30-kube-api-access-s2vxl\") pod \"maas-api-e2e-ait-08701e10-586b96dbcd-m65tb\" (UID: \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"
Sep 15 12:58:29.936698 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:29.936603    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e2adfc-3cec-42a3-8282-bde3f9116f30-openshift-service-ca\") pod \"maas-api-e2e-ait-08701e10-586b96dbcd-m65tb\" (UID: \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"
Sep 15 12:58:29.937319 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:29.937286    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e2adfc-3cec-42a3-8282-bde3f9116f30-openshift-service-ca\") pod \"maas-api-e2e-ait-08701e10-586b96dbcd-m65tb\" (UID: \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"
Sep 15 12:58:29.939056 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:29.939034    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8e2adfc-3cec-42a3-8282-bde3f9116f30-metrics-certs\") pod \"maas-api-e2e-ait-08701e10-586b96dbcd-m65tb\" (UID: \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"
Sep 15 12:58:29.939151 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:29.939072    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8e2adfc-3cec-42a3-8282-bde3f9116f30-maas-api-tls\") pod \"maas-api-e2e-ait-08701e10-586b96dbcd-m65tb\" (UID: \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"
Sep 15 12:58:29.954147 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:29.954121    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm"
Sep 15 12:58:29.965520 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:29.965489    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2vxl\" (UniqueName: \"kubernetes.io/projected/e8e2adfc-3cec-42a3-8282-bde3f9116f30-kube-api-access-s2vxl\") pod \"maas-api-e2e-ait-08701e10-586b96dbcd-m65tb\" (UID: \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"
Sep 15 12:58:29.994822 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:29.994788    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"
Sep 15 12:58:30.275354 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:30.275328    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"]
Sep 15 12:58:30.277465 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:58:30.277442    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e2adfc_3cec_42a3_8282_bde3f9116f30.slice/crio-f2baeb865a59ba2d7e916bfd3a7d0f6665949eef93f7c91f94d83caffa3bfc1c WatchSource:0}: Error finding container f2baeb865a59ba2d7e916bfd3a7d0f6665949eef93f7c91f94d83caffa3bfc1c: Status 404 returned error can't find the container with id f2baeb865a59ba2d7e916bfd3a7d0f6665949eef93f7c91f94d83caffa3bfc1c
Sep 15 12:58:30.979873 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:30.979830    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb" event={"ID":"e8e2adfc-3cec-42a3-8282-bde3f9116f30","Type":"ContainerStarted","Data":"cb1b4839b75a521815290832b7a64071306d4f4b4a9e072bf95ad1d094fdf060"}
Sep 15 12:58:30.980259 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:30.979896    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb" event={"ID":"e8e2adfc-3cec-42a3-8282-bde3f9116f30","Type":"ContainerStarted","Data":"f2baeb865a59ba2d7e916bfd3a7d0f6665949eef93f7c91f94d83caffa3bfc1c"}
Sep 15 12:58:30.980259 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:30.980011    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"
Sep 15 12:58:31.013852 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:31.013801    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb" podStartSLOduration=1.64532716 podStartE2EDuration="2.013783643s" totalImagesPullingTime="368.456483ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:31.010901672 +0000 UTC m=+814.732217204" watchObservedRunningTime="2026-09-15 12:58:31.013783643 +0000 UTC m=+814.735099173"
Sep 15 12:58:32.939082 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:32.939039    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr"
Sep 15 12:58:34.420370 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:34.420333    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"]
Sep 15 12:58:34.424212 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:34.424192    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"
Sep 15 12:58:34.426336 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:34.426317    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-59f4a3-serving-cert\""
Sep 15 12:58:34.439851 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:34.439824    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"]
Sep 15 12:58:34.578382 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:34.578346    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52bb1f5a-7608-4394-b2dd-29964b7ed944-openshift-service-ca\") pod \"maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp\" (UID: \"52bb1f5a-7608-4394-b2dd-29964b7ed944\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"
Sep 15 12:58:34.578536 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:34.578388    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9xb6\" (UniqueName: \"kubernetes.io/projected/52bb1f5a-7608-4394-b2dd-29964b7ed944-kube-api-access-p9xb6\") pod \"maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp\" (UID: \"52bb1f5a-7608-4394-b2dd-29964b7ed944\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"
Sep 15 12:58:34.578536 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:34.578408    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52bb1f5a-7608-4394-b2dd-29964b7ed944-metrics-certs\") pod \"maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp\" (UID: \"52bb1f5a-7608-4394-b2dd-29964b7ed944\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"
Sep 15 12:58:34.578536 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:34.578455    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52bb1f5a-7608-4394-b2dd-29964b7ed944-maas-api-tls\") pod \"maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp\" (UID: \"52bb1f5a-7608-4394-b2dd-29964b7ed944\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"
Sep 15 12:58:34.678911 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:34.678829    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52bb1f5a-7608-4394-b2dd-29964b7ed944-maas-api-tls\") pod \"maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp\" (UID: \"52bb1f5a-7608-4394-b2dd-29964b7ed944\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"
Sep 15 12:58:34.679075 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:34.678916    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52bb1f5a-7608-4394-b2dd-29964b7ed944-openshift-service-ca\") pod \"maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp\" (UID: \"52bb1f5a-7608-4394-b2dd-29964b7ed944\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"
Sep 15 12:58:34.679075 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:34.678943    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9xb6\" (UniqueName: \"kubernetes.io/projected/52bb1f5a-7608-4394-b2dd-29964b7ed944-kube-api-access-p9xb6\") pod \"maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp\" (UID: \"52bb1f5a-7608-4394-b2dd-29964b7ed944\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"
Sep 15 12:58:34.679075 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:34.678959    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52bb1f5a-7608-4394-b2dd-29964b7ed944-metrics-certs\") pod \"maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp\" (UID: \"52bb1f5a-7608-4394-b2dd-29964b7ed944\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"
Sep 15 12:58:34.679633 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:34.679605    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52bb1f5a-7608-4394-b2dd-29964b7ed944-openshift-service-ca\") pod \"maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp\" (UID: \"52bb1f5a-7608-4394-b2dd-29964b7ed944\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"
Sep 15 12:58:34.681216 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:34.681194    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52bb1f5a-7608-4394-b2dd-29964b7ed944-maas-api-tls\") pod \"maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp\" (UID: \"52bb1f5a-7608-4394-b2dd-29964b7ed944\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"
Sep 15 12:58:34.681311 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:34.681289    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52bb1f5a-7608-4394-b2dd-29964b7ed944-metrics-certs\") pod \"maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp\" (UID: \"52bb1f5a-7608-4394-b2dd-29964b7ed944\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"
Sep 15 12:58:34.688466 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:34.688446    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9xb6\" (UniqueName: \"kubernetes.io/projected/52bb1f5a-7608-4394-b2dd-29964b7ed944-kube-api-access-p9xb6\") pod \"maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp\" (UID: \"52bb1f5a-7608-4394-b2dd-29964b7ed944\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"
Sep 15 12:58:34.735582 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:34.735550    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"
Sep 15 12:58:35.011221 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:35.011195    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"]
Sep 15 12:58:35.013280 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:58:35.013253    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52bb1f5a_7608_4394_b2dd_29964b7ed944.slice/crio-0f65a05ad81503f36c33fca19fc2c9dfed05dfe33b226c763b73335aac31d835 WatchSource:0}: Error finding container 0f65a05ad81503f36c33fca19fc2c9dfed05dfe33b226c763b73335aac31d835: Status 404 returned error can't find the container with id 0f65a05ad81503f36c33fca19fc2c9dfed05dfe33b226c763b73335aac31d835
Sep 15 12:58:36.009084 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:36.009047    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp" event={"ID":"52bb1f5a-7608-4394-b2dd-29964b7ed944","Type":"ContainerStarted","Data":"dc43d4d7364d092f94e36d500bc6c7a4c37fd8601b7eb99278cb66d3bb7f306c"}
Sep 15 12:58:36.009510 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:36.009100    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp" event={"ID":"52bb1f5a-7608-4394-b2dd-29964b7ed944","Type":"ContainerStarted","Data":"0f65a05ad81503f36c33fca19fc2c9dfed05dfe33b226c763b73335aac31d835"}
Sep 15 12:58:36.009510 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:36.009142    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"
Sep 15 12:58:36.030961 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:36.030910    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp" podStartSLOduration=1.694342315 podStartE2EDuration="2.030895411s" totalImagesPullingTime="336.553096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:36.029470252 +0000 UTC m=+819.750785785" watchObservedRunningTime="2026-09-15 12:58:36.030895411 +0000 UTC m=+819.752210976"
Sep 15 12:58:36.990429 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:36.990401    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"
Sep 15 12:58:42.019337 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:42.019308    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"
Sep 15 12:58:44.208042 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:44.208007    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"]
Sep 15 12:58:44.211708 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:44.211688    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"
Sep 15 12:58:44.213849 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:44.213826    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-1c35dd-serving-cert\""
Sep 15 12:58:44.225256 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:44.225232    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"]
Sep 15 12:58:44.263094 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:44.263069    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2ac296c-7702-4bf6-be76-502c62309551-maas-api-tls\") pod \"maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s\" (UID: \"a2ac296c-7702-4bf6-be76-502c62309551\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"
Sep 15 12:58:44.263222 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:44.263110    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ac296c-7702-4bf6-be76-502c62309551-metrics-certs\") pod \"maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s\" (UID: \"a2ac296c-7702-4bf6-be76-502c62309551\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"
Sep 15 12:58:44.263222 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:44.263199    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp5qz\" (UniqueName: \"kubernetes.io/projected/a2ac296c-7702-4bf6-be76-502c62309551-kube-api-access-gp5qz\") pod \"maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s\" (UID: \"a2ac296c-7702-4bf6-be76-502c62309551\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"
Sep 15 12:58:44.263294 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:44.263227    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2ac296c-7702-4bf6-be76-502c62309551-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s\" (UID: \"a2ac296c-7702-4bf6-be76-502c62309551\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"
Sep 15 12:58:44.363922 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:44.363884    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2ac296c-7702-4bf6-be76-502c62309551-maas-api-tls\") pod \"maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s\" (UID: \"a2ac296c-7702-4bf6-be76-502c62309551\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"
Sep 15 12:58:44.363922 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:44.363930    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ac296c-7702-4bf6-be76-502c62309551-metrics-certs\") pod \"maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s\" (UID: \"a2ac296c-7702-4bf6-be76-502c62309551\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"
Sep 15 12:58:44.364138 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:44.364025    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp5qz\" (UniqueName: \"kubernetes.io/projected/a2ac296c-7702-4bf6-be76-502c62309551-kube-api-access-gp5qz\") pod \"maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s\" (UID: \"a2ac296c-7702-4bf6-be76-502c62309551\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"
Sep 15 12:58:44.364138 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:58:44.364035    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-serving-cert: secret "maas-api-e2e-inf-b-1c35dd-serving-cert" not found
Sep 15 12:58:44.364138 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:58:44.364099    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2ac296c-7702-4bf6-be76-502c62309551-maas-api-tls podName:a2ac296c-7702-4bf6-be76-502c62309551 nodeName:}" failed. No retries permitted until 2026-09-15 12:58:44.86407746 +0000 UTC m=+828.585392984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a2ac296c-7702-4bf6-be76-502c62309551-maas-api-tls") pod "maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s" (UID: "a2ac296c-7702-4bf6-be76-502c62309551") : secret "maas-api-e2e-inf-b-1c35dd-serving-cert" not found
Sep 15 12:58:44.364138 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:44.364124    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2ac296c-7702-4bf6-be76-502c62309551-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s\" (UID: \"a2ac296c-7702-4bf6-be76-502c62309551\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"
Sep 15 12:58:44.364770 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:44.364752    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2ac296c-7702-4bf6-be76-502c62309551-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s\" (UID: \"a2ac296c-7702-4bf6-be76-502c62309551\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"
Sep 15 12:58:44.366498 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:44.366479    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2ac296c-7702-4bf6-be76-502c62309551-metrics-certs\") pod \"maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s\" (UID: \"a2ac296c-7702-4bf6-be76-502c62309551\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"
Sep 15 12:58:44.375991 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:44.372938    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp5qz\" (UniqueName: \"kubernetes.io/projected/a2ac296c-7702-4bf6-be76-502c62309551-kube-api-access-gp5qz\") pod \"maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s\" (UID: \"a2ac296c-7702-4bf6-be76-502c62309551\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"
Sep 15 12:58:44.869120 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:44.869087    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2ac296c-7702-4bf6-be76-502c62309551-maas-api-tls\") pod \"maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s\" (UID: \"a2ac296c-7702-4bf6-be76-502c62309551\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"
Sep 15 12:58:44.871511 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:44.871477    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2ac296c-7702-4bf6-be76-502c62309551-maas-api-tls\") pod \"maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s\" (UID: \"a2ac296c-7702-4bf6-be76-502c62309551\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"
Sep 15 12:58:45.084611 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:45.084580    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr"]
Sep 15 12:58:45.089535 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:45.089518    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr"
Sep 15 12:58:45.091710 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:45.091684    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-1c35dd-dockercfg-ml9xz\""
Sep 15 12:58:45.092180 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:45.092160    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-1c35dd\""
Sep 15 12:58:45.101945 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:45.101923    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr"]
Sep 15 12:58:45.123244 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:45.123178    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"
Sep 15 12:58:45.172337 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:45.172301    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb865e51-fc60-4fde-9f62-b071ff69fc0e-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr\" (UID: \"eb865e51-fc60-4fde-9f62-b071ff69fc0e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr"
Sep 15 12:58:45.172337 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:45.172339    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjlln\" (UniqueName: \"kubernetes.io/projected/eb865e51-fc60-4fde-9f62-b071ff69fc0e-kube-api-access-hjlln\") pod \"payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr\" (UID: \"eb865e51-fc60-4fde-9f62-b071ff69fc0e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr"
Sep 15 12:58:45.272995 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:45.272933    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb865e51-fc60-4fde-9f62-b071ff69fc0e-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr\" (UID: \"eb865e51-fc60-4fde-9f62-b071ff69fc0e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr"
Sep 15 12:58:45.273345 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:45.273000    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjlln\" (UniqueName: \"kubernetes.io/projected/eb865e51-fc60-4fde-9f62-b071ff69fc0e-kube-api-access-hjlln\") pod \"payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr\" (UID: \"eb865e51-fc60-4fde-9f62-b071ff69fc0e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr"
Sep 15 12:58:45.273724 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:45.273703    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eb865e51-fc60-4fde-9f62-b071ff69fc0e-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr\" (UID: \"eb865e51-fc60-4fde-9f62-b071ff69fc0e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr"
Sep 15 12:58:45.282907 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:45.282881    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjlln\" (UniqueName: \"kubernetes.io/projected/eb865e51-fc60-4fde-9f62-b071ff69fc0e-kube-api-access-hjlln\") pod \"payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr\" (UID: \"eb865e51-fc60-4fde-9f62-b071ff69fc0e\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr"
Sep 15 12:58:45.399952 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:45.399927    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"]
Sep 15 12:58:45.400084 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:45.400058    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr"
Sep 15 12:58:45.402067 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:58:45.402042    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2ac296c_7702_4bf6_be76_502c62309551.slice/crio-9ea91415576ae9f090a8a0b55aff5fcc86d82ec8af8301bf22ecdd109298e9b4 WatchSource:0}: Error finding container 9ea91415576ae9f090a8a0b55aff5fcc86d82ec8af8301bf22ecdd109298e9b4: Status 404 returned error can't find the container with id 9ea91415576ae9f090a8a0b55aff5fcc86d82ec8af8301bf22ecdd109298e9b4
Sep 15 12:58:45.679231 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:45.679198    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr"]
Sep 15 12:58:46.057829 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:46.057789    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s" event={"ID":"a2ac296c-7702-4bf6-be76-502c62309551","Type":"ContainerStarted","Data":"825ad367561a6601eac30c763bf64301d63b4b5d43b1d293c2052dd7148e9cd7"}
Sep 15 12:58:46.058078 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:46.057855    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s" event={"ID":"a2ac296c-7702-4bf6-be76-502c62309551","Type":"ContainerStarted","Data":"9ea91415576ae9f090a8a0b55aff5fcc86d82ec8af8301bf22ecdd109298e9b4"}
Sep 15 12:58:46.058078 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:46.057885    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"
Sep 15 12:58:46.059561 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:46.059529    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr" event={"ID":"eb865e51-fc60-4fde-9f62-b071ff69fc0e","Type":"ContainerStarted","Data":"ee2f1447b4208fb84d3aaccd960b7b765fe18702c6c9f6ec3ffbda6e9dadb93c"}
Sep 15 12:58:46.059698 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:46.059579    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr" event={"ID":"eb865e51-fc60-4fde-9f62-b071ff69fc0e","Type":"ContainerStarted","Data":"11d2588e3609285a48e9ddc8f7e58d98e1f4b138d3e2059a45258ae9204ba53c"}
Sep 15 12:58:46.059698 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:46.059600    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr"
Sep 15 12:58:46.104992 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:46.104929    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s" podStartSLOduration=1.599361797 podStartE2EDuration="2.104913909s" totalImagesPullingTime="505.552112ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:46.104199125 +0000 UTC m=+829.825514669" watchObservedRunningTime="2026-09-15 12:58:46.104913909 +0000 UTC m=+829.826229441"
Sep 15 12:58:52.070884 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:52.070850    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s"
Sep 15 12:58:52.090601 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:52.090543    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr" podStartSLOduration=7.090526162 podStartE2EDuration="7.090526162s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:58:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:58:46.139911167 +0000 UTC m=+829.861226697" watchObservedRunningTime="2026-09-15 12:58:52.090526162 +0000 UTC m=+835.811841745"
Sep 15 12:58:57.067576 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:58:57.067541    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr"
Sep 15 12:59:02.217778 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:02.217745    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"]
Sep 15 12:59:02.218244 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:02.218046    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb" podUID="e8e2adfc-3cec-42a3-8282-bde3f9116f30" containerName="maas-api" containerID="cri-o://cb1b4839b75a521815290832b7a64071306d4f4b4a9e072bf95ad1d094fdf060" gracePeriod=30
Sep 15 12:59:02.467014 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:02.466989    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"
Sep 15 12:59:02.530924 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:02.530842    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8e2adfc-3cec-42a3-8282-bde3f9116f30-maas-api-tls\") pod \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\" (UID: \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\") "
Sep 15 12:59:02.530924 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:02.530877    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8e2adfc-3cec-42a3-8282-bde3f9116f30-metrics-certs\") pod \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\" (UID: \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\") "
Sep 15 12:59:02.531182 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:02.530933    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2vxl\" (UniqueName: \"kubernetes.io/projected/e8e2adfc-3cec-42a3-8282-bde3f9116f30-kube-api-access-s2vxl\") pod \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\" (UID: \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\") "
Sep 15 12:59:02.531182 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:02.530998    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e2adfc-3cec-42a3-8282-bde3f9116f30-openshift-service-ca\") pod \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\" (UID: \"e8e2adfc-3cec-42a3-8282-bde3f9116f30\") "
Sep 15 12:59:02.531380 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:02.531353    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e2adfc-3cec-42a3-8282-bde3f9116f30-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e8e2adfc-3cec-42a3-8282-bde3f9116f30" (UID: "e8e2adfc-3cec-42a3-8282-bde3f9116f30"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:59:02.533245 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:02.533220    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e2adfc-3cec-42a3-8282-bde3f9116f30-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e8e2adfc-3cec-42a3-8282-bde3f9116f30" (UID: "e8e2adfc-3cec-42a3-8282-bde3f9116f30"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:59:02.533349 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:02.533287    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e2adfc-3cec-42a3-8282-bde3f9116f30-kube-api-access-s2vxl" (OuterVolumeSpecName: "kube-api-access-s2vxl") pod "e8e2adfc-3cec-42a3-8282-bde3f9116f30" (UID: "e8e2adfc-3cec-42a3-8282-bde3f9116f30"). InnerVolumeSpecName "kube-api-access-s2vxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:59:02.533429 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:02.533412    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8e2adfc-3cec-42a3-8282-bde3f9116f30-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e8e2adfc-3cec-42a3-8282-bde3f9116f30" (UID: "e8e2adfc-3cec-42a3-8282-bde3f9116f30"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:59:02.632082 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:02.632043    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8e2adfc-3cec-42a3-8282-bde3f9116f30-maas-api-tls\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:59:02.632082 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:02.632076    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8e2adfc-3cec-42a3-8282-bde3f9116f30-metrics-certs\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:59:02.632082 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:02.632089    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2vxl\" (UniqueName: \"kubernetes.io/projected/e8e2adfc-3cec-42a3-8282-bde3f9116f30-kube-api-access-s2vxl\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:59:02.632352 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:02.632104    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8e2adfc-3cec-42a3-8282-bde3f9116f30-openshift-service-ca\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:59:03.152418 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:03.152381    2567 generic.go:356] "Generic (PLEG): container finished" podID="e8e2adfc-3cec-42a3-8282-bde3f9116f30" containerID="cb1b4839b75a521815290832b7a64071306d4f4b4a9e072bf95ad1d094fdf060" exitCode=0
Sep 15 12:59:03.152578 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:03.152432    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"
Sep 15 12:59:03.152578 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:03.152468    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb" event={"ID":"e8e2adfc-3cec-42a3-8282-bde3f9116f30","Type":"ContainerDied","Data":"cb1b4839b75a521815290832b7a64071306d4f4b4a9e072bf95ad1d094fdf060"}
Sep 15 12:59:03.152578 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:03.152524    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb" event={"ID":"e8e2adfc-3cec-42a3-8282-bde3f9116f30","Type":"ContainerDied","Data":"f2baeb865a59ba2d7e916bfd3a7d0f6665949eef93f7c91f94d83caffa3bfc1c"}
Sep 15 12:59:03.152578 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:03.152548    2567 scope.go:117] "RemoveContainer" containerID="cb1b4839b75a521815290832b7a64071306d4f4b4a9e072bf95ad1d094fdf060"
Sep 15 12:59:03.161777 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:03.161761    2567 scope.go:117] "RemoveContainer" containerID="cb1b4839b75a521815290832b7a64071306d4f4b4a9e072bf95ad1d094fdf060"
Sep 15 12:59:03.162060 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:59:03.162038    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb1b4839b75a521815290832b7a64071306d4f4b4a9e072bf95ad1d094fdf060\": container with ID starting with cb1b4839b75a521815290832b7a64071306d4f4b4a9e072bf95ad1d094fdf060 not found: ID does not exist" containerID="cb1b4839b75a521815290832b7a64071306d4f4b4a9e072bf95ad1d094fdf060"
Sep 15 12:59:03.162118 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:03.162068    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb1b4839b75a521815290832b7a64071306d4f4b4a9e072bf95ad1d094fdf060"} err="failed to get container status \"cb1b4839b75a521815290832b7a64071306d4f4b4a9e072bf95ad1d094fdf060\": rpc error: code = NotFound desc = could not find container \"cb1b4839b75a521815290832b7a64071306d4f4b4a9e072bf95ad1d094fdf060\": container with ID starting with cb1b4839b75a521815290832b7a64071306d4f4b4a9e072bf95ad1d094fdf060 not found: ID does not exist"
Sep 15 12:59:03.176810 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:03.176786    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"]
Sep 15 12:59:03.183743 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:03.183715    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-08701e10-586b96dbcd-m65tb"]
Sep 15 12:59:04.713814 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:04.713780    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8e2adfc-3cec-42a3-8282-bde3f9116f30" path="/var/lib/kubelet/pods/e8e2adfc-3cec-42a3-8282-bde3f9116f30/volumes"
Sep 15 12:59:08.686626 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:08.686586    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"]
Sep 15 12:59:08.687198 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:08.687178    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8e2adfc-3cec-42a3-8282-bde3f9116f30" containerName="maas-api"
Sep 15 12:59:08.687284 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:08.687200    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8e2adfc-3cec-42a3-8282-bde3f9116f30" containerName="maas-api"
Sep 15 12:59:08.687337 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:08.687289    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8e2adfc-3cec-42a3-8282-bde3f9116f30" containerName="maas-api"
Sep 15 12:59:08.691457 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:08.691435    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"
Sep 15 12:59:08.693296 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:08.693273    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-f78f068d-serving-cert\""
Sep 15 12:59:08.701192 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:08.701169    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"]
Sep 15 12:59:08.787968 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:08.787933    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-metrics-certs\") pod \"maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m\" (UID: \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"
Sep 15 12:59:08.788259 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:08.788235    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-openshift-service-ca\") pod \"maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m\" (UID: \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"
Sep 15 12:59:08.788357 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:08.788336    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82wx8\" (UniqueName: \"kubernetes.io/projected/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-kube-api-access-82wx8\") pod \"maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m\" (UID: \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"
Sep 15 12:59:08.788425 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:08.788396    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-maas-api-tls\") pod \"maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m\" (UID: \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"
Sep 15 12:59:08.889361 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:08.889327    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-openshift-service-ca\") pod \"maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m\" (UID: \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"
Sep 15 12:59:08.889528 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:08.889369    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82wx8\" (UniqueName: \"kubernetes.io/projected/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-kube-api-access-82wx8\") pod \"maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m\" (UID: \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"
Sep 15 12:59:08.889528 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:08.889394    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-maas-api-tls\") pod \"maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m\" (UID: \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"
Sep 15 12:59:08.889528 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:08.889440    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-metrics-certs\") pod \"maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m\" (UID: \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"
Sep 15 12:59:08.890108 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:08.890076    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-openshift-service-ca\") pod \"maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m\" (UID: \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"
Sep 15 12:59:08.891728 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:08.891697    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-maas-api-tls\") pod \"maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m\" (UID: \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"
Sep 15 12:59:08.891852 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:08.891831    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-metrics-certs\") pod \"maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m\" (UID: \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"
Sep 15 12:59:08.900360 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:08.900339    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82wx8\" (UniqueName: \"kubernetes.io/projected/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-kube-api-access-82wx8\") pod \"maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m\" (UID: \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"
Sep 15 12:59:09.002159 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:09.002083    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"
Sep 15 12:59:09.277366 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:09.277342    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"]
Sep 15 12:59:09.279334 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:59:09.279306    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89cb3c9e_cd6e_4ff6_9ab0_33b8d200d1f9.slice/crio-9ef57bf5046915e27eb76bbab1b1cb41671656ab8db9cb1c3f43c892dd03a6c3 WatchSource:0}: Error finding container 9ef57bf5046915e27eb76bbab1b1cb41671656ab8db9cb1c3f43c892dd03a6c3: Status 404 returned error can't find the container with id 9ef57bf5046915e27eb76bbab1b1cb41671656ab8db9cb1c3f43c892dd03a6c3
Sep 15 12:59:10.188074 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:10.188036    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m" event={"ID":"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9","Type":"ContainerStarted","Data":"5cbed88be406a2caf08b5ea5aa44e653560b4c27db9618fcd000ab888659a22b"}
Sep 15 12:59:10.188464 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:10.188095    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m" event={"ID":"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9","Type":"ContainerStarted","Data":"9ef57bf5046915e27eb76bbab1b1cb41671656ab8db9cb1c3f43c892dd03a6c3"}
Sep 15 12:59:10.188464 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:10.188198    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"
Sep 15 12:59:10.209382 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:10.209334    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m" podStartSLOduration=1.850014597 podStartE2EDuration="2.209319126s" totalImagesPullingTime="359.304529ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:59:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:59:10.207298239 +0000 UTC m=+853.928613769" watchObservedRunningTime="2026-09-15 12:59:10.209319126 +0000 UTC m=+853.930634714"
Sep 15 12:59:16.197942 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:16.197909    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"
Sep 15 12:59:38.363223 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:38.363189    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"]
Sep 15 12:59:38.363690 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:38.363447    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m" podUID="89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9" containerName="maas-api" containerID="cri-o://5cbed88be406a2caf08b5ea5aa44e653560b4c27db9618fcd000ab888659a22b" gracePeriod=30
Sep 15 12:59:38.623250 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:38.623195    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"
Sep 15 12:59:38.657685 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:38.657656    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82wx8\" (UniqueName: \"kubernetes.io/projected/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-kube-api-access-82wx8\") pod \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\" (UID: \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\") "
Sep 15 12:59:38.657834 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:38.657697    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-openshift-service-ca\") pod \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\" (UID: \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\") "
Sep 15 12:59:38.657834 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:38.657820    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-maas-api-tls\") pod \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\" (UID: \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\") "
Sep 15 12:59:38.657952 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:38.657892    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-metrics-certs\") pod \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\" (UID: \"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9\") "
Sep 15 12:59:38.658155 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:38.658125    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9" (UID: "89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 12:59:38.658323 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:38.658245    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-openshift-service-ca\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:59:38.659898 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:38.659876    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9" (UID: "89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:59:38.660003 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:38.659935    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9" (UID: "89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 12:59:38.660003 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:38.659991    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-kube-api-access-82wx8" (OuterVolumeSpecName: "kube-api-access-82wx8") pod "89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9" (UID: "89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9"). InnerVolumeSpecName "kube-api-access-82wx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 12:59:38.759632 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:38.759598    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-maas-api-tls\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:59:38.759632 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:38.759631    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-metrics-certs\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:59:38.759869 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:38.759645    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82wx8\" (UniqueName: \"kubernetes.io/projected/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9-kube-api-access-82wx8\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 12:59:39.325195 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:39.325113    2567 generic.go:356] "Generic (PLEG): container finished" podID="89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9" containerID="5cbed88be406a2caf08b5ea5aa44e653560b4c27db9618fcd000ab888659a22b" exitCode=0
Sep 15 12:59:39.325195 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:39.325158    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"
Sep 15 12:59:39.325195 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:39.325174    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m" event={"ID":"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9","Type":"ContainerDied","Data":"5cbed88be406a2caf08b5ea5aa44e653560b4c27db9618fcd000ab888659a22b"}
Sep 15 12:59:39.325420 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:39.325216    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m" event={"ID":"89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9","Type":"ContainerDied","Data":"9ef57bf5046915e27eb76bbab1b1cb41671656ab8db9cb1c3f43c892dd03a6c3"}
Sep 15 12:59:39.325420 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:39.325237    2567 scope.go:117] "RemoveContainer" containerID="5cbed88be406a2caf08b5ea5aa44e653560b4c27db9618fcd000ab888659a22b"
Sep 15 12:59:39.334267 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:39.334250    2567 scope.go:117] "RemoveContainer" containerID="5cbed88be406a2caf08b5ea5aa44e653560b4c27db9618fcd000ab888659a22b"
Sep 15 12:59:39.334572 ip-10-0-129-48 kubenswrapper[2567]: E0915 12:59:39.334552    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cbed88be406a2caf08b5ea5aa44e653560b4c27db9618fcd000ab888659a22b\": container with ID starting with 5cbed88be406a2caf08b5ea5aa44e653560b4c27db9618fcd000ab888659a22b not found: ID does not exist" containerID="5cbed88be406a2caf08b5ea5aa44e653560b4c27db9618fcd000ab888659a22b"
Sep 15 12:59:39.334610 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:39.334582    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cbed88be406a2caf08b5ea5aa44e653560b4c27db9618fcd000ab888659a22b"} err="failed to get container status \"5cbed88be406a2caf08b5ea5aa44e653560b4c27db9618fcd000ab888659a22b\": rpc error: code = NotFound desc = could not find container \"5cbed88be406a2caf08b5ea5aa44e653560b4c27db9618fcd000ab888659a22b\": container with ID starting with 5cbed88be406a2caf08b5ea5aa44e653560b4c27db9618fcd000ab888659a22b not found: ID does not exist"
Sep 15 12:59:39.342656 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:39.342632    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"]
Sep 15 12:59:39.347743 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:39.347718    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f78f068d-6fd979ff9d-9rv6m"]
Sep 15 12:59:40.713068 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:40.713027    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9" path="/var/lib/kubelet/pods/89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9/volumes"
Sep 15 12:59:44.490733 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.490694    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"]
Sep 15 12:59:44.491452 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.491415    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9" containerName="maas-api"
Sep 15 12:59:44.491452 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.491441    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9" containerName="maas-api"
Sep 15 12:59:44.491638 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.491549    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="89cb3c9e-cd6e-4ff6-9ab0-33b8d200d1f9" containerName="maas-api"
Sep 15 12:59:44.496303 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.496283    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"
Sep 15 12:59:44.498390 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.498365    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-dc842c6b-serving-cert\""
Sep 15 12:59:44.506390 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.506360    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"]
Sep 15 12:59:44.616384 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.616343    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2d4b1db-f253-4890-896d-938bf0225eeb-maas-api-tls\") pod \"maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9\" (UID: \"d2d4b1db-f253-4890-896d-938bf0225eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"
Sep 15 12:59:44.616564 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.616502    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d4b1db-f253-4890-896d-938bf0225eeb-openshift-service-ca\") pod \"maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9\" (UID: \"d2d4b1db-f253-4890-896d-938bf0225eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"
Sep 15 12:59:44.616632 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.616558    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2d4b1db-f253-4890-896d-938bf0225eeb-metrics-certs\") pod \"maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9\" (UID: \"d2d4b1db-f253-4890-896d-938bf0225eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"
Sep 15 12:59:44.616632 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.616592    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29hw4\" (UniqueName: \"kubernetes.io/projected/d2d4b1db-f253-4890-896d-938bf0225eeb-kube-api-access-29hw4\") pod \"maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9\" (UID: \"d2d4b1db-f253-4890-896d-938bf0225eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"
Sep 15 12:59:44.717237 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.717202    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d4b1db-f253-4890-896d-938bf0225eeb-openshift-service-ca\") pod \"maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9\" (UID: \"d2d4b1db-f253-4890-896d-938bf0225eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"
Sep 15 12:59:44.717237 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.717242    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2d4b1db-f253-4890-896d-938bf0225eeb-metrics-certs\") pod \"maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9\" (UID: \"d2d4b1db-f253-4890-896d-938bf0225eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"
Sep 15 12:59:44.717497 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.717259    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29hw4\" (UniqueName: \"kubernetes.io/projected/d2d4b1db-f253-4890-896d-938bf0225eeb-kube-api-access-29hw4\") pod \"maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9\" (UID: \"d2d4b1db-f253-4890-896d-938bf0225eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"
Sep 15 12:59:44.717497 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.717324    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2d4b1db-f253-4890-896d-938bf0225eeb-maas-api-tls\") pod \"maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9\" (UID: \"d2d4b1db-f253-4890-896d-938bf0225eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"
Sep 15 12:59:44.717929 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.717905    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d4b1db-f253-4890-896d-938bf0225eeb-openshift-service-ca\") pod \"maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9\" (UID: \"d2d4b1db-f253-4890-896d-938bf0225eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"
Sep 15 12:59:44.719811 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.719793    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2d4b1db-f253-4890-896d-938bf0225eeb-maas-api-tls\") pod \"maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9\" (UID: \"d2d4b1db-f253-4890-896d-938bf0225eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"
Sep 15 12:59:44.719865 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.719825    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2d4b1db-f253-4890-896d-938bf0225eeb-metrics-certs\") pod \"maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9\" (UID: \"d2d4b1db-f253-4890-896d-938bf0225eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"
Sep 15 12:59:44.726533 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.726514    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29hw4\" (UniqueName: \"kubernetes.io/projected/d2d4b1db-f253-4890-896d-938bf0225eeb-kube-api-access-29hw4\") pod \"maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9\" (UID: \"d2d4b1db-f253-4890-896d-938bf0225eeb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"
Sep 15 12:59:44.828706 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:44.828631    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"
Sep 15 12:59:45.105318 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:45.105290    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"]
Sep 15 12:59:45.107187 ip-10-0-129-48 kubenswrapper[2567]: W0915 12:59:45.107163    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d4b1db_f253_4890_896d_938bf0225eeb.slice/crio-e4fbc3d7bb61bf0b645ee3db11a77769a7a38dc27c4a30c3dce46c1db93025a1 WatchSource:0}: Error finding container e4fbc3d7bb61bf0b645ee3db11a77769a7a38dc27c4a30c3dce46c1db93025a1: Status 404 returned error can't find the container with id e4fbc3d7bb61bf0b645ee3db11a77769a7a38dc27c4a30c3dce46c1db93025a1
Sep 15 12:59:45.357524 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:45.357442    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9" event={"ID":"d2d4b1db-f253-4890-896d-938bf0225eeb","Type":"ContainerStarted","Data":"e4fbc3d7bb61bf0b645ee3db11a77769a7a38dc27c4a30c3dce46c1db93025a1"}
Sep 15 12:59:46.363800 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:46.363760    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9" event={"ID":"d2d4b1db-f253-4890-896d-938bf0225eeb","Type":"ContainerStarted","Data":"58aea1bdb976923c13f6a42d84256f833fb5cee595116525814bb4a41e2bb17e"}
Sep 15 12:59:46.364267 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:46.363885    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"
Sep 15 12:59:46.381352 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:46.381307    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9" podStartSLOduration=2.03594464 podStartE2EDuration="2.381292548s" totalImagesPullingTime="345.347908ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 12:59:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 12:59:46.379745186 +0000 UTC m=+890.101060718" watchObservedRunningTime="2026-09-15 12:59:46.381292548 +0000 UTC m=+890.102608124"
Sep 15 12:59:52.374201 ip-10-0-129-48 kubenswrapper[2567]: I0915 12:59:52.374131    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"
Sep 15 13:00:14.161396 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.161353    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"]
Sep 15 13:00:14.161957 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.161614    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9" podUID="d2d4b1db-f253-4890-896d-938bf0225eeb" containerName="maas-api" containerID="cri-o://58aea1bdb976923c13f6a42d84256f833fb5cee595116525814bb4a41e2bb17e" gracePeriod=30
Sep 15 13:00:14.414176 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.414118    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"
Sep 15 13:00:14.491968 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.491930    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d4b1db-f253-4890-896d-938bf0225eeb-openshift-service-ca\") pod \"d2d4b1db-f253-4890-896d-938bf0225eeb\" (UID: \"d2d4b1db-f253-4890-896d-938bf0225eeb\") "
Sep 15 13:00:14.492158 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.492047    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29hw4\" (UniqueName: \"kubernetes.io/projected/d2d4b1db-f253-4890-896d-938bf0225eeb-kube-api-access-29hw4\") pod \"d2d4b1db-f253-4890-896d-938bf0225eeb\" (UID: \"d2d4b1db-f253-4890-896d-938bf0225eeb\") "
Sep 15 13:00:14.492158 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.492092    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2d4b1db-f253-4890-896d-938bf0225eeb-maas-api-tls\") pod \"d2d4b1db-f253-4890-896d-938bf0225eeb\" (UID: \"d2d4b1db-f253-4890-896d-938bf0225eeb\") "
Sep 15 13:00:14.492158 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.492113    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2d4b1db-f253-4890-896d-938bf0225eeb-metrics-certs\") pod \"d2d4b1db-f253-4890-896d-938bf0225eeb\" (UID: \"d2d4b1db-f253-4890-896d-938bf0225eeb\") "
Sep 15 13:00:14.492334 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.492282    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2d4b1db-f253-4890-896d-938bf0225eeb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d2d4b1db-f253-4890-896d-938bf0225eeb" (UID: "d2d4b1db-f253-4890-896d-938bf0225eeb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:00:14.492420 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.492402    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2d4b1db-f253-4890-896d-938bf0225eeb-openshift-service-ca\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:00:14.494148 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.494115    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2d4b1db-f253-4890-896d-938bf0225eeb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d2d4b1db-f253-4890-896d-938bf0225eeb" (UID: "d2d4b1db-f253-4890-896d-938bf0225eeb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:00:14.494257 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.494188    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2d4b1db-f253-4890-896d-938bf0225eeb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d2d4b1db-f253-4890-896d-938bf0225eeb" (UID: "d2d4b1db-f253-4890-896d-938bf0225eeb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:00:14.494257 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.494206    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2d4b1db-f253-4890-896d-938bf0225eeb-kube-api-access-29hw4" (OuterVolumeSpecName: "kube-api-access-29hw4") pod "d2d4b1db-f253-4890-896d-938bf0225eeb" (UID: "d2d4b1db-f253-4890-896d-938bf0225eeb"). InnerVolumeSpecName "kube-api-access-29hw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:00:14.499548 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.499525    2567 generic.go:356] "Generic (PLEG): container finished" podID="d2d4b1db-f253-4890-896d-938bf0225eeb" containerID="58aea1bdb976923c13f6a42d84256f833fb5cee595116525814bb4a41e2bb17e" exitCode=0
Sep 15 13:00:14.499662 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.499580    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"
Sep 15 13:00:14.499662 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.499613    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9" event={"ID":"d2d4b1db-f253-4890-896d-938bf0225eeb","Type":"ContainerDied","Data":"58aea1bdb976923c13f6a42d84256f833fb5cee595116525814bb4a41e2bb17e"}
Sep 15 13:00:14.499787 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.499691    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9" event={"ID":"d2d4b1db-f253-4890-896d-938bf0225eeb","Type":"ContainerDied","Data":"e4fbc3d7bb61bf0b645ee3db11a77769a7a38dc27c4a30c3dce46c1db93025a1"}
Sep 15 13:00:14.499787 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.499727    2567 scope.go:117] "RemoveContainer" containerID="58aea1bdb976923c13f6a42d84256f833fb5cee595116525814bb4a41e2bb17e"
Sep 15 13:00:14.517468 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.517450    2567 scope.go:117] "RemoveContainer" containerID="58aea1bdb976923c13f6a42d84256f833fb5cee595116525814bb4a41e2bb17e"
Sep 15 13:00:14.517755 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:00:14.517736    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58aea1bdb976923c13f6a42d84256f833fb5cee595116525814bb4a41e2bb17e\": container with ID starting with 58aea1bdb976923c13f6a42d84256f833fb5cee595116525814bb4a41e2bb17e not found: ID does not exist" containerID="58aea1bdb976923c13f6a42d84256f833fb5cee595116525814bb4a41e2bb17e"
Sep 15 13:00:14.517824 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.517764    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58aea1bdb976923c13f6a42d84256f833fb5cee595116525814bb4a41e2bb17e"} err="failed to get container status \"58aea1bdb976923c13f6a42d84256f833fb5cee595116525814bb4a41e2bb17e\": rpc error: code = NotFound desc = could not find container \"58aea1bdb976923c13f6a42d84256f833fb5cee595116525814bb4a41e2bb17e\": container with ID starting with 58aea1bdb976923c13f6a42d84256f833fb5cee595116525814bb4a41e2bb17e not found: ID does not exist"
Sep 15 13:00:14.530773 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.530752    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"]
Sep 15 13:00:14.538124 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.538104    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc842c6b-5d44d5fb84-vdvj9"]
Sep 15 13:00:14.593186 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.593162    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29hw4\" (UniqueName: \"kubernetes.io/projected/d2d4b1db-f253-4890-896d-938bf0225eeb-kube-api-access-29hw4\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:00:14.593186 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.593184    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2d4b1db-f253-4890-896d-938bf0225eeb-maas-api-tls\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:00:14.593186 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.593194    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2d4b1db-f253-4890-896d-938bf0225eeb-metrics-certs\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:00:14.713424 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:14.713322    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2d4b1db-f253-4890-896d-938bf0225eeb" path="/var/lib/kubelet/pods/d2d4b1db-f253-4890-896d-938bf0225eeb/volumes"
Sep 15 13:00:16.425804 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.425764    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"]
Sep 15 13:00:16.426208 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.426193    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2d4b1db-f253-4890-896d-938bf0225eeb" containerName="maas-api"
Sep 15 13:00:16.426208 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.426209    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2d4b1db-f253-4890-896d-938bf0225eeb" containerName="maas-api"
Sep 15 13:00:16.426287 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.426275    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2d4b1db-f253-4890-896d-938bf0225eeb" containerName="maas-api"
Sep 15 13:00:16.430624 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.430604    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:16.434384 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.434360    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-59f4a3\"/\"kube-root-ca.crt\""
Sep 15 13:00:16.434514 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.434488    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-59f4a3\"/\"autores-model-59f4a3-kserve-self-signed-certs\""
Sep 15 13:00:16.434582 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.434566    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-59f4a3\"/\"default-dockercfg-dsw6h\""
Sep 15 13:00:16.434642 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.434488    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-59f4a3\"/\"openshift-service-ca.crt\""
Sep 15 13:00:16.445880 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.445849    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"]
Sep 15 13:00:16.510091 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.510052    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzvdt\" (UniqueName: \"kubernetes.io/projected/81b18fc5-10a8-4b95-b710-58fdaaae7e65-kube-api-access-hzvdt\") pod \"autores-model-59f4a3-kserve-569dbc7547-qxwk2\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") " pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:16.510243 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.510141    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81b18fc5-10a8-4b95-b710-58fdaaae7e65-tls-certs\") pod \"autores-model-59f4a3-kserve-569dbc7547-qxwk2\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") " pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:16.510243 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.510190    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-model-cache\") pod \"autores-model-59f4a3-kserve-569dbc7547-qxwk2\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") " pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:16.510376 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.510265    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-tmp-dir\") pod \"autores-model-59f4a3-kserve-569dbc7547-qxwk2\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") " pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:16.510376 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.510318    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-home\") pod \"autores-model-59f4a3-kserve-569dbc7547-qxwk2\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") " pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:16.510442 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.510372    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-dshm\") pod \"autores-model-59f4a3-kserve-569dbc7547-qxwk2\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") " pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:16.611171 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.611139    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-dshm\") pod \"autores-model-59f4a3-kserve-569dbc7547-qxwk2\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") " pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:16.611362 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.611232    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzvdt\" (UniqueName: \"kubernetes.io/projected/81b18fc5-10a8-4b95-b710-58fdaaae7e65-kube-api-access-hzvdt\") pod \"autores-model-59f4a3-kserve-569dbc7547-qxwk2\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") " pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:16.611362 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.611285    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81b18fc5-10a8-4b95-b710-58fdaaae7e65-tls-certs\") pod \"autores-model-59f4a3-kserve-569dbc7547-qxwk2\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") " pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:16.611362 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.611330    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-model-cache\") pod \"autores-model-59f4a3-kserve-569dbc7547-qxwk2\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") " pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:16.611527 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.611370    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-tmp-dir\") pod \"autores-model-59f4a3-kserve-569dbc7547-qxwk2\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") " pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:16.611527 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.611505    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-home\") pod \"autores-model-59f4a3-kserve-569dbc7547-qxwk2\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") " pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:16.611749 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.611723    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-tmp-dir\") pod \"autores-model-59f4a3-kserve-569dbc7547-qxwk2\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") " pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:16.611869 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.611751    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-model-cache\") pod \"autores-model-59f4a3-kserve-569dbc7547-qxwk2\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") " pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:16.611869 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.611819    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-home\") pod \"autores-model-59f4a3-kserve-569dbc7547-qxwk2\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") " pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:16.613404 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.613374    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-dshm\") pod \"autores-model-59f4a3-kserve-569dbc7547-qxwk2\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") " pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:16.613725 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.613707    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81b18fc5-10a8-4b95-b710-58fdaaae7e65-tls-certs\") pod \"autores-model-59f4a3-kserve-569dbc7547-qxwk2\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") " pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:16.619360 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.619337    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzvdt\" (UniqueName: \"kubernetes.io/projected/81b18fc5-10a8-4b95-b710-58fdaaae7e65-kube-api-access-hzvdt\") pod \"autores-model-59f4a3-kserve-569dbc7547-qxwk2\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") " pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:16.740327 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:16.740252    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:17.017473 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:17.017440    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"]
Sep 15 13:00:17.018103 ip-10-0-129-48 kubenswrapper[2567]: W0915 13:00:17.018068    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81b18fc5_10a8_4b95_b710_58fdaaae7e65.slice/crio-6d74817e9f2025e65105e7cd2a6131ae004e86944935b42cdb4576e847ff52e5 WatchSource:0}: Error finding container 6d74817e9f2025e65105e7cd2a6131ae004e86944935b42cdb4576e847ff52e5: Status 404 returned error can't find the container with id 6d74817e9f2025e65105e7cd2a6131ae004e86944935b42cdb4576e847ff52e5
Sep 15 13:00:17.519934 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:17.519899    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2" event={"ID":"81b18fc5-10a8-4b95-b710-58fdaaae7e65","Type":"ContainerStarted","Data":"e4c7a61e2dbd66629a8a3a96bd2e4d112947889eb3bcde6aea99df1eda086fc6"}
Sep 15 13:00:17.519934 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:17.519943    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2" event={"ID":"81b18fc5-10a8-4b95-b710-58fdaaae7e65","Type":"ContainerStarted","Data":"6d74817e9f2025e65105e7cd2a6131ae004e86944935b42cdb4576e847ff52e5"}
Sep 15 13:00:17.540196 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:17.540138    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2" podStartSLOduration=1.540116375 podStartE2EDuration="1.540116375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:00:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:00:17.539089143 +0000 UTC m=+921.260404678" watchObservedRunningTime="2026-09-15 13:00:17.540116375 +0000 UTC m=+921.261431906"
Sep 15 13:00:20.833581 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:20.833550    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"]
Sep 15 13:00:20.837227 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:20.837205    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"
Sep 15 13:00:20.839652 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:20.839627    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-179a5f99-serving-cert\""
Sep 15 13:00:20.849843 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:20.849809    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"]
Sep 15 13:00:20.948728 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:20.948687    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89z8q\" (UniqueName: \"kubernetes.io/projected/8df1293b-7606-4f28-8764-df3375534f7d-kube-api-access-89z8q\") pod \"maas-api-e2e-derive-179a5f99-65959c6b96-5gg78\" (UID: \"8df1293b-7606-4f28-8764-df3375534f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"
Sep 15 13:00:20.948908 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:20.948748    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df1293b-7606-4f28-8764-df3375534f7d-openshift-service-ca\") pod \"maas-api-e2e-derive-179a5f99-65959c6b96-5gg78\" (UID: \"8df1293b-7606-4f28-8764-df3375534f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"
Sep 15 13:00:20.948908 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:20.948799    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df1293b-7606-4f28-8764-df3375534f7d-metrics-certs\") pod \"maas-api-e2e-derive-179a5f99-65959c6b96-5gg78\" (UID: \"8df1293b-7606-4f28-8764-df3375534f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"
Sep 15 13:00:20.948908 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:20.948823    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df1293b-7606-4f28-8764-df3375534f7d-maas-api-tls\") pod \"maas-api-e2e-derive-179a5f99-65959c6b96-5gg78\" (UID: \"8df1293b-7606-4f28-8764-df3375534f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"
Sep 15 13:00:21.049568 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.049532    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df1293b-7606-4f28-8764-df3375534f7d-metrics-certs\") pod \"maas-api-e2e-derive-179a5f99-65959c6b96-5gg78\" (UID: \"8df1293b-7606-4f28-8764-df3375534f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"
Sep 15 13:00:21.049568 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.049566    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df1293b-7606-4f28-8764-df3375534f7d-maas-api-tls\") pod \"maas-api-e2e-derive-179a5f99-65959c6b96-5gg78\" (UID: \"8df1293b-7606-4f28-8764-df3375534f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"
Sep 15 13:00:21.049781 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.049626    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89z8q\" (UniqueName: \"kubernetes.io/projected/8df1293b-7606-4f28-8764-df3375534f7d-kube-api-access-89z8q\") pod \"maas-api-e2e-derive-179a5f99-65959c6b96-5gg78\" (UID: \"8df1293b-7606-4f28-8764-df3375534f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"
Sep 15 13:00:21.049781 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.049656    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df1293b-7606-4f28-8764-df3375534f7d-openshift-service-ca\") pod \"maas-api-e2e-derive-179a5f99-65959c6b96-5gg78\" (UID: \"8df1293b-7606-4f28-8764-df3375534f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"
Sep 15 13:00:21.050313 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.050281    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df1293b-7606-4f28-8764-df3375534f7d-openshift-service-ca\") pod \"maas-api-e2e-derive-179a5f99-65959c6b96-5gg78\" (UID: \"8df1293b-7606-4f28-8764-df3375534f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"
Sep 15 13:00:21.052011 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.051991    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df1293b-7606-4f28-8764-df3375534f7d-metrics-certs\") pod \"maas-api-e2e-derive-179a5f99-65959c6b96-5gg78\" (UID: \"8df1293b-7606-4f28-8764-df3375534f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"
Sep 15 13:00:21.052088 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.052041    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df1293b-7606-4f28-8764-df3375534f7d-maas-api-tls\") pod \"maas-api-e2e-derive-179a5f99-65959c6b96-5gg78\" (UID: \"8df1293b-7606-4f28-8764-df3375534f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"
Sep 15 13:00:21.061878 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.061852    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89z8q\" (UniqueName: \"kubernetes.io/projected/8df1293b-7606-4f28-8764-df3375534f7d-kube-api-access-89z8q\") pod \"maas-api-e2e-derive-179a5f99-65959c6b96-5gg78\" (UID: \"8df1293b-7606-4f28-8764-df3375534f7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"
Sep 15 13:00:21.147411 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.147337    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"
Sep 15 13:00:21.428618 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.428586    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"]
Sep 15 13:00:21.432714 ip-10-0-129-48 kubenswrapper[2567]: W0915 13:00:21.432648    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8df1293b_7606_4f28_8764_df3375534f7d.slice/crio-36442619577d8106f94499b065a7907a9ce9317eb90f346bb40022c0c5803260 WatchSource:0}: Error finding container 36442619577d8106f94499b065a7907a9ce9317eb90f346bb40022c0c5803260: Status 404 returned error can't find the container with id 36442619577d8106f94499b065a7907a9ce9317eb90f346bb40022c0c5803260
Sep 15 13:00:21.542037 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.542004    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78" event={"ID":"8df1293b-7606-4f28-8764-df3375534f7d","Type":"ContainerStarted","Data":"36442619577d8106f94499b065a7907a9ce9317eb90f346bb40022c0c5803260"}
Sep 15 13:00:21.667347 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.667310    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx"]
Sep 15 13:00:21.672014 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.671966    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx"
Sep 15 13:00:21.674361 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.674332    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-179a5f99\""
Sep 15 13:00:21.674552 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.674537    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-179a5f99-dockercfg-ptvr8\""
Sep 15 13:00:21.683809 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.683784    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx"]
Sep 15 13:00:21.755353 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.755314    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpt79\" (UniqueName: \"kubernetes.io/projected/180e8696-d5d9-4529-b6d1-7c4a4d69e231-kube-api-access-bpt79\") pod \"payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx\" (UID: \"180e8696-d5d9-4529-b6d1-7c4a4d69e231\") " pod="openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx"
Sep 15 13:00:21.755508 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.755486    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/180e8696-d5d9-4529-b6d1-7c4a4d69e231-plugins-config-volume\") pod \"payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx\" (UID: \"180e8696-d5d9-4529-b6d1-7c4a4d69e231\") " pod="openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx"
Sep 15 13:00:21.856138 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.856103    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/180e8696-d5d9-4529-b6d1-7c4a4d69e231-plugins-config-volume\") pod \"payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx\" (UID: \"180e8696-d5d9-4529-b6d1-7c4a4d69e231\") " pod="openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx"
Sep 15 13:00:21.856503 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.856166    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpt79\" (UniqueName: \"kubernetes.io/projected/180e8696-d5d9-4529-b6d1-7c4a4d69e231-kube-api-access-bpt79\") pod \"payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx\" (UID: \"180e8696-d5d9-4529-b6d1-7c4a4d69e231\") " pod="openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx"
Sep 15 13:00:21.856778 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.856759    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/180e8696-d5d9-4529-b6d1-7c4a4d69e231-plugins-config-volume\") pod \"payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx\" (UID: \"180e8696-d5d9-4529-b6d1-7c4a4d69e231\") " pod="openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx"
Sep 15 13:00:21.869165 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.869138    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpt79\" (UniqueName: \"kubernetes.io/projected/180e8696-d5d9-4529-b6d1-7c4a4d69e231-kube-api-access-bpt79\") pod \"payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx\" (UID: \"180e8696-d5d9-4529-b6d1-7c4a4d69e231\") " pod="openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx"
Sep 15 13:00:21.984998 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:21.984888    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx"
Sep 15 13:00:22.256452 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:22.256430    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx"]
Sep 15 13:00:22.258395 ip-10-0-129-48 kubenswrapper[2567]: W0915 13:00:22.258358    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod180e8696_d5d9_4529_b6d1_7c4a4d69e231.slice/crio-39e79d3b4b98cffeb937e489417fd4c97ee1c82e965a60a56a051b3d862cdefb WatchSource:0}: Error finding container 39e79d3b4b98cffeb937e489417fd4c97ee1c82e965a60a56a051b3d862cdefb: Status 404 returned error can't find the container with id 39e79d3b4b98cffeb937e489417fd4c97ee1c82e965a60a56a051b3d862cdefb
Sep 15 13:00:22.549589 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:22.549506    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx" event={"ID":"180e8696-d5d9-4529-b6d1-7c4a4d69e231","Type":"ContainerStarted","Data":"4daa60bb8e390225c93033407dfb169d6d8eae9152c737ed4771688326a78195"}
Sep 15 13:00:22.549589 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:22.549563    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx" event={"ID":"180e8696-d5d9-4529-b6d1-7c4a4d69e231","Type":"ContainerStarted","Data":"39e79d3b4b98cffeb937e489417fd4c97ee1c82e965a60a56a051b3d862cdefb"}
Sep 15 13:00:22.549798 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:22.549611    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx"
Sep 15 13:00:22.569198 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:22.569141    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx" podStartSLOduration=1.569120633 podStartE2EDuration="1.569120633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:00:22.567236296 +0000 UTC m=+926.288551828" watchObservedRunningTime="2026-09-15 13:00:22.569120633 +0000 UTC m=+926.290436165"
Sep 15 13:00:24.562175 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:24.562137    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78" event={"ID":"8df1293b-7606-4f28-8764-df3375534f7d","Type":"ContainerStarted","Data":"844c836c4b1cdeeaf10d5e837c6ed6f07a3815a42157edb41f3c4c4fdd7faac1"}
Sep 15 13:00:24.562536 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:24.562243    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"
Sep 15 13:00:24.579218 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:24.579165    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78" podStartSLOduration=2.315569461 podStartE2EDuration="4.57914839s" totalImagesPullingTime="2.263578929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:00:24.578332217 +0000 UTC m=+928.299647739" watchObservedRunningTime="2026-09-15 13:00:24.57914839 +0000 UTC m=+928.300463922"
Sep 15 13:00:26.741284 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:26.741254    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:26.741284 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:26.741293    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:26.754302 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:26.754277    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:27.588227 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:27.588198    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:00:30.572419 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:30.572385    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"
Sep 15 13:00:33.556644 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:33.556611    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx"
Sep 15 13:00:53.705217 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:53.705183    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"]
Sep 15 13:00:53.707835 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:53.705485    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78" podUID="8df1293b-7606-4f28-8764-df3375534f7d" containerName="maas-api" containerID="cri-o://844c836c4b1cdeeaf10d5e837c6ed6f07a3815a42157edb41f3c4c4fdd7faac1" gracePeriod=30
Sep 15 13:00:53.760775 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:53.760741    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx"]
Sep 15 13:00:53.761079 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:53.761016    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx" podUID="180e8696-d5d9-4529-b6d1-7c4a4d69e231" containerName="payload-processing" containerID="cri-o://4daa60bb8e390225c93033407dfb169d6d8eae9152c737ed4771688326a78195" gracePeriod=30
Sep 15 13:00:54.011442 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.011420    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"
Sep 15 13:00:54.040167 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.040139    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx"
Sep 15 13:00:54.059340 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.059311    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df1293b-7606-4f28-8764-df3375534f7d-openshift-service-ca\") pod \"8df1293b-7606-4f28-8764-df3375534f7d\" (UID: \"8df1293b-7606-4f28-8764-df3375534f7d\") "
Sep 15 13:00:54.059528 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.059349    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/180e8696-d5d9-4529-b6d1-7c4a4d69e231-plugins-config-volume\") pod \"180e8696-d5d9-4529-b6d1-7c4a4d69e231\" (UID: \"180e8696-d5d9-4529-b6d1-7c4a4d69e231\") "
Sep 15 13:00:54.059528 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.059379    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df1293b-7606-4f28-8764-df3375534f7d-metrics-certs\") pod \"8df1293b-7606-4f28-8764-df3375534f7d\" (UID: \"8df1293b-7606-4f28-8764-df3375534f7d\") "
Sep 15 13:00:54.059528 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.059436    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89z8q\" (UniqueName: \"kubernetes.io/projected/8df1293b-7606-4f28-8764-df3375534f7d-kube-api-access-89z8q\") pod \"8df1293b-7606-4f28-8764-df3375534f7d\" (UID: \"8df1293b-7606-4f28-8764-df3375534f7d\") "
Sep 15 13:00:54.059528 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.059465    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df1293b-7606-4f28-8764-df3375534f7d-maas-api-tls\") pod \"8df1293b-7606-4f28-8764-df3375534f7d\" (UID: \"8df1293b-7606-4f28-8764-df3375534f7d\") "
Sep 15 13:00:54.059528 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.059521    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpt79\" (UniqueName: \"kubernetes.io/projected/180e8696-d5d9-4529-b6d1-7c4a4d69e231-kube-api-access-bpt79\") pod \"180e8696-d5d9-4529-b6d1-7c4a4d69e231\" (UID: \"180e8696-d5d9-4529-b6d1-7c4a4d69e231\") "
Sep 15 13:00:54.059775 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.059745    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/180e8696-d5d9-4529-b6d1-7c4a4d69e231-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "180e8696-d5d9-4529-b6d1-7c4a4d69e231" (UID: "180e8696-d5d9-4529-b6d1-7c4a4d69e231"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:00:54.059869 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.059847    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/180e8696-d5d9-4529-b6d1-7c4a4d69e231-plugins-config-volume\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:00:54.059968 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.059937    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8df1293b-7606-4f28-8764-df3375534f7d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8df1293b-7606-4f28-8764-df3375534f7d" (UID: "8df1293b-7606-4f28-8764-df3375534f7d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:00:54.062347 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.062321    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8df1293b-7606-4f28-8764-df3375534f7d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8df1293b-7606-4f28-8764-df3375534f7d" (UID: "8df1293b-7606-4f28-8764-df3375534f7d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:00:54.062347 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.062338    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8df1293b-7606-4f28-8764-df3375534f7d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8df1293b-7606-4f28-8764-df3375534f7d" (UID: "8df1293b-7606-4f28-8764-df3375534f7d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:00:54.062509 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.062375    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/180e8696-d5d9-4529-b6d1-7c4a4d69e231-kube-api-access-bpt79" (OuterVolumeSpecName: "kube-api-access-bpt79") pod "180e8696-d5d9-4529-b6d1-7c4a4d69e231" (UID: "180e8696-d5d9-4529-b6d1-7c4a4d69e231"). InnerVolumeSpecName "kube-api-access-bpt79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:00:54.062509 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.062406    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8df1293b-7606-4f28-8764-df3375534f7d-kube-api-access-89z8q" (OuterVolumeSpecName: "kube-api-access-89z8q") pod "8df1293b-7606-4f28-8764-df3375534f7d" (UID: "8df1293b-7606-4f28-8764-df3375534f7d"). InnerVolumeSpecName "kube-api-access-89z8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:00:54.161316 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.161281    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpt79\" (UniqueName: \"kubernetes.io/projected/180e8696-d5d9-4529-b6d1-7c4a4d69e231-kube-api-access-bpt79\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:00:54.161316 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.161308    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8df1293b-7606-4f28-8764-df3375534f7d-openshift-service-ca\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:00:54.161316 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.161318    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8df1293b-7606-4f28-8764-df3375534f7d-metrics-certs\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:00:54.161548 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.161327    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89z8q\" (UniqueName: \"kubernetes.io/projected/8df1293b-7606-4f28-8764-df3375534f7d-kube-api-access-89z8q\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:00:54.161548 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.161337    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8df1293b-7606-4f28-8764-df3375534f7d-maas-api-tls\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:00:54.714499 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.714469    2567 generic.go:356] "Generic (PLEG): container finished" podID="8df1293b-7606-4f28-8764-df3375534f7d" containerID="844c836c4b1cdeeaf10d5e837c6ed6f07a3815a42157edb41f3c4c4fdd7faac1" exitCode=0
Sep 15 13:00:54.714911 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.714585    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"
Sep 15 13:00:54.714911 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.714821    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78" event={"ID":"8df1293b-7606-4f28-8764-df3375534f7d","Type":"ContainerDied","Data":"844c836c4b1cdeeaf10d5e837c6ed6f07a3815a42157edb41f3c4c4fdd7faac1"}
Sep 15 13:00:54.714911 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.714870    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78" event={"ID":"8df1293b-7606-4f28-8764-df3375534f7d","Type":"ContainerDied","Data":"36442619577d8106f94499b065a7907a9ce9317eb90f346bb40022c0c5803260"}
Sep 15 13:00:54.714911 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.714900    2567 scope.go:117] "RemoveContainer" containerID="844c836c4b1cdeeaf10d5e837c6ed6f07a3815a42157edb41f3c4c4fdd7faac1"
Sep 15 13:00:54.716811 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.716789    2567 generic.go:356] "Generic (PLEG): container finished" podID="180e8696-d5d9-4529-b6d1-7c4a4d69e231" containerID="4daa60bb8e390225c93033407dfb169d6d8eae9152c737ed4771688326a78195" exitCode=0
Sep 15 13:00:54.716934 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.716831    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx"
Sep 15 13:00:54.716934 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.716850    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx" event={"ID":"180e8696-d5d9-4529-b6d1-7c4a4d69e231","Type":"ContainerDied","Data":"4daa60bb8e390225c93033407dfb169d6d8eae9152c737ed4771688326a78195"}
Sep 15 13:00:54.716934 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.716887    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx" event={"ID":"180e8696-d5d9-4529-b6d1-7c4a4d69e231","Type":"ContainerDied","Data":"39e79d3b4b98cffeb937e489417fd4c97ee1c82e965a60a56a051b3d862cdefb"}
Sep 15 13:00:54.730668 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.730649    2567 scope.go:117] "RemoveContainer" containerID="844c836c4b1cdeeaf10d5e837c6ed6f07a3815a42157edb41f3c4c4fdd7faac1"
Sep 15 13:00:54.730938 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:00:54.730920    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"844c836c4b1cdeeaf10d5e837c6ed6f07a3815a42157edb41f3c4c4fdd7faac1\": container with ID starting with 844c836c4b1cdeeaf10d5e837c6ed6f07a3815a42157edb41f3c4c4fdd7faac1 not found: ID does not exist" containerID="844c836c4b1cdeeaf10d5e837c6ed6f07a3815a42157edb41f3c4c4fdd7faac1"
Sep 15 13:00:54.731016 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.730945    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"844c836c4b1cdeeaf10d5e837c6ed6f07a3815a42157edb41f3c4c4fdd7faac1"} err="failed to get container status \"844c836c4b1cdeeaf10d5e837c6ed6f07a3815a42157edb41f3c4c4fdd7faac1\": rpc error: code = NotFound desc = could not find container \"844c836c4b1cdeeaf10d5e837c6ed6f07a3815a42157edb41f3c4c4fdd7faac1\": container with ID starting with 844c836c4b1cdeeaf10d5e837c6ed6f07a3815a42157edb41f3c4c4fdd7faac1 not found: ID does not exist"
Sep 15 13:00:54.731016 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.730962    2567 scope.go:117] "RemoveContainer" containerID="4daa60bb8e390225c93033407dfb169d6d8eae9152c737ed4771688326a78195"
Sep 15 13:00:54.739045 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.739021    2567 scope.go:117] "RemoveContainer" containerID="4daa60bb8e390225c93033407dfb169d6d8eae9152c737ed4771688326a78195"
Sep 15 13:00:54.739348 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:00:54.739325    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4daa60bb8e390225c93033407dfb169d6d8eae9152c737ed4771688326a78195\": container with ID starting with 4daa60bb8e390225c93033407dfb169d6d8eae9152c737ed4771688326a78195 not found: ID does not exist" containerID="4daa60bb8e390225c93033407dfb169d6d8eae9152c737ed4771688326a78195"
Sep 15 13:00:54.739448 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.739355    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4daa60bb8e390225c93033407dfb169d6d8eae9152c737ed4771688326a78195"} err="failed to get container status \"4daa60bb8e390225c93033407dfb169d6d8eae9152c737ed4771688326a78195\": rpc error: code = NotFound desc = could not find container \"4daa60bb8e390225c93033407dfb169d6d8eae9152c737ed4771688326a78195\": container with ID starting with 4daa60bb8e390225c93033407dfb169d6d8eae9152c737ed4771688326a78195 not found: ID does not exist"
Sep 15 13:00:54.771300 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.771276    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"]
Sep 15 13:00:54.783774 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.783750    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-179a5f99-65959c6b96-5gg78"]
Sep 15 13:00:54.802026 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.802002    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx"]
Sep 15 13:00:54.818269 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:54.818243    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-179a5f99-685c9fb65c-dkrgx"]
Sep 15 13:00:56.724444 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:56.724406    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="180e8696-d5d9-4529-b6d1-7c4a4d69e231" path="/var/lib/kubelet/pods/180e8696-d5d9-4529-b6d1-7c4a4d69e231/volumes"
Sep 15 13:00:56.725085 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:56.725064    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8df1293b-7606-4f28-8764-df3375534f7d" path="/var/lib/kubelet/pods/8df1293b-7606-4f28-8764-df3375534f7d/volumes"
Sep 15 13:00:59.998795 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:59.998761    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"]
Sep 15 13:00:59.999249 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:00:59.998989    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp" podUID="52bb1f5a-7608-4394-b2dd-29964b7ed944" containerName="maas-api" containerID="cri-o://dc43d4d7364d092f94e36d500bc6c7a4c37fd8601b7eb99278cb66d3bb7f306c" gracePeriod=30
Sep 15 13:01:00.248213 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.248188    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"
Sep 15 13:01:00.321770 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.321679    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9xb6\" (UniqueName: \"kubernetes.io/projected/52bb1f5a-7608-4394-b2dd-29964b7ed944-kube-api-access-p9xb6\") pod \"52bb1f5a-7608-4394-b2dd-29964b7ed944\" (UID: \"52bb1f5a-7608-4394-b2dd-29964b7ed944\") "
Sep 15 13:01:00.321770 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.321727    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52bb1f5a-7608-4394-b2dd-29964b7ed944-openshift-service-ca\") pod \"52bb1f5a-7608-4394-b2dd-29964b7ed944\" (UID: \"52bb1f5a-7608-4394-b2dd-29964b7ed944\") "
Sep 15 13:01:00.321945 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.321799    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52bb1f5a-7608-4394-b2dd-29964b7ed944-metrics-certs\") pod \"52bb1f5a-7608-4394-b2dd-29964b7ed944\" (UID: \"52bb1f5a-7608-4394-b2dd-29964b7ed944\") "
Sep 15 13:01:00.321945 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.321861    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52bb1f5a-7608-4394-b2dd-29964b7ed944-maas-api-tls\") pod \"52bb1f5a-7608-4394-b2dd-29964b7ed944\" (UID: \"52bb1f5a-7608-4394-b2dd-29964b7ed944\") "
Sep 15 13:01:00.322168 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.322137    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52bb1f5a-7608-4394-b2dd-29964b7ed944-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "52bb1f5a-7608-4394-b2dd-29964b7ed944" (UID: "52bb1f5a-7608-4394-b2dd-29964b7ed944"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:01:00.323997 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.323913    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52bb1f5a-7608-4394-b2dd-29964b7ed944-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "52bb1f5a-7608-4394-b2dd-29964b7ed944" (UID: "52bb1f5a-7608-4394-b2dd-29964b7ed944"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:01:00.323997 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.323924    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52bb1f5a-7608-4394-b2dd-29964b7ed944-kube-api-access-p9xb6" (OuterVolumeSpecName: "kube-api-access-p9xb6") pod "52bb1f5a-7608-4394-b2dd-29964b7ed944" (UID: "52bb1f5a-7608-4394-b2dd-29964b7ed944"). InnerVolumeSpecName "kube-api-access-p9xb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:01:00.324120 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.324004    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52bb1f5a-7608-4394-b2dd-29964b7ed944-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "52bb1f5a-7608-4394-b2dd-29964b7ed944" (UID: "52bb1f5a-7608-4394-b2dd-29964b7ed944"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:01:00.422825 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.422789    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/52bb1f5a-7608-4394-b2dd-29964b7ed944-maas-api-tls\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:01:00.422825 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.422823    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9xb6\" (UniqueName: \"kubernetes.io/projected/52bb1f5a-7608-4394-b2dd-29964b7ed944-kube-api-access-p9xb6\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:01:00.422825 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.422833    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/52bb1f5a-7608-4394-b2dd-29964b7ed944-openshift-service-ca\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:01:00.423113 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.422842    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/52bb1f5a-7608-4394-b2dd-29964b7ed944-metrics-certs\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:01:00.749109 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.749075    2567 generic.go:356] "Generic (PLEG): container finished" podID="52bb1f5a-7608-4394-b2dd-29964b7ed944" containerID="dc43d4d7364d092f94e36d500bc6c7a4c37fd8601b7eb99278cb66d3bb7f306c" exitCode=0
Sep 15 13:01:00.749239 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.749137    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"
Sep 15 13:01:00.749239 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.749153    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp" event={"ID":"52bb1f5a-7608-4394-b2dd-29964b7ed944","Type":"ContainerDied","Data":"dc43d4d7364d092f94e36d500bc6c7a4c37fd8601b7eb99278cb66d3bb7f306c"}
Sep 15 13:01:00.749239 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.749206    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp" event={"ID":"52bb1f5a-7608-4394-b2dd-29964b7ed944","Type":"ContainerDied","Data":"0f65a05ad81503f36c33fca19fc2c9dfed05dfe33b226c763b73335aac31d835"}
Sep 15 13:01:00.749239 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.749229    2567 scope.go:117] "RemoveContainer" containerID="dc43d4d7364d092f94e36d500bc6c7a4c37fd8601b7eb99278cb66d3bb7f306c"
Sep 15 13:01:00.757873 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.757851    2567 scope.go:117] "RemoveContainer" containerID="dc43d4d7364d092f94e36d500bc6c7a4c37fd8601b7eb99278cb66d3bb7f306c"
Sep 15 13:01:00.758134 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:01:00.758115    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc43d4d7364d092f94e36d500bc6c7a4c37fd8601b7eb99278cb66d3bb7f306c\": container with ID starting with dc43d4d7364d092f94e36d500bc6c7a4c37fd8601b7eb99278cb66d3bb7f306c not found: ID does not exist" containerID="dc43d4d7364d092f94e36d500bc6c7a4c37fd8601b7eb99278cb66d3bb7f306c"
Sep 15 13:01:00.758185 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.758144    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc43d4d7364d092f94e36d500bc6c7a4c37fd8601b7eb99278cb66d3bb7f306c"} err="failed to get container status \"dc43d4d7364d092f94e36d500bc6c7a4c37fd8601b7eb99278cb66d3bb7f306c\": rpc error: code = NotFound desc = could not find container \"dc43d4d7364d092f94e36d500bc6c7a4c37fd8601b7eb99278cb66d3bb7f306c\": container with ID starting with dc43d4d7364d092f94e36d500bc6c7a4c37fd8601b7eb99278cb66d3bb7f306c not found: ID does not exist"
Sep 15 13:01:00.776688 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.776652    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"]
Sep 15 13:01:00.776890 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:00.776870    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-59f4a3-676d986dcf-4gzzp"]
Sep 15 13:01:02.713370 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:02.713338    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52bb1f5a-7608-4394-b2dd-29964b7ed944" path="/var/lib/kubelet/pods/52bb1f5a-7608-4394-b2dd-29964b7ed944/volumes"
Sep 15 13:01:05.611712 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:05.611676    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"]
Sep 15 13:01:20.630892 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:20.630797    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2" podUID="81b18fc5-10a8-4b95-b710-58fdaaae7e65" containerName="main" containerID="cri-o://e4c7a61e2dbd66629a8a3a96bd2e4d112947889eb3bcde6aea99df1eda086fc6" gracePeriod=45
Sep 15 13:01:20.846560 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:20.846525    2567 generic.go:356] "Generic (PLEG): container finished" podID="81b18fc5-10a8-4b95-b710-58fdaaae7e65" containerID="e4c7a61e2dbd66629a8a3a96bd2e4d112947889eb3bcde6aea99df1eda086fc6" exitCode=0
Sep 15 13:01:20.846682 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:20.846594    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2" event={"ID":"81b18fc5-10a8-4b95-b710-58fdaaae7e65","Type":"ContainerDied","Data":"e4c7a61e2dbd66629a8a3a96bd2e4d112947889eb3bcde6aea99df1eda086fc6"}
Sep 15 13:01:20.877347 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:20.877326    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:01:21.012503 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.012471    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzvdt\" (UniqueName: \"kubernetes.io/projected/81b18fc5-10a8-4b95-b710-58fdaaae7e65-kube-api-access-hzvdt\") pod \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") "
Sep 15 13:01:21.012686 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.012532    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-dshm\") pod \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") "
Sep 15 13:01:21.012686 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.012584    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-home\") pod \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") "
Sep 15 13:01:21.012686 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.012613    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-tmp-dir\") pod \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") "
Sep 15 13:01:21.012846 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.012690    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-model-cache\") pod \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") "
Sep 15 13:01:21.012846 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.012718    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81b18fc5-10a8-4b95-b710-58fdaaae7e65-tls-certs\") pod \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\" (UID: \"81b18fc5-10a8-4b95-b710-58fdaaae7e65\") "
Sep 15 13:01:21.012947 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.012875    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-home" (OuterVolumeSpecName: "home") pod "81b18fc5-10a8-4b95-b710-58fdaaae7e65" (UID: "81b18fc5-10a8-4b95-b710-58fdaaae7e65"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:01:21.012947 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.012925    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "81b18fc5-10a8-4b95-b710-58fdaaae7e65" (UID: "81b18fc5-10a8-4b95-b710-58fdaaae7e65"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:01:21.012947 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.012937    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-model-cache" (OuterVolumeSpecName: "model-cache") pod "81b18fc5-10a8-4b95-b710-58fdaaae7e65" (UID: "81b18fc5-10a8-4b95-b710-58fdaaae7e65"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:01:21.013114 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.013090    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-home\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:01:21.013194 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.013132    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-tmp-dir\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:01:21.013194 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.013147    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-model-cache\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:01:21.014756 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.014734    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81b18fc5-10a8-4b95-b710-58fdaaae7e65-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "81b18fc5-10a8-4b95-b710-58fdaaae7e65" (UID: "81b18fc5-10a8-4b95-b710-58fdaaae7e65"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:01:21.014840 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.014795    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81b18fc5-10a8-4b95-b710-58fdaaae7e65-kube-api-access-hzvdt" (OuterVolumeSpecName: "kube-api-access-hzvdt") pod "81b18fc5-10a8-4b95-b710-58fdaaae7e65" (UID: "81b18fc5-10a8-4b95-b710-58fdaaae7e65"). InnerVolumeSpecName "kube-api-access-hzvdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:01:21.014840 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.014831    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-dshm" (OuterVolumeSpecName: "dshm") pod "81b18fc5-10a8-4b95-b710-58fdaaae7e65" (UID: "81b18fc5-10a8-4b95-b710-58fdaaae7e65"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:01:21.114458 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.114432    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81b18fc5-10a8-4b95-b710-58fdaaae7e65-tls-certs\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:01:21.114458 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.114455    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzvdt\" (UniqueName: \"kubernetes.io/projected/81b18fc5-10a8-4b95-b710-58fdaaae7e65-kube-api-access-hzvdt\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:01:21.114458 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.114465    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81b18fc5-10a8-4b95-b710-58fdaaae7e65-dshm\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:01:21.852892 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.852863    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"
Sep 15 13:01:21.853297 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.852863    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2" event={"ID":"81b18fc5-10a8-4b95-b710-58fdaaae7e65","Type":"ContainerDied","Data":"6d74817e9f2025e65105e7cd2a6131ae004e86944935b42cdb4576e847ff52e5"}
Sep 15 13:01:21.853297 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.853001    2567 scope.go:117] "RemoveContainer" containerID="e4c7a61e2dbd66629a8a3a96bd2e4d112947889eb3bcde6aea99df1eda086fc6"
Sep 15 13:01:21.874708 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.874679    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"]
Sep 15 13:01:21.881376 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:21.881353    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-59f4a3/autores-model-59f4a3-kserve-569dbc7547-qxwk2"]
Sep 15 13:01:22.713638 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:22.713608    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81b18fc5-10a8-4b95-b710-58fdaaae7e65" path="/var/lib/kubelet/pods/81b18fc5-10a8-4b95-b710-58fdaaae7e65/volumes"
Sep 15 13:01:50.976748 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:50.976715    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"]
Sep 15 13:01:50.977303 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:50.977284    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52bb1f5a-7608-4394-b2dd-29964b7ed944" containerName="maas-api"
Sep 15 13:01:50.977563 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:50.977306    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="52bb1f5a-7608-4394-b2dd-29964b7ed944" containerName="maas-api"
Sep 15 13:01:50.977563 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:50.977319    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8df1293b-7606-4f28-8764-df3375534f7d" containerName="maas-api"
Sep 15 13:01:50.977563 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:50.977327    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8df1293b-7606-4f28-8764-df3375534f7d" containerName="maas-api"
Sep 15 13:01:50.977563 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:50.977341    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="180e8696-d5d9-4529-b6d1-7c4a4d69e231" containerName="payload-processing"
Sep 15 13:01:50.977563 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:50.977351    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="180e8696-d5d9-4529-b6d1-7c4a4d69e231" containerName="payload-processing"
Sep 15 13:01:50.977563 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:50.977364    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81b18fc5-10a8-4b95-b710-58fdaaae7e65" containerName="main"
Sep 15 13:01:50.977563 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:50.977382    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="81b18fc5-10a8-4b95-b710-58fdaaae7e65" containerName="main"
Sep 15 13:01:50.977563 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:50.977493    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="81b18fc5-10a8-4b95-b710-58fdaaae7e65" containerName="main"
Sep 15 13:01:50.977563 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:50.977506    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="52bb1f5a-7608-4394-b2dd-29964b7ed944" containerName="maas-api"
Sep 15 13:01:50.977563 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:50.977518    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="180e8696-d5d9-4529-b6d1-7c4a4d69e231" containerName="payload-processing"
Sep 15 13:01:50.977563 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:50.977528    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8df1293b-7606-4f28-8764-df3375534f7d" containerName="maas-api"
Sep 15 13:01:50.980933 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:50.980911    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"
Sep 15 13:01:50.983002 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:50.982966    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-413e9f-serving-cert\""
Sep 15 13:01:50.994446 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:50.994422    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"]
Sep 15 13:01:51.070428 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.070389    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16641cbe-87c6-49df-b18a-26b8d9db9850-metrics-certs\") pod \"maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7\" (UID: \"16641cbe-87c6-49df-b18a-26b8d9db9850\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"
Sep 15 13:01:51.070428 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.070425    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16641cbe-87c6-49df-b18a-26b8d9db9850-openshift-service-ca\") pod \"maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7\" (UID: \"16641cbe-87c6-49df-b18a-26b8d9db9850\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"
Sep 15 13:01:51.070625 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.070450    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmn79\" (UniqueName: \"kubernetes.io/projected/16641cbe-87c6-49df-b18a-26b8d9db9850-kube-api-access-nmn79\") pod \"maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7\" (UID: \"16641cbe-87c6-49df-b18a-26b8d9db9850\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"
Sep 15 13:01:51.070625 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.070534    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16641cbe-87c6-49df-b18a-26b8d9db9850-maas-api-tls\") pod \"maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7\" (UID: \"16641cbe-87c6-49df-b18a-26b8d9db9850\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"
Sep 15 13:01:51.171953 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.171922    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16641cbe-87c6-49df-b18a-26b8d9db9850-metrics-certs\") pod \"maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7\" (UID: \"16641cbe-87c6-49df-b18a-26b8d9db9850\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"
Sep 15 13:01:51.171953 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.171961    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16641cbe-87c6-49df-b18a-26b8d9db9850-openshift-service-ca\") pod \"maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7\" (UID: \"16641cbe-87c6-49df-b18a-26b8d9db9850\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"
Sep 15 13:01:51.172177 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.172008    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmn79\" (UniqueName: \"kubernetes.io/projected/16641cbe-87c6-49df-b18a-26b8d9db9850-kube-api-access-nmn79\") pod \"maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7\" (UID: \"16641cbe-87c6-49df-b18a-26b8d9db9850\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"
Sep 15 13:01:51.172177 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.172056    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16641cbe-87c6-49df-b18a-26b8d9db9850-maas-api-tls\") pod \"maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7\" (UID: \"16641cbe-87c6-49df-b18a-26b8d9db9850\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"
Sep 15 13:01:51.172249 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:01:51.172185    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-serving-cert: secret "maas-api-e2e-explicit-413e9f-serving-cert" not found
Sep 15 13:01:51.172282 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:01:51.172262    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16641cbe-87c6-49df-b18a-26b8d9db9850-maas-api-tls podName:16641cbe-87c6-49df-b18a-26b8d9db9850 nodeName:}" failed. No retries permitted until 2026-09-15 13:01:51.67224138 +0000 UTC m=+1015.393556904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/16641cbe-87c6-49df-b18a-26b8d9db9850-maas-api-tls") pod "maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7" (UID: "16641cbe-87c6-49df-b18a-26b8d9db9850") : secret "maas-api-e2e-explicit-413e9f-serving-cert" not found
Sep 15 13:01:51.172766 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.172744    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16641cbe-87c6-49df-b18a-26b8d9db9850-openshift-service-ca\") pod \"maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7\" (UID: \"16641cbe-87c6-49df-b18a-26b8d9db9850\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"
Sep 15 13:01:51.174357 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.174339    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16641cbe-87c6-49df-b18a-26b8d9db9850-metrics-certs\") pod \"maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7\" (UID: \"16641cbe-87c6-49df-b18a-26b8d9db9850\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"
Sep 15 13:01:51.180487 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.180467    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmn79\" (UniqueName: \"kubernetes.io/projected/16641cbe-87c6-49df-b18a-26b8d9db9850-kube-api-access-nmn79\") pod \"maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7\" (UID: \"16641cbe-87c6-49df-b18a-26b8d9db9850\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"
Sep 15 13:01:51.677093 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.677057    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16641cbe-87c6-49df-b18a-26b8d9db9850-maas-api-tls\") pod \"maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7\" (UID: \"16641cbe-87c6-49df-b18a-26b8d9db9850\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"
Sep 15 13:01:51.679526 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.679503    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16641cbe-87c6-49df-b18a-26b8d9db9850-maas-api-tls\") pod \"maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7\" (UID: \"16641cbe-87c6-49df-b18a-26b8d9db9850\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"
Sep 15 13:01:51.711623 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.711593    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx"]
Sep 15 13:01:51.715305 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.715288    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx"
Sep 15 13:01:51.717542 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.717523    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-413e9f-dockercfg-j9rpt\""
Sep 15 13:01:51.717612 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.717553    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-413e9f\""
Sep 15 13:01:51.729950 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.729926    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx"]
Sep 15 13:01:51.778057 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.778017    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6fhx\" (UniqueName: \"kubernetes.io/projected/528c46a2-f22b-4526-b4e2-a694cab8959a-kube-api-access-r6fhx\") pod \"payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx\" (UID: \"528c46a2-f22b-4526-b4e2-a694cab8959a\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx"
Sep 15 13:01:51.778326 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.778064    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/528c46a2-f22b-4526-b4e2-a694cab8959a-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx\" (UID: \"528c46a2-f22b-4526-b4e2-a694cab8959a\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx"
Sep 15 13:01:51.878919 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.878879    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6fhx\" (UniqueName: \"kubernetes.io/projected/528c46a2-f22b-4526-b4e2-a694cab8959a-kube-api-access-r6fhx\") pod \"payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx\" (UID: \"528c46a2-f22b-4526-b4e2-a694cab8959a\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx"
Sep 15 13:01:51.878919 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.878917    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/528c46a2-f22b-4526-b4e2-a694cab8959a-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx\" (UID: \"528c46a2-f22b-4526-b4e2-a694cab8959a\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx"
Sep 15 13:01:51.879611 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.879590    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/528c46a2-f22b-4526-b4e2-a694cab8959a-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx\" (UID: \"528c46a2-f22b-4526-b4e2-a694cab8959a\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx"
Sep 15 13:01:51.887519 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.887490    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6fhx\" (UniqueName: \"kubernetes.io/projected/528c46a2-f22b-4526-b4e2-a694cab8959a-kube-api-access-r6fhx\") pod \"payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx\" (UID: \"528c46a2-f22b-4526-b4e2-a694cab8959a\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx"
Sep 15 13:01:51.892258 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:51.892238    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"
Sep 15 13:01:52.026292 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:52.026261    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx"
Sep 15 13:01:52.163368 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:52.163344    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"]
Sep 15 13:01:52.165460 ip-10-0-129-48 kubenswrapper[2567]: W0915 13:01:52.165431    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16641cbe_87c6_49df_b18a_26b8d9db9850.slice/crio-c130a9e6585aaa8fd3f4c5c24679545e4d81aa0fa444b45a0310d4a9461d99ec WatchSource:0}: Error finding container c130a9e6585aaa8fd3f4c5c24679545e4d81aa0fa444b45a0310d4a9461d99ec: Status 404 returned error can't find the container with id c130a9e6585aaa8fd3f4c5c24679545e4d81aa0fa444b45a0310d4a9461d99ec
Sep 15 13:01:52.166928 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:52.166913    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 13:01:52.298492 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:52.298460    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx"]
Sep 15 13:01:52.300261 ip-10-0-129-48 kubenswrapper[2567]: W0915 13:01:52.300229    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528c46a2_f22b_4526_b4e2_a694cab8959a.slice/crio-bd46297e021b915029c536fc21bc592d7f2ff1af5230874244750d062bedbe66 WatchSource:0}: Error finding container bd46297e021b915029c536fc21bc592d7f2ff1af5230874244750d062bedbe66: Status 404 returned error can't find the container with id bd46297e021b915029c536fc21bc592d7f2ff1af5230874244750d062bedbe66
Sep 15 13:01:53.004604 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:53.004575    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx" event={"ID":"528c46a2-f22b-4526-b4e2-a694cab8959a","Type":"ContainerStarted","Data":"c2c66cd3756f223e8181b50ffd0b901afdc1b1c8855395ab21778b7ed86e2941"}
Sep 15 13:01:53.004718 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:53.004627    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx" event={"ID":"528c46a2-f22b-4526-b4e2-a694cab8959a","Type":"ContainerStarted","Data":"bd46297e021b915029c536fc21bc592d7f2ff1af5230874244750d062bedbe66"}
Sep 15 13:01:53.004718 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:53.004674    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx"
Sep 15 13:01:53.005940 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:53.005919    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7" event={"ID":"16641cbe-87c6-49df-b18a-26b8d9db9850","Type":"ContainerStarted","Data":"c130a9e6585aaa8fd3f4c5c24679545e4d81aa0fa444b45a0310d4a9461d99ec"}
Sep 15 13:01:53.034864 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:53.034817    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx" podStartSLOduration=2.034799443 podStartE2EDuration="2.034799443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:01:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:01:53.033307263 +0000 UTC m=+1016.754622794" watchObservedRunningTime="2026-09-15 13:01:53.034799443 +0000 UTC m=+1016.756114976"
Sep 15 13:01:54.012083 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:54.012047    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7" event={"ID":"16641cbe-87c6-49df-b18a-26b8d9db9850","Type":"ContainerStarted","Data":"04400f021937b64b34700a486b906e3c16be47d40468581b8adc437d74b97939"}
Sep 15 13:01:54.030756 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:54.030707    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7" podStartSLOduration=3.211028191 podStartE2EDuration="4.030691663s" totalImagesPullingTime="819.663472ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:01:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:01:54.028359753 +0000 UTC m=+1017.749675284" watchObservedRunningTime="2026-09-15 13:01:54.030691663 +0000 UTC m=+1017.752007194"
Sep 15 13:01:55.016990 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:01:55.016951    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"
Sep 15 13:02:01.026663 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:02:01.026629    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"
Sep 15 13:02:04.014187 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:02:04.014155    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx"
Sep 15 13:03:49.168214 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.168177    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"]
Sep 15 13:03:49.168738 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.168451    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7" podUID="16641cbe-87c6-49df-b18a-26b8d9db9850" containerName="maas-api" containerID="cri-o://04400f021937b64b34700a486b906e3c16be47d40468581b8adc437d74b97939" gracePeriod=30
Sep 15 13:03:49.241187 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.241152    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx"]
Sep 15 13:03:49.241495 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.241411    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx" podUID="528c46a2-f22b-4526-b4e2-a694cab8959a" containerName="payload-pre-processing" containerID="cri-o://c2c66cd3756f223e8181b50ffd0b901afdc1b1c8855395ab21778b7ed86e2941" gracePeriod=30
Sep 15 13:03:49.495586 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.495557    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"
Sep 15 13:03:49.518215 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.518193    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx"
Sep 15 13:03:49.572823 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.572787    2567 generic.go:356] "Generic (PLEG): container finished" podID="528c46a2-f22b-4526-b4e2-a694cab8959a" containerID="c2c66cd3756f223e8181b50ffd0b901afdc1b1c8855395ab21778b7ed86e2941" exitCode=0
Sep 15 13:03:49.573029 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.572845    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx"
Sep 15 13:03:49.573029 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.572884    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx" event={"ID":"528c46a2-f22b-4526-b4e2-a694cab8959a","Type":"ContainerDied","Data":"c2c66cd3756f223e8181b50ffd0b901afdc1b1c8855395ab21778b7ed86e2941"}
Sep 15 13:03:49.573029 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.572944    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx" event={"ID":"528c46a2-f22b-4526-b4e2-a694cab8959a","Type":"ContainerDied","Data":"bd46297e021b915029c536fc21bc592d7f2ff1af5230874244750d062bedbe66"}
Sep 15 13:03:49.573029 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.572993    2567 scope.go:117] "RemoveContainer" containerID="c2c66cd3756f223e8181b50ffd0b901afdc1b1c8855395ab21778b7ed86e2941"
Sep 15 13:03:49.575177 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.575151    2567 generic.go:356] "Generic (PLEG): container finished" podID="16641cbe-87c6-49df-b18a-26b8d9db9850" containerID="04400f021937b64b34700a486b906e3c16be47d40468581b8adc437d74b97939" exitCode=0
Sep 15 13:03:49.575293 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.575190    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7" event={"ID":"16641cbe-87c6-49df-b18a-26b8d9db9850","Type":"ContainerDied","Data":"04400f021937b64b34700a486b906e3c16be47d40468581b8adc437d74b97939"}
Sep 15 13:03:49.575293 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.575233    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7" event={"ID":"16641cbe-87c6-49df-b18a-26b8d9db9850","Type":"ContainerDied","Data":"c130a9e6585aaa8fd3f4c5c24679545e4d81aa0fa444b45a0310d4a9461d99ec"}
Sep 15 13:03:49.575424 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.575304    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"
Sep 15 13:03:49.582352 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.582333    2567 scope.go:117] "RemoveContainer" containerID="c2c66cd3756f223e8181b50ffd0b901afdc1b1c8855395ab21778b7ed86e2941"
Sep 15 13:03:49.582662 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:03:49.582644    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2c66cd3756f223e8181b50ffd0b901afdc1b1c8855395ab21778b7ed86e2941\": container with ID starting with c2c66cd3756f223e8181b50ffd0b901afdc1b1c8855395ab21778b7ed86e2941 not found: ID does not exist" containerID="c2c66cd3756f223e8181b50ffd0b901afdc1b1c8855395ab21778b7ed86e2941"
Sep 15 13:03:49.582731 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.582670    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2c66cd3756f223e8181b50ffd0b901afdc1b1c8855395ab21778b7ed86e2941"} err="failed to get container status \"c2c66cd3756f223e8181b50ffd0b901afdc1b1c8855395ab21778b7ed86e2941\": rpc error: code = NotFound desc = could not find container \"c2c66cd3756f223e8181b50ffd0b901afdc1b1c8855395ab21778b7ed86e2941\": container with ID starting with c2c66cd3756f223e8181b50ffd0b901afdc1b1c8855395ab21778b7ed86e2941 not found: ID does not exist"
Sep 15 13:03:49.582731 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.582687    2567 scope.go:117] "RemoveContainer" containerID="04400f021937b64b34700a486b906e3c16be47d40468581b8adc437d74b97939"
Sep 15 13:03:49.590870 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.590849    2567 scope.go:117] "RemoveContainer" containerID="04400f021937b64b34700a486b906e3c16be47d40468581b8adc437d74b97939"
Sep 15 13:03:49.591230 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:03:49.591202    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04400f021937b64b34700a486b906e3c16be47d40468581b8adc437d74b97939\": container with ID starting with 04400f021937b64b34700a486b906e3c16be47d40468581b8adc437d74b97939 not found: ID does not exist" containerID="04400f021937b64b34700a486b906e3c16be47d40468581b8adc437d74b97939"
Sep 15 13:03:49.591342 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.591238    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04400f021937b64b34700a486b906e3c16be47d40468581b8adc437d74b97939"} err="failed to get container status \"04400f021937b64b34700a486b906e3c16be47d40468581b8adc437d74b97939\": rpc error: code = NotFound desc = could not find container \"04400f021937b64b34700a486b906e3c16be47d40468581b8adc437d74b97939\": container with ID starting with 04400f021937b64b34700a486b906e3c16be47d40468581b8adc437d74b97939 not found: ID does not exist"
Sep 15 13:03:49.663092 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.663053    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16641cbe-87c6-49df-b18a-26b8d9db9850-maas-api-tls\") pod \"16641cbe-87c6-49df-b18a-26b8d9db9850\" (UID: \"16641cbe-87c6-49df-b18a-26b8d9db9850\") "
Sep 15 13:03:49.663296 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.663120    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16641cbe-87c6-49df-b18a-26b8d9db9850-metrics-certs\") pod \"16641cbe-87c6-49df-b18a-26b8d9db9850\" (UID: \"16641cbe-87c6-49df-b18a-26b8d9db9850\") "
Sep 15 13:03:49.663296 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.663178    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/528c46a2-f22b-4526-b4e2-a694cab8959a-plugins-config-volume\") pod \"528c46a2-f22b-4526-b4e2-a694cab8959a\" (UID: \"528c46a2-f22b-4526-b4e2-a694cab8959a\") "
Sep 15 13:03:49.663296 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.663241    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16641cbe-87c6-49df-b18a-26b8d9db9850-openshift-service-ca\") pod \"16641cbe-87c6-49df-b18a-26b8d9db9850\" (UID: \"16641cbe-87c6-49df-b18a-26b8d9db9850\") "
Sep 15 13:03:49.663296 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.663275    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6fhx\" (UniqueName: \"kubernetes.io/projected/528c46a2-f22b-4526-b4e2-a694cab8959a-kube-api-access-r6fhx\") pod \"528c46a2-f22b-4526-b4e2-a694cab8959a\" (UID: \"528c46a2-f22b-4526-b4e2-a694cab8959a\") "
Sep 15 13:03:49.663528 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.663341    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmn79\" (UniqueName: \"kubernetes.io/projected/16641cbe-87c6-49df-b18a-26b8d9db9850-kube-api-access-nmn79\") pod \"16641cbe-87c6-49df-b18a-26b8d9db9850\" (UID: \"16641cbe-87c6-49df-b18a-26b8d9db9850\") "
Sep 15 13:03:49.663961 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.663873    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/528c46a2-f22b-4526-b4e2-a694cab8959a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "528c46a2-f22b-4526-b4e2-a694cab8959a" (UID: "528c46a2-f22b-4526-b4e2-a694cab8959a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:03:49.664142 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.664096    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16641cbe-87c6-49df-b18a-26b8d9db9850-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "16641cbe-87c6-49df-b18a-26b8d9db9850" (UID: "16641cbe-87c6-49df-b18a-26b8d9db9850"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:03:49.666314 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.666219    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16641cbe-87c6-49df-b18a-26b8d9db9850-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "16641cbe-87c6-49df-b18a-26b8d9db9850" (UID: "16641cbe-87c6-49df-b18a-26b8d9db9850"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:03:49.666314 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.666262    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16641cbe-87c6-49df-b18a-26b8d9db9850-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "16641cbe-87c6-49df-b18a-26b8d9db9850" (UID: "16641cbe-87c6-49df-b18a-26b8d9db9850"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:03:49.666314 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.666304    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/528c46a2-f22b-4526-b4e2-a694cab8959a-kube-api-access-r6fhx" (OuterVolumeSpecName: "kube-api-access-r6fhx") pod "528c46a2-f22b-4526-b4e2-a694cab8959a" (UID: "528c46a2-f22b-4526-b4e2-a694cab8959a"). InnerVolumeSpecName "kube-api-access-r6fhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:03:49.666617 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.666588    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16641cbe-87c6-49df-b18a-26b8d9db9850-kube-api-access-nmn79" (OuterVolumeSpecName: "kube-api-access-nmn79") pod "16641cbe-87c6-49df-b18a-26b8d9db9850" (UID: "16641cbe-87c6-49df-b18a-26b8d9db9850"). InnerVolumeSpecName "kube-api-access-nmn79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:03:49.764342 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.764264    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16641cbe-87c6-49df-b18a-26b8d9db9850-maas-api-tls\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:03:49.764342 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.764310    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16641cbe-87c6-49df-b18a-26b8d9db9850-metrics-certs\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:03:49.764342 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.764320    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/528c46a2-f22b-4526-b4e2-a694cab8959a-plugins-config-volume\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:03:49.764342 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.764329    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16641cbe-87c6-49df-b18a-26b8d9db9850-openshift-service-ca\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:03:49.764342 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.764338    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6fhx\" (UniqueName: \"kubernetes.io/projected/528c46a2-f22b-4526-b4e2-a694cab8959a-kube-api-access-r6fhx\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:03:49.764342 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.764346    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmn79\" (UniqueName: \"kubernetes.io/projected/16641cbe-87c6-49df-b18a-26b8d9db9850-kube-api-access-nmn79\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:03:49.900654 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.900631    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx"]
Sep 15 13:03:49.903595 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.903573    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-413e9f-ffd49bc4b-6kfcx"]
Sep 15 13:03:49.916316 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.916286    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"]
Sep 15 13:03:49.922008 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:49.921961    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-413e9f-6f56495cf8-5j6g7"]
Sep 15 13:03:50.714045 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:50.714015    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16641cbe-87c6-49df-b18a-26b8d9db9850" path="/var/lib/kubelet/pods/16641cbe-87c6-49df-b18a-26b8d9db9850/volumes"
Sep 15 13:03:50.714428 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:03:50.714413    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="528c46a2-f22b-4526-b4e2-a694cab8959a" path="/var/lib/kubelet/pods/528c46a2-f22b-4526-b4e2-a694cab8959a/volumes"
Sep 15 13:04:20.090549 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.090466    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"]
Sep 15 13:04:20.091158 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.091130    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16641cbe-87c6-49df-b18a-26b8d9db9850" containerName="maas-api"
Sep 15 13:04:20.091158 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.091156    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="16641cbe-87c6-49df-b18a-26b8d9db9850" containerName="maas-api"
Sep 15 13:04:20.091316 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.091173    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="528c46a2-f22b-4526-b4e2-a694cab8959a" containerName="payload-pre-processing"
Sep 15 13:04:20.091316 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.091182    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="528c46a2-f22b-4526-b4e2-a694cab8959a" containerName="payload-pre-processing"
Sep 15 13:04:20.091316 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.091305    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="528c46a2-f22b-4526-b4e2-a694cab8959a" containerName="payload-pre-processing"
Sep 15 13:04:20.091412 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.091321    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="16641cbe-87c6-49df-b18a-26b8d9db9850" containerName="maas-api"
Sep 15 13:04:20.095674 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.095653    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.098451 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.098424    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-08b44c\"/\"openshift-service-ca.crt\""
Sep 15 13:04:20.098574 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.098454    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-08b44c\"/\"kube-root-ca.crt\""
Sep 15 13:04:20.099056 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.099036    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-08b44c\"/\"noten-model-08b44c-kserve-self-signed-certs\""
Sep 15 13:04:20.099153 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.099125    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-08b44c\"/\"default-dockercfg-qr5j9\""
Sep 15 13:04:20.103876 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.103857    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"]
Sep 15 13:04:20.231253 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.231208    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b1af2ca-d556-403a-90c8-6acd03a58efd-tls-certs\") pod \"noten-model-08b44c-kserve-7bdf5b7899-c96tj\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") " pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.231253 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.231253    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-tmp-dir\") pod \"noten-model-08b44c-kserve-7bdf5b7899-c96tj\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") " pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.231541 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.231355    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-model-cache\") pod \"noten-model-08b44c-kserve-7bdf5b7899-c96tj\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") " pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.231541 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.231398    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-home\") pod \"noten-model-08b44c-kserve-7bdf5b7899-c96tj\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") " pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.231541 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.231431    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-dshm\") pod \"noten-model-08b44c-kserve-7bdf5b7899-c96tj\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") " pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.231541 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.231451    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wzg7\" (UniqueName: \"kubernetes.io/projected/5b1af2ca-d556-403a-90c8-6acd03a58efd-kube-api-access-5wzg7\") pod \"noten-model-08b44c-kserve-7bdf5b7899-c96tj\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") " pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.332741 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.332701    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b1af2ca-d556-403a-90c8-6acd03a58efd-tls-certs\") pod \"noten-model-08b44c-kserve-7bdf5b7899-c96tj\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") " pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.332741 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.332741    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-tmp-dir\") pod \"noten-model-08b44c-kserve-7bdf5b7899-c96tj\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") " pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.333000 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.332792    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-model-cache\") pod \"noten-model-08b44c-kserve-7bdf5b7899-c96tj\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") " pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.333000 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.332814    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-home\") pod \"noten-model-08b44c-kserve-7bdf5b7899-c96tj\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") " pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.333000 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.332863    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-dshm\") pod \"noten-model-08b44c-kserve-7bdf5b7899-c96tj\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") " pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.333000 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.332891    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wzg7\" (UniqueName: \"kubernetes.io/projected/5b1af2ca-d556-403a-90c8-6acd03a58efd-kube-api-access-5wzg7\") pod \"noten-model-08b44c-kserve-7bdf5b7899-c96tj\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") " pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.333294 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.333265    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-home\") pod \"noten-model-08b44c-kserve-7bdf5b7899-c96tj\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") " pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.333376 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.333299    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-tmp-dir\") pod \"noten-model-08b44c-kserve-7bdf5b7899-c96tj\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") " pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.333376 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.333326    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-model-cache\") pod \"noten-model-08b44c-kserve-7bdf5b7899-c96tj\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") " pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.335107 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.335088    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-dshm\") pod \"noten-model-08b44c-kserve-7bdf5b7899-c96tj\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") " pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.335296 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.335278    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b1af2ca-d556-403a-90c8-6acd03a58efd-tls-certs\") pod \"noten-model-08b44c-kserve-7bdf5b7899-c96tj\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") " pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.340907 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.340853    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wzg7\" (UniqueName: \"kubernetes.io/projected/5b1af2ca-d556-403a-90c8-6acd03a58efd-kube-api-access-5wzg7\") pod \"noten-model-08b44c-kserve-7bdf5b7899-c96tj\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") " pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.405743 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.405707    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:20.684542 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.684515    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"]
Sep 15 13:04:20.686555 ip-10-0-129-48 kubenswrapper[2567]: W0915 13:04:20.686530    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b1af2ca_d556_403a_90c8_6acd03a58efd.slice/crio-9ebc8bc6c0556137bff7be792ba3e0ee4922ba190e2a4eb08fffb0d5aadff384 WatchSource:0}: Error finding container 9ebc8bc6c0556137bff7be792ba3e0ee4922ba190e2a4eb08fffb0d5aadff384: Status 404 returned error can't find the container with id 9ebc8bc6c0556137bff7be792ba3e0ee4922ba190e2a4eb08fffb0d5aadff384
Sep 15 13:04:20.726565 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:20.726536    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj" event={"ID":"5b1af2ca-d556-403a-90c8-6acd03a58efd","Type":"ContainerStarted","Data":"9ebc8bc6c0556137bff7be792ba3e0ee4922ba190e2a4eb08fffb0d5aadff384"}
Sep 15 13:04:21.733099 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:21.733062    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj" event={"ID":"5b1af2ca-d556-403a-90c8-6acd03a58efd","Type":"ContainerStarted","Data":"555549ec66ebd545c988c33add706930548b9150b829c8570fd386fbfff7396d"}
Sep 15 13:04:21.751258 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:21.751214    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj" podStartSLOduration=1.75119951 podStartE2EDuration="1.75119951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:04:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:04:21.750256609 +0000 UTC m=+1165.471572142" watchObservedRunningTime="2026-09-15 13:04:21.75119951 +0000 UTC m=+1165.472515042"
Sep 15 13:04:29.103387 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:29.103353    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"]
Sep 15 13:04:30.406307 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:30.406274    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:44.122619 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.122572    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj" podUID="5b1af2ca-d556-403a-90c8-6acd03a58efd" containerName="main" containerID="cri-o://555549ec66ebd545c988c33add706930548b9150b829c8570fd386fbfff7396d" gracePeriod=45
Sep 15 13:04:44.364068 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.364042    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:44.446066 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.446038    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-tmp-dir\") pod \"5b1af2ca-d556-403a-90c8-6acd03a58efd\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") "
Sep 15 13:04:44.446244 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.446075    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wzg7\" (UniqueName: \"kubernetes.io/projected/5b1af2ca-d556-403a-90c8-6acd03a58efd-kube-api-access-5wzg7\") pod \"5b1af2ca-d556-403a-90c8-6acd03a58efd\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") "
Sep 15 13:04:44.446244 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.446107    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b1af2ca-d556-403a-90c8-6acd03a58efd-tls-certs\") pod \"5b1af2ca-d556-403a-90c8-6acd03a58efd\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") "
Sep 15 13:04:44.446244 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.446141    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-dshm\") pod \"5b1af2ca-d556-403a-90c8-6acd03a58efd\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") "
Sep 15 13:04:44.446244 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.446184    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-model-cache\") pod \"5b1af2ca-d556-403a-90c8-6acd03a58efd\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") "
Sep 15 13:04:44.446244 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.446219    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-home\") pod \"5b1af2ca-d556-403a-90c8-6acd03a58efd\" (UID: \"5b1af2ca-d556-403a-90c8-6acd03a58efd\") "
Sep 15 13:04:44.446522 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.446358    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5b1af2ca-d556-403a-90c8-6acd03a58efd" (UID: "5b1af2ca-d556-403a-90c8-6acd03a58efd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:04:44.446522 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.446469    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-tmp-dir\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:04:44.446522 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.446471    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-model-cache" (OuterVolumeSpecName: "model-cache") pod "5b1af2ca-d556-403a-90c8-6acd03a58efd" (UID: "5b1af2ca-d556-403a-90c8-6acd03a58efd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:04:44.446522 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.446506    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-home" (OuterVolumeSpecName: "home") pod "5b1af2ca-d556-403a-90c8-6acd03a58efd" (UID: "5b1af2ca-d556-403a-90c8-6acd03a58efd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:04:44.448333 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.448312    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-dshm" (OuterVolumeSpecName: "dshm") pod "5b1af2ca-d556-403a-90c8-6acd03a58efd" (UID: "5b1af2ca-d556-403a-90c8-6acd03a58efd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:04:44.448418 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.448377    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b1af2ca-d556-403a-90c8-6acd03a58efd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5b1af2ca-d556-403a-90c8-6acd03a58efd" (UID: "5b1af2ca-d556-403a-90c8-6acd03a58efd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:04:44.448418 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.448389    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b1af2ca-d556-403a-90c8-6acd03a58efd-kube-api-access-5wzg7" (OuterVolumeSpecName: "kube-api-access-5wzg7") pod "5b1af2ca-d556-403a-90c8-6acd03a58efd" (UID: "5b1af2ca-d556-403a-90c8-6acd03a58efd"). InnerVolumeSpecName "kube-api-access-5wzg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:04:44.546989 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.546952    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wzg7\" (UniqueName: \"kubernetes.io/projected/5b1af2ca-d556-403a-90c8-6acd03a58efd-kube-api-access-5wzg7\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:04:44.547157 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.547013    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5b1af2ca-d556-403a-90c8-6acd03a58efd-tls-certs\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:04:44.547157 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.547027    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-dshm\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:04:44.547157 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.547042    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-model-cache\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:04:44.547157 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.547052    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5b1af2ca-d556-403a-90c8-6acd03a58efd-home\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:04:44.840378 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.840341    2567 generic.go:356] "Generic (PLEG): container finished" podID="5b1af2ca-d556-403a-90c8-6acd03a58efd" containerID="555549ec66ebd545c988c33add706930548b9150b829c8570fd386fbfff7396d" exitCode=0
Sep 15 13:04:44.840537 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.840386    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"
Sep 15 13:04:44.840537 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.840427    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj" event={"ID":"5b1af2ca-d556-403a-90c8-6acd03a58efd","Type":"ContainerDied","Data":"555549ec66ebd545c988c33add706930548b9150b829c8570fd386fbfff7396d"}
Sep 15 13:04:44.840537 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.840468    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj" event={"ID":"5b1af2ca-d556-403a-90c8-6acd03a58efd","Type":"ContainerDied","Data":"9ebc8bc6c0556137bff7be792ba3e0ee4922ba190e2a4eb08fffb0d5aadff384"}
Sep 15 13:04:44.840537 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.840484    2567 scope.go:117] "RemoveContainer" containerID="555549ec66ebd545c988c33add706930548b9150b829c8570fd386fbfff7396d"
Sep 15 13:04:44.849079 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.849062    2567 scope.go:117] "RemoveContainer" containerID="555549ec66ebd545c988c33add706930548b9150b829c8570fd386fbfff7396d"
Sep 15 13:04:44.849327 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:04:44.849308    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"555549ec66ebd545c988c33add706930548b9150b829c8570fd386fbfff7396d\": container with ID starting with 555549ec66ebd545c988c33add706930548b9150b829c8570fd386fbfff7396d not found: ID does not exist" containerID="555549ec66ebd545c988c33add706930548b9150b829c8570fd386fbfff7396d"
Sep 15 13:04:44.849394 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.849334    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"555549ec66ebd545c988c33add706930548b9150b829c8570fd386fbfff7396d"} err="failed to get container status \"555549ec66ebd545c988c33add706930548b9150b829c8570fd386fbfff7396d\": rpc error: code = NotFound desc = could not find container \"555549ec66ebd545c988c33add706930548b9150b829c8570fd386fbfff7396d\": container with ID starting with 555549ec66ebd545c988c33add706930548b9150b829c8570fd386fbfff7396d not found: ID does not exist"
Sep 15 13:04:44.861569 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.861544    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"]
Sep 15 13:04:44.864840 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:44.864820    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-08b44c/noten-model-08b44c-kserve-7bdf5b7899-c96tj"]
Sep 15 13:04:46.713817 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:04:46.713783    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b1af2ca-d556-403a-90c8-6acd03a58efd" path="/var/lib/kubelet/pods/5b1af2ca-d556-403a-90c8-6acd03a58efd/volumes"
Sep 15 13:05:03.080247 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.080211    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"]
Sep 15 13:05:03.080653 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.080585    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b1af2ca-d556-403a-90c8-6acd03a58efd" containerName="main"
Sep 15 13:05:03.080653 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.080595    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b1af2ca-d556-403a-90c8-6acd03a58efd" containerName="main"
Sep 15 13:05:03.080732 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.080663    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b1af2ca-d556-403a-90c8-6acd03a58efd" containerName="main"
Sep 15 13:05:03.084735 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.084713    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.087094 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.087070    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-2af9a3\"/\"openshift-service-ca.crt\""
Sep 15 13:05:03.087790 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.087771    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2af9a3\"/\"default-dockercfg-b2lfg\""
Sep 15 13:05:03.087966 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.087945    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-2af9a3\"/\"kube-root-ca.crt\""
Sep 15 13:05:03.088232 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.088212    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2af9a3\"/\"distinct-w4-2af9a3-kserve-self-signed-certs\""
Sep 15 13:05:03.094361 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.094338    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"]
Sep 15 13:05:03.209393 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.209342    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-model-cache\") pod \"distinct-w4-2af9a3-kserve-6648888d99-6smdn\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.209393 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.209400    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-tmp-dir\") pod \"distinct-w4-2af9a3-kserve-6648888d99-6smdn\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.209630 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.209477    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-home\") pod \"distinct-w4-2af9a3-kserve-6648888d99-6smdn\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.209630 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.209539    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-dshm\") pod \"distinct-w4-2af9a3-kserve-6648888d99-6smdn\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.209630 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.209582    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0708292-a278-492c-bade-b0863cff8f30-tls-certs\") pod \"distinct-w4-2af9a3-kserve-6648888d99-6smdn\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.209630 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.209619    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q6x4\" (UniqueName: \"kubernetes.io/projected/d0708292-a278-492c-bade-b0863cff8f30-kube-api-access-2q6x4\") pod \"distinct-w4-2af9a3-kserve-6648888d99-6smdn\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.310218 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.310176    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-dshm\") pod \"distinct-w4-2af9a3-kserve-6648888d99-6smdn\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.310434 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.310233    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0708292-a278-492c-bade-b0863cff8f30-tls-certs\") pod \"distinct-w4-2af9a3-kserve-6648888d99-6smdn\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.310434 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.310267    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q6x4\" (UniqueName: \"kubernetes.io/projected/d0708292-a278-492c-bade-b0863cff8f30-kube-api-access-2q6x4\") pod \"distinct-w4-2af9a3-kserve-6648888d99-6smdn\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.310434 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.310307    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-model-cache\") pod \"distinct-w4-2af9a3-kserve-6648888d99-6smdn\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.310434 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.310339    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-tmp-dir\") pod \"distinct-w4-2af9a3-kserve-6648888d99-6smdn\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.310434 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.310366    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-home\") pod \"distinct-w4-2af9a3-kserve-6648888d99-6smdn\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.310748 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.310722    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-model-cache\") pod \"distinct-w4-2af9a3-kserve-6648888d99-6smdn\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.310815 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.310748    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-home\") pod \"distinct-w4-2af9a3-kserve-6648888d99-6smdn\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.310815 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.310766    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-tmp-dir\") pod \"distinct-w4-2af9a3-kserve-6648888d99-6smdn\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.312652 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.312624    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-dshm\") pod \"distinct-w4-2af9a3-kserve-6648888d99-6smdn\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.312753 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.312743    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0708292-a278-492c-bade-b0863cff8f30-tls-certs\") pod \"distinct-w4-2af9a3-kserve-6648888d99-6smdn\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.320895 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.320876    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q6x4\" (UniqueName: \"kubernetes.io/projected/d0708292-a278-492c-bade-b0863cff8f30-kube-api-access-2q6x4\") pod \"distinct-w4-2af9a3-kserve-6648888d99-6smdn\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") " pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.394108 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.394003    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:03.669421 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.669383    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"]
Sep 15 13:05:03.671929 ip-10-0-129-48 kubenswrapper[2567]: W0915 13:05:03.671904    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0708292_a278_492c_bade_b0863cff8f30.slice/crio-8334c42ec14c842534b2bf257126caaec70c2e896cca607ae20eff339fb889cd WatchSource:0}: Error finding container 8334c42ec14c842534b2bf257126caaec70c2e896cca607ae20eff339fb889cd: Status 404 returned error can't find the container with id 8334c42ec14c842534b2bf257126caaec70c2e896cca607ae20eff339fb889cd
Sep 15 13:05:03.937778 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.937679    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn" event={"ID":"d0708292-a278-492c-bade-b0863cff8f30","Type":"ContainerStarted","Data":"3d9b17039981a179414db5eafdfcd0e4e6c9b3c0dd1777b35698a592c2f11222"}
Sep 15 13:05:03.937778 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.937725    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn" event={"ID":"d0708292-a278-492c-bade-b0863cff8f30","Type":"ContainerStarted","Data":"8334c42ec14c842534b2bf257126caaec70c2e896cca607ae20eff339fb889cd"}
Sep 15 13:05:03.957515 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:03.957454    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn" podStartSLOduration=0.957435091 podStartE2EDuration="957.435091ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:05:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:05:03.955562385 +0000 UTC m=+1207.676877927" watchObservedRunningTime="2026-09-15 13:05:03.957435091 +0000 UTC m=+1207.678750674"
Sep 15 13:05:13.394964 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:13.394924    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:13.395447 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:13.395002    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:13.407357 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:13.407334    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:05:13.999828 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:05:13.999800    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:08:24.767470 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:24.767429    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"]
Sep 15 13:08:24.771286 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:24.771261    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"
Sep 15 13:08:24.773834 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:24.773809    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-de540b29-serving-cert\""
Sep 15 13:08:24.780828 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:24.780763    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"]
Sep 15 13:08:24.804848 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:24.804812    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-maas-api-tls\") pod \"maas-api-e2e-mt-de540b29-5945db5488-dddsk\" (UID: \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"
Sep 15 13:08:24.805025 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:24.804875    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-metrics-certs\") pod \"maas-api-e2e-mt-de540b29-5945db5488-dddsk\" (UID: \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"
Sep 15 13:08:24.805025 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:24.804927    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-openshift-service-ca\") pod \"maas-api-e2e-mt-de540b29-5945db5488-dddsk\" (UID: \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"
Sep 15 13:08:24.805139 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:24.805078    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpmpz\" (UniqueName: \"kubernetes.io/projected/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-kube-api-access-vpmpz\") pod \"maas-api-e2e-mt-de540b29-5945db5488-dddsk\" (UID: \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"
Sep 15 13:08:24.905992 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:24.905935    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-maas-api-tls\") pod \"maas-api-e2e-mt-de540b29-5945db5488-dddsk\" (UID: \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"
Sep 15 13:08:24.905992 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:24.905994    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-metrics-certs\") pod \"maas-api-e2e-mt-de540b29-5945db5488-dddsk\" (UID: \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"
Sep 15 13:08:24.906229 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:24.906029    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-openshift-service-ca\") pod \"maas-api-e2e-mt-de540b29-5945db5488-dddsk\" (UID: \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"
Sep 15 13:08:24.906229 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:24.906087    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpmpz\" (UniqueName: \"kubernetes.io/projected/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-kube-api-access-vpmpz\") pod \"maas-api-e2e-mt-de540b29-5945db5488-dddsk\" (UID: \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"
Sep 15 13:08:24.906747 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:24.906718    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-openshift-service-ca\") pod \"maas-api-e2e-mt-de540b29-5945db5488-dddsk\" (UID: \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"
Sep 15 13:08:24.908368 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:24.908336    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-metrics-certs\") pod \"maas-api-e2e-mt-de540b29-5945db5488-dddsk\" (UID: \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"
Sep 15 13:08:24.908477 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:24.908386    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-maas-api-tls\") pod \"maas-api-e2e-mt-de540b29-5945db5488-dddsk\" (UID: \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"
Sep 15 13:08:24.913712 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:24.913687    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpmpz\" (UniqueName: \"kubernetes.io/projected/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-kube-api-access-vpmpz\") pod \"maas-api-e2e-mt-de540b29-5945db5488-dddsk\" (UID: \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"
Sep 15 13:08:25.084624 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:25.084535    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"
Sep 15 13:08:25.360079 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:25.360038    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"]
Sep 15 13:08:25.361750 ip-10-0-129-48 kubenswrapper[2567]: W0915 13:08:25.361725    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf92372be_ab2c_4b09_93f3_d2a9a3ce2d32.slice/crio-2dca34446f5a91f9a19be83638663ee0226b9b5d3ce724e9105fdb2c70718c2c WatchSource:0}: Error finding container 2dca34446f5a91f9a19be83638663ee0226b9b5d3ce724e9105fdb2c70718c2c: Status 404 returned error can't find the container with id 2dca34446f5a91f9a19be83638663ee0226b9b5d3ce724e9105fdb2c70718c2c
Sep 15 13:08:25.363221 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:25.363197    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 13:08:25.506637 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:25.506606    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw"]
Sep 15 13:08:25.511196 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:25.511178    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw"
Sep 15 13:08:25.513306 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:25.513280    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-de540b29\""
Sep 15 13:08:25.513450 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:25.513315    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-de540b29-dockercfg-29xwh\""
Sep 15 13:08:25.522071 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:25.522041    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw"]
Sep 15 13:08:25.612379 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:25.612262    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw9h4\" (UniqueName: \"kubernetes.io/projected/e01ad83c-0d1c-4528-a804-c6d13d9e71c6-kube-api-access-xw9h4\") pod \"payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw\" (UID: \"e01ad83c-0d1c-4528-a804-c6d13d9e71c6\") " pod="openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw"
Sep 15 13:08:25.612558 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:25.612468    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e01ad83c-0d1c-4528-a804-c6d13d9e71c6-plugins-config-volume\") pod \"payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw\" (UID: \"e01ad83c-0d1c-4528-a804-c6d13d9e71c6\") " pod="openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw"
Sep 15 13:08:25.713763 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:25.713721    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e01ad83c-0d1c-4528-a804-c6d13d9e71c6-plugins-config-volume\") pod \"payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw\" (UID: \"e01ad83c-0d1c-4528-a804-c6d13d9e71c6\") " pod="openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw"
Sep 15 13:08:25.713947 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:25.713795    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw9h4\" (UniqueName: \"kubernetes.io/projected/e01ad83c-0d1c-4528-a804-c6d13d9e71c6-kube-api-access-xw9h4\") pod \"payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw\" (UID: \"e01ad83c-0d1c-4528-a804-c6d13d9e71c6\") " pod="openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw"
Sep 15 13:08:25.714557 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:25.714535    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e01ad83c-0d1c-4528-a804-c6d13d9e71c6-plugins-config-volume\") pod \"payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw\" (UID: \"e01ad83c-0d1c-4528-a804-c6d13d9e71c6\") " pod="openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw"
Sep 15 13:08:25.722167 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:25.722135    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw9h4\" (UniqueName: \"kubernetes.io/projected/e01ad83c-0d1c-4528-a804-c6d13d9e71c6-kube-api-access-xw9h4\") pod \"payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw\" (UID: \"e01ad83c-0d1c-4528-a804-c6d13d9e71c6\") " pod="openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw"
Sep 15 13:08:25.823077 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:25.823029    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw"
Sep 15 13:08:25.908958 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:25.908927    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk" event={"ID":"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32","Type":"ContainerStarted","Data":"da3db15595d62885b1eaba000f3d0a264e892838035ee8e92d0c23cdc5658f6e"}
Sep 15 13:08:25.909116 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:25.908997    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk" event={"ID":"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32","Type":"ContainerStarted","Data":"2dca34446f5a91f9a19be83638663ee0226b9b5d3ce724e9105fdb2c70718c2c"}
Sep 15 13:08:25.926805 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:25.926747    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk" podStartSLOduration=1.547512848 podStartE2EDuration="1.926727467s" totalImagesPullingTime="379.214619ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:08:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:08:25.92493288 +0000 UTC m=+1409.646248412" watchObservedRunningTime="2026-09-15 13:08:25.926727467 +0000 UTC m=+1409.648043002"
Sep 15 13:08:26.095026 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:26.094995    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw"]
Sep 15 13:08:26.096864 ip-10-0-129-48 kubenswrapper[2567]: W0915 13:08:26.096833    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode01ad83c_0d1c_4528_a804_c6d13d9e71c6.slice/crio-af6cb1929638bd052d509480995f8e8270ef0b70c2142a8020624fd8560555e5 WatchSource:0}: Error finding container af6cb1929638bd052d509480995f8e8270ef0b70c2142a8020624fd8560555e5: Status 404 returned error can't find the container with id af6cb1929638bd052d509480995f8e8270ef0b70c2142a8020624fd8560555e5
Sep 15 13:08:26.914394 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:26.914355    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw" event={"ID":"e01ad83c-0d1c-4528-a804-c6d13d9e71c6","Type":"ContainerStarted","Data":"42aa37fa38d125743b20e6b2845cd37f283cba649fbef034214cd2e7cc3e8d6a"}
Sep 15 13:08:26.914804 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:26.914413    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw" event={"ID":"e01ad83c-0d1c-4528-a804-c6d13d9e71c6","Type":"ContainerStarted","Data":"af6cb1929638bd052d509480995f8e8270ef0b70c2142a8020624fd8560555e5"}
Sep 15 13:08:26.914804 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:26.914447    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw"
Sep 15 13:08:26.914804 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:26.914572    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"
Sep 15 13:08:26.931390 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:26.931340    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw" podStartSLOduration=1.931323272 podStartE2EDuration="1.931323272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:08:26.929907697 +0000 UTC m=+1410.651223227" watchObservedRunningTime="2026-09-15 13:08:26.931323272 +0000 UTC m=+1410.652638802"
Sep 15 13:08:32.925826 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:32.925795    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"
Sep 15 13:08:37.922773 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:08:37.922738    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw"
Sep 15 13:09:04.939424 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:04.939343    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"]
Sep 15 13:09:04.939968 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:04.939578    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk" podUID="f92372be-ab2c-4b09-93f3-d2a9a3ce2d32" containerName="maas-api" containerID="cri-o://da3db15595d62885b1eaba000f3d0a264e892838035ee8e92d0c23cdc5658f6e" gracePeriod=30
Sep 15 13:09:04.996384 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:04.996349    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw"]
Sep 15 13:09:04.996626 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:04.996572    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw" podUID="e01ad83c-0d1c-4528-a804-c6d13d9e71c6" containerName="payload-processing" containerID="cri-o://42aa37fa38d125743b20e6b2845cd37f283cba649fbef034214cd2e7cc3e8d6a" gracePeriod=30
Sep 15 13:09:05.106843 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.106703    2567 generic.go:356] "Generic (PLEG): container finished" podID="f92372be-ab2c-4b09-93f3-d2a9a3ce2d32" containerID="da3db15595d62885b1eaba000f3d0a264e892838035ee8e92d0c23cdc5658f6e" exitCode=0
Sep 15 13:09:05.106843 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.106758    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk" event={"ID":"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32","Type":"ContainerDied","Data":"da3db15595d62885b1eaba000f3d0a264e892838035ee8e92d0c23cdc5658f6e"}
Sep 15 13:09:05.244352 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.243703    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"
Sep 15 13:09:05.276952 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.276922    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw"
Sep 15 13:09:05.289189 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.289156    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpmpz\" (UniqueName: \"kubernetes.io/projected/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-kube-api-access-vpmpz\") pod \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\" (UID: \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\") "
Sep 15 13:09:05.289359 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.289221    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-metrics-certs\") pod \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\" (UID: \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\") "
Sep 15 13:09:05.289359 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.289255    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-openshift-service-ca\") pod \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\" (UID: \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\") "
Sep 15 13:09:05.289359 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.289296    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-maas-api-tls\") pod \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\" (UID: \"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32\") "
Sep 15 13:09:05.290074 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.290033    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f92372be-ab2c-4b09-93f3-d2a9a3ce2d32" (UID: "f92372be-ab2c-4b09-93f3-d2a9a3ce2d32"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:09:05.292227 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.292200    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-kube-api-access-vpmpz" (OuterVolumeSpecName: "kube-api-access-vpmpz") pod "f92372be-ab2c-4b09-93f3-d2a9a3ce2d32" (UID: "f92372be-ab2c-4b09-93f3-d2a9a3ce2d32"). InnerVolumeSpecName "kube-api-access-vpmpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:09:05.292382 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.292226    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f92372be-ab2c-4b09-93f3-d2a9a3ce2d32" (UID: "f92372be-ab2c-4b09-93f3-d2a9a3ce2d32"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:09:05.292382 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.292242    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f92372be-ab2c-4b09-93f3-d2a9a3ce2d32" (UID: "f92372be-ab2c-4b09-93f3-d2a9a3ce2d32"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:09:05.390701 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.390665    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e01ad83c-0d1c-4528-a804-c6d13d9e71c6-plugins-config-volume\") pod \"e01ad83c-0d1c-4528-a804-c6d13d9e71c6\" (UID: \"e01ad83c-0d1c-4528-a804-c6d13d9e71c6\") "
Sep 15 13:09:05.390863 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.390710    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xw9h4\" (UniqueName: \"kubernetes.io/projected/e01ad83c-0d1c-4528-a804-c6d13d9e71c6-kube-api-access-xw9h4\") pod \"e01ad83c-0d1c-4528-a804-c6d13d9e71c6\" (UID: \"e01ad83c-0d1c-4528-a804-c6d13d9e71c6\") "
Sep 15 13:09:05.390911 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.390901    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpmpz\" (UniqueName: \"kubernetes.io/projected/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-kube-api-access-vpmpz\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:09:05.390948 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.390914    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-metrics-certs\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:09:05.390948 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.390924    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-openshift-service-ca\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:09:05.390948 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.390932    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32-maas-api-tls\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:09:05.391163 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.391131    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e01ad83c-0d1c-4528-a804-c6d13d9e71c6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e01ad83c-0d1c-4528-a804-c6d13d9e71c6" (UID: "e01ad83c-0d1c-4528-a804-c6d13d9e71c6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:09:05.392761 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.392735    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e01ad83c-0d1c-4528-a804-c6d13d9e71c6-kube-api-access-xw9h4" (OuterVolumeSpecName: "kube-api-access-xw9h4") pod "e01ad83c-0d1c-4528-a804-c6d13d9e71c6" (UID: "e01ad83c-0d1c-4528-a804-c6d13d9e71c6"). InnerVolumeSpecName "kube-api-access-xw9h4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:09:05.492374 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.492294    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e01ad83c-0d1c-4528-a804-c6d13d9e71c6-plugins-config-volume\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:09:05.492374 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:05.492319    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xw9h4\" (UniqueName: \"kubernetes.io/projected/e01ad83c-0d1c-4528-a804-c6d13d9e71c6-kube-api-access-xw9h4\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:09:06.112922 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:06.112889    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"
Sep 15 13:09:06.113398 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:06.112895    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk" event={"ID":"f92372be-ab2c-4b09-93f3-d2a9a3ce2d32","Type":"ContainerDied","Data":"2dca34446f5a91f9a19be83638663ee0226b9b5d3ce724e9105fdb2c70718c2c"}
Sep 15 13:09:06.113398 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:06.113055    2567 scope.go:117] "RemoveContainer" containerID="da3db15595d62885b1eaba000f3d0a264e892838035ee8e92d0c23cdc5658f6e"
Sep 15 13:09:06.114495 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:06.114401    2567 generic.go:356] "Generic (PLEG): container finished" podID="e01ad83c-0d1c-4528-a804-c6d13d9e71c6" containerID="42aa37fa38d125743b20e6b2845cd37f283cba649fbef034214cd2e7cc3e8d6a" exitCode=0
Sep 15 13:09:06.114495 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:06.114437    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw"
Sep 15 13:09:06.114495 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:06.114481    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw" event={"ID":"e01ad83c-0d1c-4528-a804-c6d13d9e71c6","Type":"ContainerDied","Data":"42aa37fa38d125743b20e6b2845cd37f283cba649fbef034214cd2e7cc3e8d6a"}
Sep 15 13:09:06.114612 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:06.114531    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw" event={"ID":"e01ad83c-0d1c-4528-a804-c6d13d9e71c6","Type":"ContainerDied","Data":"af6cb1929638bd052d509480995f8e8270ef0b70c2142a8020624fd8560555e5"}
Sep 15 13:09:06.123025 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:06.122968    2567 scope.go:117] "RemoveContainer" containerID="42aa37fa38d125743b20e6b2845cd37f283cba649fbef034214cd2e7cc3e8d6a"
Sep 15 13:09:06.130754 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:06.130738    2567 scope.go:117] "RemoveContainer" containerID="42aa37fa38d125743b20e6b2845cd37f283cba649fbef034214cd2e7cc3e8d6a"
Sep 15 13:09:06.131034 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:09:06.131016    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42aa37fa38d125743b20e6b2845cd37f283cba649fbef034214cd2e7cc3e8d6a\": container with ID starting with 42aa37fa38d125743b20e6b2845cd37f283cba649fbef034214cd2e7cc3e8d6a not found: ID does not exist" containerID="42aa37fa38d125743b20e6b2845cd37f283cba649fbef034214cd2e7cc3e8d6a"
Sep 15 13:09:06.131090 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:06.131043    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42aa37fa38d125743b20e6b2845cd37f283cba649fbef034214cd2e7cc3e8d6a"} err="failed to get container status \"42aa37fa38d125743b20e6b2845cd37f283cba649fbef034214cd2e7cc3e8d6a\": rpc error: code = NotFound desc = could not find container \"42aa37fa38d125743b20e6b2845cd37f283cba649fbef034214cd2e7cc3e8d6a\": container with ID starting with 42aa37fa38d125743b20e6b2845cd37f283cba649fbef034214cd2e7cc3e8d6a not found: ID does not exist"
Sep 15 13:09:06.140757 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:06.140731    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"]
Sep 15 13:09:06.144522 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:06.144502    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-de540b29-5945db5488-dddsk"]
Sep 15 13:09:06.158103 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:06.158083    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw"]
Sep 15 13:09:06.164059 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:06.164039    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-de540b29-bdc46bf7-8znbw"]
Sep 15 13:09:06.714910 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:06.714879    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e01ad83c-0d1c-4528-a804-c6d13d9e71c6" path="/var/lib/kubelet/pods/e01ad83c-0d1c-4528-a804-c6d13d9e71c6/volumes"
Sep 15 13:09:06.715328 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:06.715313    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f92372be-ab2c-4b09-93f3-d2a9a3ce2d32" path="/var/lib/kubelet/pods/f92372be-ab2c-4b09-93f3-d2a9a3ce2d32/volumes"
Sep 15 13:09:32.163204 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.163172    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"]
Sep 15 13:09:32.163690 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.163599    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f92372be-ab2c-4b09-93f3-d2a9a3ce2d32" containerName="maas-api"
Sep 15 13:09:32.163690 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.163619    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f92372be-ab2c-4b09-93f3-d2a9a3ce2d32" containerName="maas-api"
Sep 15 13:09:32.163690 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.163634    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e01ad83c-0d1c-4528-a804-c6d13d9e71c6" containerName="payload-processing"
Sep 15 13:09:32.163690 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.163642    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e01ad83c-0d1c-4528-a804-c6d13d9e71c6" containerName="payload-processing"
Sep 15 13:09:32.163934 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.163747    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e01ad83c-0d1c-4528-a804-c6d13d9e71c6" containerName="payload-processing"
Sep 15 13:09:32.163934 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.163761    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f92372be-ab2c-4b09-93f3-d2a9a3ce2d32" containerName="maas-api"
Sep 15 13:09:32.167156 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.167137    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"
Sep 15 13:09:32.169289 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.169268    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-f6a966-serving-cert\""
Sep 15 13:09:32.179258 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.179233    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"]
Sep 15 13:09:32.338842 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.338804    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmtm9\" (UniqueName: \"kubernetes.io/projected/44024e3a-0553-4a26-b3d0-e498370c9c3e-kube-api-access-bmtm9\") pod \"maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8\" (UID: \"44024e3a-0553-4a26-b3d0-e498370c9c3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"
Sep 15 13:09:32.339062 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.338860    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44024e3a-0553-4a26-b3d0-e498370c9c3e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8\" (UID: \"44024e3a-0553-4a26-b3d0-e498370c9c3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"
Sep 15 13:09:32.339062 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.338911    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44024e3a-0553-4a26-b3d0-e498370c9c3e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8\" (UID: \"44024e3a-0553-4a26-b3d0-e498370c9c3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"
Sep 15 13:09:32.339062 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.339003    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44024e3a-0553-4a26-b3d0-e498370c9c3e-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8\" (UID: \"44024e3a-0553-4a26-b3d0-e498370c9c3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"
Sep 15 13:09:32.440258 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.440173    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmtm9\" (UniqueName: \"kubernetes.io/projected/44024e3a-0553-4a26-b3d0-e498370c9c3e-kube-api-access-bmtm9\") pod \"maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8\" (UID: \"44024e3a-0553-4a26-b3d0-e498370c9c3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"
Sep 15 13:09:32.440258 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.440228    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44024e3a-0553-4a26-b3d0-e498370c9c3e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8\" (UID: \"44024e3a-0553-4a26-b3d0-e498370c9c3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"
Sep 15 13:09:32.440492 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.440281    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44024e3a-0553-4a26-b3d0-e498370c9c3e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8\" (UID: \"44024e3a-0553-4a26-b3d0-e498370c9c3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"
Sep 15 13:09:32.440492 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.440315    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44024e3a-0553-4a26-b3d0-e498370c9c3e-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8\" (UID: \"44024e3a-0553-4a26-b3d0-e498370c9c3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"
Sep 15 13:09:32.441047 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.441013    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44024e3a-0553-4a26-b3d0-e498370c9c3e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8\" (UID: \"44024e3a-0553-4a26-b3d0-e498370c9c3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"
Sep 15 13:09:32.442745 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.442726    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44024e3a-0553-4a26-b3d0-e498370c9c3e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8\" (UID: \"44024e3a-0553-4a26-b3d0-e498370c9c3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"
Sep 15 13:09:32.442833 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.442791    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44024e3a-0553-4a26-b3d0-e498370c9c3e-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8\" (UID: \"44024e3a-0553-4a26-b3d0-e498370c9c3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"
Sep 15 13:09:32.448996 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.448952    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmtm9\" (UniqueName: \"kubernetes.io/projected/44024e3a-0553-4a26-b3d0-e498370c9c3e-kube-api-access-bmtm9\") pod \"maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8\" (UID: \"44024e3a-0553-4a26-b3d0-e498370c9c3e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"
Sep 15 13:09:32.477808 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.477788    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"
Sep 15 13:09:32.749874 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.749845    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"]
Sep 15 13:09:32.751753 ip-10-0-129-48 kubenswrapper[2567]: W0915 13:09:32.751725    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44024e3a_0553_4a26_b3d0_e498370c9c3e.slice/crio-e9f0f5a2601d08e62ca07df71a02a7b2ac4f91af10164022710e7ac9c42b8011 WatchSource:0}: Error finding container e9f0f5a2601d08e62ca07df71a02a7b2ac4f91af10164022710e7ac9c42b8011: Status 404 returned error can't find the container with id e9f0f5a2601d08e62ca07df71a02a7b2ac4f91af10164022710e7ac9c42b8011
Sep 15 13:09:32.792210 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.792180    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp"]
Sep 15 13:09:32.796573 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.796557    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp"
Sep 15 13:09:32.798997 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.798956    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-f6a966-dockercfg-j4mnh\""
Sep 15 13:09:32.799268 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.799239    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-f6a966\""
Sep 15 13:09:32.804718 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.804692    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp"]
Sep 15 13:09:32.945821 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.945787    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6ba9607-ec07-443a-9653-dfb5991fb7cd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp\" (UID: \"f6ba9607-ec07-443a-9653-dfb5991fb7cd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp"
Sep 15 13:09:32.946020 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:32.945865    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz9fd\" (UniqueName: \"kubernetes.io/projected/f6ba9607-ec07-443a-9653-dfb5991fb7cd-kube-api-access-fz9fd\") pod \"payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp\" (UID: \"f6ba9607-ec07-443a-9653-dfb5991fb7cd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp"
Sep 15 13:09:33.046762 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:33.046677    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6ba9607-ec07-443a-9653-dfb5991fb7cd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp\" (UID: \"f6ba9607-ec07-443a-9653-dfb5991fb7cd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp"
Sep 15 13:09:33.046762 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:33.046741    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz9fd\" (UniqueName: \"kubernetes.io/projected/f6ba9607-ec07-443a-9653-dfb5991fb7cd-kube-api-access-fz9fd\") pod \"payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp\" (UID: \"f6ba9607-ec07-443a-9653-dfb5991fb7cd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp"
Sep 15 13:09:33.047361 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:33.047338    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6ba9607-ec07-443a-9653-dfb5991fb7cd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp\" (UID: \"f6ba9607-ec07-443a-9653-dfb5991fb7cd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp"
Sep 15 13:09:33.054385 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:33.054367    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz9fd\" (UniqueName: \"kubernetes.io/projected/f6ba9607-ec07-443a-9653-dfb5991fb7cd-kube-api-access-fz9fd\") pod \"payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp\" (UID: \"f6ba9607-ec07-443a-9653-dfb5991fb7cd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp"
Sep 15 13:09:33.107969 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:33.107937    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp"
Sep 15 13:09:33.246228 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:33.246191    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8" event={"ID":"44024e3a-0553-4a26-b3d0-e498370c9c3e","Type":"ContainerStarted","Data":"e9f0f5a2601d08e62ca07df71a02a7b2ac4f91af10164022710e7ac9c42b8011"}
Sep 15 13:09:33.377900 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:33.377875    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp"]
Sep 15 13:09:33.379340 ip-10-0-129-48 kubenswrapper[2567]: W0915 13:09:33.379312    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6ba9607_ec07_443a_9653_dfb5991fb7cd.slice/crio-bc6b5548c46b59bd4347abd37a58da0e56d33969606d6d3a548641466131f91c WatchSource:0}: Error finding container bc6b5548c46b59bd4347abd37a58da0e56d33969606d6d3a548641466131f91c: Status 404 returned error can't find the container with id bc6b5548c46b59bd4347abd37a58da0e56d33969606d6d3a548641466131f91c
Sep 15 13:09:34.260948 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:34.260912    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp" event={"ID":"f6ba9607-ec07-443a-9653-dfb5991fb7cd","Type":"ContainerStarted","Data":"86d1ab9738c131fee182c5a2a664a14e5d06148720a162e5a9c1ede918cd3109"}
Sep 15 13:09:34.261431 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:34.261022    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp"
Sep 15 13:09:34.261431 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:34.261048    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp" event={"ID":"f6ba9607-ec07-443a-9653-dfb5991fb7cd","Type":"ContainerStarted","Data":"bc6b5548c46b59bd4347abd37a58da0e56d33969606d6d3a548641466131f91c"}
Sep 15 13:09:34.262623 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:34.262600    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8" event={"ID":"44024e3a-0553-4a26-b3d0-e498370c9c3e","Type":"ContainerStarted","Data":"9fcf732fd0f1b3c19e63de7fa4d0fbf69503cf7595ad6a061bd080776d360514"}
Sep 15 13:09:34.262753 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:34.262712    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"
Sep 15 13:09:34.279282 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:34.279232    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp" podStartSLOduration=2.279219433 podStartE2EDuration="2.279219433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:09:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:09:34.277246808 +0000 UTC m=+1477.998562330" watchObservedRunningTime="2026-09-15 13:09:34.279219433 +0000 UTC m=+1478.000534964"
Sep 15 13:09:34.295852 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:34.295813    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8" podStartSLOduration=1.765874119 podStartE2EDuration="2.295788117s" totalImagesPullingTime="529.913998ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:09:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:09:34.294398794 +0000 UTC m=+1478.015714324" watchObservedRunningTime="2026-09-15 13:09:34.295788117 +0000 UTC m=+1478.017103648"
Sep 15 13:09:40.272315 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:40.272284    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"
Sep 15 13:09:45.269715 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:09:45.269684    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp"
Sep 15 13:10:07.289266 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.289234    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"]
Sep 15 13:10:07.293574 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.293548    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"
Sep 15 13:10:07.295439 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.295411    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-ddd0eb-serving-cert\""
Sep 15 13:10:07.309011 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.308950    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"]
Sep 15 13:10:07.359777 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.359746    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f10f1187-1fca-45b6-be63-2ff25ddaea5e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n\" (UID: \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"
Sep 15 13:10:07.359926 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.359810    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f10f1187-1fca-45b6-be63-2ff25ddaea5e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n\" (UID: \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"
Sep 15 13:10:07.359926 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.359838    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f10f1187-1fca-45b6-be63-2ff25ddaea5e-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n\" (UID: \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"
Sep 15 13:10:07.359926 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.359863    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8fg9\" (UniqueName: \"kubernetes.io/projected/f10f1187-1fca-45b6-be63-2ff25ddaea5e-kube-api-access-g8fg9\") pod \"maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n\" (UID: \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"
Sep 15 13:10:07.460426 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.460399    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f10f1187-1fca-45b6-be63-2ff25ddaea5e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n\" (UID: \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"
Sep 15 13:10:07.460593 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.460441    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f10f1187-1fca-45b6-be63-2ff25ddaea5e-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n\" (UID: \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"
Sep 15 13:10:07.460593 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.460483    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8fg9\" (UniqueName: \"kubernetes.io/projected/f10f1187-1fca-45b6-be63-2ff25ddaea5e-kube-api-access-g8fg9\") pod \"maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n\" (UID: \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"
Sep 15 13:10:07.460593 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.460532    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f10f1187-1fca-45b6-be63-2ff25ddaea5e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n\" (UID: \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"
Sep 15 13:10:07.461089 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.461061    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f10f1187-1fca-45b6-be63-2ff25ddaea5e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n\" (UID: \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"
Sep 15 13:10:07.462876 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.462854    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f10f1187-1fca-45b6-be63-2ff25ddaea5e-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n\" (UID: \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"
Sep 15 13:10:07.462969 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.462894    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f10f1187-1fca-45b6-be63-2ff25ddaea5e-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n\" (UID: \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"
Sep 15 13:10:07.468750 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.468731    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8fg9\" (UniqueName: \"kubernetes.io/projected/f10f1187-1fca-45b6-be63-2ff25ddaea5e-kube-api-access-g8fg9\") pod \"maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n\" (UID: \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"
Sep 15 13:10:07.606142 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.606040    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"
Sep 15 13:10:07.882830 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.882801    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"]
Sep 15 13:10:07.884410 ip-10-0-129-48 kubenswrapper[2567]: W0915 13:10:07.884377    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf10f1187_1fca_45b6_be63_2ff25ddaea5e.slice/crio-9a8d32450c85ffda1b5d8bbcf97f1ab7b1ae11fc2721fe88c6b3f6a02c9ae0d9 WatchSource:0}: Error finding container 9a8d32450c85ffda1b5d8bbcf97f1ab7b1ae11fc2721fe88c6b3f6a02c9ae0d9: Status 404 returned error can't find the container with id 9a8d32450c85ffda1b5d8bbcf97f1ab7b1ae11fc2721fe88c6b3f6a02c9ae0d9
Sep 15 13:10:07.940934 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.940895    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz"]
Sep 15 13:10:07.945675 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.945653    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz"
Sep 15 13:10:07.947962 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.947944    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-ddd0eb-dockercfg-bbxrx\""
Sep 15 13:10:07.948163 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.948143    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-ddd0eb\""
Sep 15 13:10:07.956786 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:07.956764    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz"]
Sep 15 13:10:08.066565 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:08.066531    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18fb3772-b54e-4aef-9130-130b377cec29-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz\" (UID: \"18fb3772-b54e-4aef-9130-130b377cec29\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz"
Sep 15 13:10:08.066732 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:08.066600    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vr7c\" (UniqueName: \"kubernetes.io/projected/18fb3772-b54e-4aef-9130-130b377cec29-kube-api-access-9vr7c\") pod \"payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz\" (UID: \"18fb3772-b54e-4aef-9130-130b377cec29\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz"
Sep 15 13:10:08.167173 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:08.167140    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18fb3772-b54e-4aef-9130-130b377cec29-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz\" (UID: \"18fb3772-b54e-4aef-9130-130b377cec29\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz"
Sep 15 13:10:08.167323 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:08.167198    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vr7c\" (UniqueName: \"kubernetes.io/projected/18fb3772-b54e-4aef-9130-130b377cec29-kube-api-access-9vr7c\") pod \"payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz\" (UID: \"18fb3772-b54e-4aef-9130-130b377cec29\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz"
Sep 15 13:10:08.167822 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:08.167800    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18fb3772-b54e-4aef-9130-130b377cec29-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz\" (UID: \"18fb3772-b54e-4aef-9130-130b377cec29\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz"
Sep 15 13:10:08.174967 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:08.174944    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vr7c\" (UniqueName: \"kubernetes.io/projected/18fb3772-b54e-4aef-9130-130b377cec29-kube-api-access-9vr7c\") pod \"payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz\" (UID: \"18fb3772-b54e-4aef-9130-130b377cec29\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz"
Sep 15 13:10:08.256367 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:08.256336    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz"
Sep 15 13:10:08.433990 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:08.433902    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n" event={"ID":"f10f1187-1fca-45b6-be63-2ff25ddaea5e","Type":"ContainerStarted","Data":"cde530d92f17519b5580e7d86aa7c5730c419b85fa122cb3a1e6ed80e212037e"}
Sep 15 13:10:08.433990 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:08.433961    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n" event={"ID":"f10f1187-1fca-45b6-be63-2ff25ddaea5e","Type":"ContainerStarted","Data":"9a8d32450c85ffda1b5d8bbcf97f1ab7b1ae11fc2721fe88c6b3f6a02c9ae0d9"}
Sep 15 13:10:08.434426 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:08.434023    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"
Sep 15 13:10:08.455517 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:08.455463    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n" podStartSLOduration=0.998362484 podStartE2EDuration="1.455446338s" totalImagesPullingTime="457.083854ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:10:08.454485015 +0000 UTC m=+1512.175800546" watchObservedRunningTime="2026-09-15 13:10:08.455446338 +0000 UTC m=+1512.176761870"
Sep 15 13:10:08.528815 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:08.528785    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz"]
Sep 15 13:10:08.531292 ip-10-0-129-48 kubenswrapper[2567]: W0915 13:10:08.531264    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18fb3772_b54e_4aef_9130_130b377cec29.slice/crio-636127588b6969a8e8822d2c3dba6b2591f97a7c1dd72d6daaf7d8251dd3cf9a WatchSource:0}: Error finding container 636127588b6969a8e8822d2c3dba6b2591f97a7c1dd72d6daaf7d8251dd3cf9a: Status 404 returned error can't find the container with id 636127588b6969a8e8822d2c3dba6b2591f97a7c1dd72d6daaf7d8251dd3cf9a
Sep 15 13:10:09.441744 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:09.441702    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz" event={"ID":"18fb3772-b54e-4aef-9130-130b377cec29","Type":"ContainerStarted","Data":"6c7e3f6d3463787d8f0cd7f058b4997a7ed792e0894d1e1d0f2b83118522fb4c"}
Sep 15 13:10:09.442262 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:09.441770    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz" event={"ID":"18fb3772-b54e-4aef-9130-130b377cec29","Type":"ContainerStarted","Data":"636127588b6969a8e8822d2c3dba6b2591f97a7c1dd72d6daaf7d8251dd3cf9a"}
Sep 15 13:10:09.465058 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:09.465004    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz" podStartSLOduration=2.464988357 podStartE2EDuration="2.464988357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:10:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:10:09.463092013 +0000 UTC m=+1513.184407544" watchObservedRunningTime="2026-09-15 13:10:09.464988357 +0000 UTC m=+1513.186303879"
Sep 15 13:10:10.447029 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:10.447000    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz"
Sep 15 13:10:14.447121 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:14.447090    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"
Sep 15 13:10:21.454226 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:21.454147    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz"
Sep 15 13:10:35.695828 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:35.695784    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk"]
Sep 15 13:10:35.698458 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:35.698435    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk"
Sep 15 13:10:35.700936 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:35.700914    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-7e508e61-dockercfg-zj65g\""
Sep 15 13:10:35.701054 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:35.700955    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-7e508e61\""
Sep 15 13:10:35.713457 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:35.713433    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk"]
Sep 15 13:10:35.732937 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:35.732911    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77f913c0-b487-412b-acfd-62a46976f91a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk\" (UID: \"77f913c0-b487-412b-acfd-62a46976f91a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk"
Sep 15 13:10:35.733062 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:35.732951    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7gkv\" (UniqueName: \"kubernetes.io/projected/77f913c0-b487-412b-acfd-62a46976f91a-kube-api-access-v7gkv\") pod \"payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk\" (UID: \"77f913c0-b487-412b-acfd-62a46976f91a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk"
Sep 15 13:10:35.833684 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:35.833647    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77f913c0-b487-412b-acfd-62a46976f91a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk\" (UID: \"77f913c0-b487-412b-acfd-62a46976f91a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk"
Sep 15 13:10:35.833876 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:35.833726    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7gkv\" (UniqueName: \"kubernetes.io/projected/77f913c0-b487-412b-acfd-62a46976f91a-kube-api-access-v7gkv\") pod \"payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk\" (UID: \"77f913c0-b487-412b-acfd-62a46976f91a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk"
Sep 15 13:10:35.834345 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:35.834323    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77f913c0-b487-412b-acfd-62a46976f91a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk\" (UID: \"77f913c0-b487-412b-acfd-62a46976f91a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk"
Sep 15 13:10:35.842545 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:35.842516    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7gkv\" (UniqueName: \"kubernetes.io/projected/77f913c0-b487-412b-acfd-62a46976f91a-kube-api-access-v7gkv\") pod \"payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk\" (UID: \"77f913c0-b487-412b-acfd-62a46976f91a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk"
Sep 15 13:10:36.008135 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:36.008048    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk"
Sep 15 13:10:36.278468 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:36.278441    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk"]
Sep 15 13:10:36.280709 ip-10-0-129-48 kubenswrapper[2567]: W0915 13:10:36.280683    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77f913c0_b487_412b_acfd_62a46976f91a.slice/crio-a6b1eedf173a99ebb63ad4522f9b3edf7688b67b8f428ac5f552e80151672580 WatchSource:0}: Error finding container a6b1eedf173a99ebb63ad4522f9b3edf7688b67b8f428ac5f552e80151672580: Status 404 returned error can't find the container with id a6b1eedf173a99ebb63ad4522f9b3edf7688b67b8f428ac5f552e80151672580
Sep 15 13:10:36.589875 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:36.589792    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk" event={"ID":"77f913c0-b487-412b-acfd-62a46976f91a","Type":"ContainerStarted","Data":"4e2e851132bbbe06ce11364ab6bd87fd479bee241cc98bc79d715af76988ecbd"}
Sep 15 13:10:36.589875 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:36.589848    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk" event={"ID":"77f913c0-b487-412b-acfd-62a46976f91a","Type":"ContainerStarted","Data":"a6b1eedf173a99ebb63ad4522f9b3edf7688b67b8f428ac5f552e80151672580"}
Sep 15 13:10:36.589875 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:36.589873    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk"
Sep 15 13:10:36.608997 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:36.608924    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk" podStartSLOduration=1.608908046 podStartE2EDuration="1.608908046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:10:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:10:36.607818323 +0000 UTC m=+1540.329133857" watchObservedRunningTime="2026-09-15 13:10:36.608908046 +0000 UTC m=+1540.330223576"
Sep 15 13:10:47.597124 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:10:47.597088    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk"
Sep 15 13:13:31.455533 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:31.455451    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"]
Sep 15 13:13:46.475076 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.475031    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn" podUID="d0708292-a278-492c-bade-b0863cff8f30" containerName="main" containerID="cri-o://3d9b17039981a179414db5eafdfcd0e4e6c9b3c0dd1777b35698a592c2f11222" gracePeriod=45
Sep 15 13:13:46.722913 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.722887    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:13:46.762169 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.762084    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0708292-a278-492c-bade-b0863cff8f30-tls-certs\") pod \"d0708292-a278-492c-bade-b0863cff8f30\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") "
Sep 15 13:13:46.762169 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.762137    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-model-cache\") pod \"d0708292-a278-492c-bade-b0863cff8f30\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") "
Sep 15 13:13:46.762379 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.762205    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-dshm\") pod \"d0708292-a278-492c-bade-b0863cff8f30\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") "
Sep 15 13:13:46.762379 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.762232    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2q6x4\" (UniqueName: \"kubernetes.io/projected/d0708292-a278-492c-bade-b0863cff8f30-kube-api-access-2q6x4\") pod \"d0708292-a278-492c-bade-b0863cff8f30\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") "
Sep 15 13:13:46.762379 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.762263    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-tmp-dir\") pod \"d0708292-a278-492c-bade-b0863cff8f30\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") "
Sep 15 13:13:46.762379 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.762334    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-home\") pod \"d0708292-a278-492c-bade-b0863cff8f30\" (UID: \"d0708292-a278-492c-bade-b0863cff8f30\") "
Sep 15 13:13:46.762600 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.762464    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-model-cache" (OuterVolumeSpecName: "model-cache") pod "d0708292-a278-492c-bade-b0863cff8f30" (UID: "d0708292-a278-492c-bade-b0863cff8f30"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:13:46.762691 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.762669    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-model-cache\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:13:46.762759 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.762669    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-home" (OuterVolumeSpecName: "home") pod "d0708292-a278-492c-bade-b0863cff8f30" (UID: "d0708292-a278-492c-bade-b0863cff8f30"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:13:46.762759 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.762684    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d0708292-a278-492c-bade-b0863cff8f30" (UID: "d0708292-a278-492c-bade-b0863cff8f30"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:13:46.764424 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.764390    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0708292-a278-492c-bade-b0863cff8f30-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d0708292-a278-492c-bade-b0863cff8f30" (UID: "d0708292-a278-492c-bade-b0863cff8f30"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:13:46.764521 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.764497    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-dshm" (OuterVolumeSpecName: "dshm") pod "d0708292-a278-492c-bade-b0863cff8f30" (UID: "d0708292-a278-492c-bade-b0863cff8f30"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 13:13:46.765059 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.765033    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0708292-a278-492c-bade-b0863cff8f30-kube-api-access-2q6x4" (OuterVolumeSpecName: "kube-api-access-2q6x4") pod "d0708292-a278-492c-bade-b0863cff8f30" (UID: "d0708292-a278-492c-bade-b0863cff8f30"). InnerVolumeSpecName "kube-api-access-2q6x4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:13:46.863990 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.863939    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0708292-a278-492c-bade-b0863cff8f30-tls-certs\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:13:46.864144 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.864000    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-dshm\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:13:46.864144 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.864017    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q6x4\" (UniqueName: \"kubernetes.io/projected/d0708292-a278-492c-bade-b0863cff8f30-kube-api-access-2q6x4\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:13:46.864144 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.864031    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-tmp-dir\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:13:46.864144 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:46.864044    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0708292-a278-492c-bade-b0863cff8f30-home\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:13:47.553635 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:47.553594    2567 generic.go:356] "Generic (PLEG): container finished" podID="d0708292-a278-492c-bade-b0863cff8f30" containerID="3d9b17039981a179414db5eafdfcd0e4e6c9b3c0dd1777b35698a592c2f11222" exitCode=0
Sep 15 13:13:47.554090 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:47.553643    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"
Sep 15 13:13:47.554090 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:47.553678    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn" event={"ID":"d0708292-a278-492c-bade-b0863cff8f30","Type":"ContainerDied","Data":"3d9b17039981a179414db5eafdfcd0e4e6c9b3c0dd1777b35698a592c2f11222"}
Sep 15 13:13:47.554090 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:47.553726    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn" event={"ID":"d0708292-a278-492c-bade-b0863cff8f30","Type":"ContainerDied","Data":"8334c42ec14c842534b2bf257126caaec70c2e896cca607ae20eff339fb889cd"}
Sep 15 13:13:47.554090 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:47.553743    2567 scope.go:117] "RemoveContainer" containerID="3d9b17039981a179414db5eafdfcd0e4e6c9b3c0dd1777b35698a592c2f11222"
Sep 15 13:13:47.565411 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:47.565391    2567 scope.go:117] "RemoveContainer" containerID="3d9b17039981a179414db5eafdfcd0e4e6c9b3c0dd1777b35698a592c2f11222"
Sep 15 13:13:47.565694 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:13:47.565677    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d9b17039981a179414db5eafdfcd0e4e6c9b3c0dd1777b35698a592c2f11222\": container with ID starting with 3d9b17039981a179414db5eafdfcd0e4e6c9b3c0dd1777b35698a592c2f11222 not found: ID does not exist" containerID="3d9b17039981a179414db5eafdfcd0e4e6c9b3c0dd1777b35698a592c2f11222"
Sep 15 13:13:47.565741 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:47.565701    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d9b17039981a179414db5eafdfcd0e4e6c9b3c0dd1777b35698a592c2f11222"} err="failed to get container status \"3d9b17039981a179414db5eafdfcd0e4e6c9b3c0dd1777b35698a592c2f11222\": rpc error: code = NotFound desc = could not find container \"3d9b17039981a179414db5eafdfcd0e4e6c9b3c0dd1777b35698a592c2f11222\": container with ID starting with 3d9b17039981a179414db5eafdfcd0e4e6c9b3c0dd1777b35698a592c2f11222 not found: ID does not exist"
Sep 15 13:13:47.574051 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:47.574028    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"]
Sep 15 13:13:47.578113 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:47.578092    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-2af9a3/distinct-w4-2af9a3-kserve-6648888d99-6smdn"]
Sep 15 13:13:48.713559 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:13:48.713526    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0708292-a278-492c-bade-b0863cff8f30" path="/var/lib/kubelet/pods/d0708292-a278-492c-bade-b0863cff8f30/volumes"
Sep 15 13:15:04.109931 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:04.109896    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk"]
Sep 15 13:15:04.110412 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:04.110166    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk" podUID="77f913c0-b487-412b-acfd-62a46976f91a" containerName="payload-pre-processing" containerID="cri-o://4e2e851132bbbe06ce11364ab6bd87fd479bee241cc98bc79d715af76988ecbd" gracePeriod=30
Sep 15 13:15:04.376192 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:04.376117    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk"
Sep 15 13:15:04.485805 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:04.485764    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7gkv\" (UniqueName: \"kubernetes.io/projected/77f913c0-b487-412b-acfd-62a46976f91a-kube-api-access-v7gkv\") pod \"77f913c0-b487-412b-acfd-62a46976f91a\" (UID: \"77f913c0-b487-412b-acfd-62a46976f91a\") "
Sep 15 13:15:04.485805 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:04.485811    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77f913c0-b487-412b-acfd-62a46976f91a-plugins-config-volume\") pod \"77f913c0-b487-412b-acfd-62a46976f91a\" (UID: \"77f913c0-b487-412b-acfd-62a46976f91a\") "
Sep 15 13:15:04.486244 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:04.486205    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77f913c0-b487-412b-acfd-62a46976f91a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "77f913c0-b487-412b-acfd-62a46976f91a" (UID: "77f913c0-b487-412b-acfd-62a46976f91a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:15:04.487846 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:04.487827    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77f913c0-b487-412b-acfd-62a46976f91a-kube-api-access-v7gkv" (OuterVolumeSpecName: "kube-api-access-v7gkv") pod "77f913c0-b487-412b-acfd-62a46976f91a" (UID: "77f913c0-b487-412b-acfd-62a46976f91a"). InnerVolumeSpecName "kube-api-access-v7gkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:15:04.586966 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:04.586929    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7gkv\" (UniqueName: \"kubernetes.io/projected/77f913c0-b487-412b-acfd-62a46976f91a-kube-api-access-v7gkv\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:15:04.586966 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:04.586958    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/77f913c0-b487-412b-acfd-62a46976f91a-plugins-config-volume\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:15:04.954958 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:04.954928    2567 generic.go:356] "Generic (PLEG): container finished" podID="77f913c0-b487-412b-acfd-62a46976f91a" containerID="4e2e851132bbbe06ce11364ab6bd87fd479bee241cc98bc79d715af76988ecbd" exitCode=0
Sep 15 13:15:04.955140 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:04.954990    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk"
Sep 15 13:15:04.955140 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:04.955005    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk" event={"ID":"77f913c0-b487-412b-acfd-62a46976f91a","Type":"ContainerDied","Data":"4e2e851132bbbe06ce11364ab6bd87fd479bee241cc98bc79d715af76988ecbd"}
Sep 15 13:15:04.955140 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:04.955072    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk" event={"ID":"77f913c0-b487-412b-acfd-62a46976f91a","Type":"ContainerDied","Data":"a6b1eedf173a99ebb63ad4522f9b3edf7688b67b8f428ac5f552e80151672580"}
Sep 15 13:15:04.955140 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:04.955098    2567 scope.go:117] "RemoveContainer" containerID="4e2e851132bbbe06ce11364ab6bd87fd479bee241cc98bc79d715af76988ecbd"
Sep 15 13:15:04.964058 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:04.964038    2567 scope.go:117] "RemoveContainer" containerID="4e2e851132bbbe06ce11364ab6bd87fd479bee241cc98bc79d715af76988ecbd"
Sep 15 13:15:04.964392 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:15:04.964364    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e2e851132bbbe06ce11364ab6bd87fd479bee241cc98bc79d715af76988ecbd\": container with ID starting with 4e2e851132bbbe06ce11364ab6bd87fd479bee241cc98bc79d715af76988ecbd not found: ID does not exist" containerID="4e2e851132bbbe06ce11364ab6bd87fd479bee241cc98bc79d715af76988ecbd"
Sep 15 13:15:04.964509 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:04.964398    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e2e851132bbbe06ce11364ab6bd87fd479bee241cc98bc79d715af76988ecbd"} err="failed to get container status \"4e2e851132bbbe06ce11364ab6bd87fd479bee241cc98bc79d715af76988ecbd\": rpc error: code = NotFound desc = could not find container \"4e2e851132bbbe06ce11364ab6bd87fd479bee241cc98bc79d715af76988ecbd\": container with ID starting with 4e2e851132bbbe06ce11364ab6bd87fd479bee241cc98bc79d715af76988ecbd not found: ID does not exist"
Sep 15 13:15:04.970907 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:04.970877    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk"]
Sep 15 13:15:04.975448 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:04.975392    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7e508e61-855859866b-g68zk"]
Sep 15 13:15:06.713290 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:06.713251    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77f913c0-b487-412b-acfd-62a46976f91a" path="/var/lib/kubelet/pods/77f913c0-b487-412b-acfd-62a46976f91a/volumes"
Sep 15 13:15:14.138808 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.138775    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"]
Sep 15 13:15:14.139247 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.139232    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f913c0-b487-412b-acfd-62a46976f91a" containerName="payload-pre-processing"
Sep 15 13:15:14.139342 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.139249    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f913c0-b487-412b-acfd-62a46976f91a" containerName="payload-pre-processing"
Sep 15 13:15:14.139342 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.139259    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0708292-a278-492c-bade-b0863cff8f30" containerName="main"
Sep 15 13:15:14.139342 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.139264    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0708292-a278-492c-bade-b0863cff8f30" containerName="main"
Sep 15 13:15:14.139342 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.139338    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0708292-a278-492c-bade-b0863cff8f30" containerName="main"
Sep 15 13:15:14.139560 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.139356    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="77f913c0-b487-412b-acfd-62a46976f91a" containerName="payload-pre-processing"
Sep 15 13:15:14.144441 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.144422    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:15:14.146418 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.146395    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-38d90f-serving-cert\""
Sep 15 13:15:14.152814 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.152448    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"]
Sep 15 13:15:14.177922 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.177895    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkrnp\" (UniqueName: \"kubernetes.io/projected/f03c436d-11fe-4858-b6fb-bc98b0c970f8-kube-api-access-rkrnp\") pod \"maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r\" (UID: \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:15:14.178087 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.178028    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03c436d-11fe-4858-b6fb-bc98b0c970f8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r\" (UID: \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:15:14.178087 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.178078    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f03c436d-11fe-4858-b6fb-bc98b0c970f8-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r\" (UID: \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:15:14.178184 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.178136    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f03c436d-11fe-4858-b6fb-bc98b0c970f8-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r\" (UID: \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:15:14.279375 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.279315    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03c436d-11fe-4858-b6fb-bc98b0c970f8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r\" (UID: \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:15:14.279562 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.279428    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f03c436d-11fe-4858-b6fb-bc98b0c970f8-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r\" (UID: \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:15:14.279562 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.279483    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f03c436d-11fe-4858-b6fb-bc98b0c970f8-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r\" (UID: \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:15:14.279686 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.279549    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkrnp\" (UniqueName: \"kubernetes.io/projected/f03c436d-11fe-4858-b6fb-bc98b0c970f8-kube-api-access-rkrnp\") pod \"maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r\" (UID: \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:15:14.279745 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:15:14.279706    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-serving-cert: secret "maas-api-e2e-shared-b-w3-38d90f-serving-cert" not found
Sep 15 13:15:14.279799 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:15:14.279785    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03c436d-11fe-4858-b6fb-bc98b0c970f8-maas-api-tls podName:f03c436d-11fe-4858-b6fb-bc98b0c970f8 nodeName:}" failed. No retries permitted until 2026-09-15 13:15:14.779764384 +0000 UTC m=+1818.501079897 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f03c436d-11fe-4858-b6fb-bc98b0c970f8-maas-api-tls") pod "maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r" (UID: "f03c436d-11fe-4858-b6fb-bc98b0c970f8") : secret "maas-api-e2e-shared-b-w3-38d90f-serving-cert" not found
Sep 15 13:15:14.280157 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.280132    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03c436d-11fe-4858-b6fb-bc98b0c970f8-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r\" (UID: \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:15:14.281991 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.281959    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f03c436d-11fe-4858-b6fb-bc98b0c970f8-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r\" (UID: \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:15:14.289892 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.289871    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkrnp\" (UniqueName: \"kubernetes.io/projected/f03c436d-11fe-4858-b6fb-bc98b0c970f8-kube-api-access-rkrnp\") pod \"maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r\" (UID: \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:15:14.784066 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:14.784022    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f03c436d-11fe-4858-b6fb-bc98b0c970f8-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r\" (UID: \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:15:14.784217 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:15:14.784162    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-serving-cert: secret "maas-api-e2e-shared-b-w3-38d90f-serving-cert" not found
Sep 15 13:15:14.784276 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:15:14.784228    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f03c436d-11fe-4858-b6fb-bc98b0c970f8-maas-api-tls podName:f03c436d-11fe-4858-b6fb-bc98b0c970f8 nodeName:}" failed. No retries permitted until 2026-09-15 13:15:15.784211701 +0000 UTC m=+1819.505527220 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f03c436d-11fe-4858-b6fb-bc98b0c970f8-maas-api-tls") pod "maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r" (UID: "f03c436d-11fe-4858-b6fb-bc98b0c970f8") : secret "maas-api-e2e-shared-b-w3-38d90f-serving-cert" not found
Sep 15 13:15:15.792848 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:15.792761    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f03c436d-11fe-4858-b6fb-bc98b0c970f8-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r\" (UID: \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:15:15.795129 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:15.795098    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f03c436d-11fe-4858-b6fb-bc98b0c970f8-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r\" (UID: \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:15:15.957298 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:15.957261    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:15:16.229566 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:16.229541    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"]
Sep 15 13:15:16.232185 ip-10-0-129-48 kubenswrapper[2567]: W0915 13:15:16.232160    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03c436d_11fe_4858_b6fb_bc98b0c970f8.slice/crio-e93eaec48c36e4be105cc3544adb73c16f3bccad0fdc97cd4424f9715a9b291b WatchSource:0}: Error finding container e93eaec48c36e4be105cc3544adb73c16f3bccad0fdc97cd4424f9715a9b291b: Status 404 returned error can't find the container with id e93eaec48c36e4be105cc3544adb73c16f3bccad0fdc97cd4424f9715a9b291b
Sep 15 13:15:16.233666 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:16.233644    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 13:15:17.022050 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:17.022016    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r" event={"ID":"f03c436d-11fe-4858-b6fb-bc98b0c970f8","Type":"ContainerStarted","Data":"e2d31215cd7caaa9f80a334923c90a12beb0d54ae601b9b8d14aa41d0e8010c9"}
Sep 15 13:15:17.022418 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:17.022071    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r" event={"ID":"f03c436d-11fe-4858-b6fb-bc98b0c970f8","Type":"ContainerStarted","Data":"e93eaec48c36e4be105cc3544adb73c16f3bccad0fdc97cd4424f9715a9b291b"}
Sep 15 13:15:17.022418 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:17.022099    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:15:17.048531 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:17.048481    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r" podStartSLOduration=2.637501204 podStartE2EDuration="3.048462368s" totalImagesPullingTime="410.961164ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:15:17.04536697 +0000 UTC m=+1820.766682497" watchObservedRunningTime="2026-09-15 13:15:17.048462368 +0000 UTC m=+1820.769777899"
Sep 15 13:15:23.032594 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:15:23.032564    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:21:54.195411 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.195369    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb"]
Sep 15 13:21:54.199237 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.199213    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb"
Sep 15 13:21:54.201601 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.201571    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-650c57\""
Sep 15 13:21:54.201718 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.201679    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-650c57-dockercfg-x8nzf\""
Sep 15 13:21:54.211065 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.211043    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb"]
Sep 15 13:21:54.234654 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.234601    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck"]
Sep 15 13:21:54.239010 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.238987    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck"
Sep 15 13:21:54.239555 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.239529    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwcvs\" (UniqueName: \"kubernetes.io/projected/21148530-38e9-40a7-9468-ea21cf492e29-kube-api-access-fwcvs\") pod \"payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb\" (UID: \"21148530-38e9-40a7-9468-ea21cf492e29\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb"
Sep 15 13:21:54.239633 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.239573    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21148530-38e9-40a7-9468-ea21cf492e29-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb\" (UID: \"21148530-38e9-40a7-9468-ea21cf492e29\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb"
Sep 15 13:21:54.249873 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.249848    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck"]
Sep 15 13:21:54.340921 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.340868    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwcvs\" (UniqueName: \"kubernetes.io/projected/21148530-38e9-40a7-9468-ea21cf492e29-kube-api-access-fwcvs\") pod \"payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb\" (UID: \"21148530-38e9-40a7-9468-ea21cf492e29\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb"
Sep 15 13:21:54.341380 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.340947    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21148530-38e9-40a7-9468-ea21cf492e29-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb\" (UID: \"21148530-38e9-40a7-9468-ea21cf492e29\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb"
Sep 15 13:21:54.341780 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.341524    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2ba133e-6814-4f46-8cca-3dc713b4fdfb-plugins-config-volume\") pod \"payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck\" (UID: \"d2ba133e-6814-4f46-8cca-3dc713b4fdfb\") " pod="openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck"
Sep 15 13:21:54.341780 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.341593    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxjcx\" (UniqueName: \"kubernetes.io/projected/d2ba133e-6814-4f46-8cca-3dc713b4fdfb-kube-api-access-bxjcx\") pod \"payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck\" (UID: \"d2ba133e-6814-4f46-8cca-3dc713b4fdfb\") " pod="openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck"
Sep 15 13:21:54.342007 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.341857    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21148530-38e9-40a7-9468-ea21cf492e29-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb\" (UID: \"21148530-38e9-40a7-9468-ea21cf492e29\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb"
Sep 15 13:21:54.349230 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.349204    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwcvs\" (UniqueName: \"kubernetes.io/projected/21148530-38e9-40a7-9468-ea21cf492e29-kube-api-access-fwcvs\") pod \"payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb\" (UID: \"21148530-38e9-40a7-9468-ea21cf492e29\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb"
Sep 15 13:21:54.442542 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.442505    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2ba133e-6814-4f46-8cca-3dc713b4fdfb-plugins-config-volume\") pod \"payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck\" (UID: \"d2ba133e-6814-4f46-8cca-3dc713b4fdfb\") " pod="openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck"
Sep 15 13:21:54.442758 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.442556    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxjcx\" (UniqueName: \"kubernetes.io/projected/d2ba133e-6814-4f46-8cca-3dc713b4fdfb-kube-api-access-bxjcx\") pod \"payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck\" (UID: \"d2ba133e-6814-4f46-8cca-3dc713b4fdfb\") " pod="openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck"
Sep 15 13:21:54.443482 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.443456    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2ba133e-6814-4f46-8cca-3dc713b4fdfb-plugins-config-volume\") pod \"payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck\" (UID: \"d2ba133e-6814-4f46-8cca-3dc713b4fdfb\") " pod="openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck"
Sep 15 13:21:54.450421 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.450354    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxjcx\" (UniqueName: \"kubernetes.io/projected/d2ba133e-6814-4f46-8cca-3dc713b4fdfb-kube-api-access-bxjcx\") pod \"payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck\" (UID: \"d2ba133e-6814-4f46-8cca-3dc713b4fdfb\") " pod="openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck"
Sep 15 13:21:54.510918 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.510885    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb"
Sep 15 13:21:54.551665 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.551622    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck"
Sep 15 13:21:54.788572 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.788545    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb"]
Sep 15 13:21:54.790003 ip-10-0-129-48 kubenswrapper[2567]: W0915 13:21:54.789960    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21148530_38e9_40a7_9468_ea21cf492e29.slice/crio-bbf5ce7b460d0657f3e7e4ee4d9ca4fdb5091f298ebadea8525aac638a0d058c WatchSource:0}: Error finding container bbf5ce7b460d0657f3e7e4ee4d9ca4fdb5091f298ebadea8525aac638a0d058c: Status 404 returned error can't find the container with id bbf5ce7b460d0657f3e7e4ee4d9ca4fdb5091f298ebadea8525aac638a0d058c
Sep 15 13:21:54.836682 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:54.836653    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck"]
Sep 15 13:21:54.839294 ip-10-0-129-48 kubenswrapper[2567]: W0915 13:21:54.839092    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ba133e_6814_4f46_8cca_3dc713b4fdfb.slice/crio-99cf82e9e14bd288c3c38e5e00a9eff553bbaccf9551c2fd9a3a2f4c67148958 WatchSource:0}: Error finding container 99cf82e9e14bd288c3c38e5e00a9eff553bbaccf9551c2fd9a3a2f4c67148958: Status 404 returned error can't find the container with id 99cf82e9e14bd288c3c38e5e00a9eff553bbaccf9551c2fd9a3a2f4c67148958
Sep 15 13:21:55.006750 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:55.006706    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb" event={"ID":"21148530-38e9-40a7-9468-ea21cf492e29","Type":"ContainerStarted","Data":"a69e6f9aaafd7023811a03888424eee054ec9da7f02d8ef1192f4c7eaafc2787"}
Sep 15 13:21:55.006951 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:55.006767    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb" event={"ID":"21148530-38e9-40a7-9468-ea21cf492e29","Type":"ContainerStarted","Data":"bbf5ce7b460d0657f3e7e4ee4d9ca4fdb5091f298ebadea8525aac638a0d058c"}
Sep 15 13:21:55.006951 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:55.006794    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb"
Sep 15 13:21:55.008418 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:55.008396    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck" event={"ID":"d2ba133e-6814-4f46-8cca-3dc713b4fdfb","Type":"ContainerStarted","Data":"d326c301602dd23ea7f89d16a9a9b166c97baf10c29825360d560191836c2653"}
Sep 15 13:21:55.008535 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:55.008433    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck" event={"ID":"d2ba133e-6814-4f46-8cca-3dc713b4fdfb","Type":"ContainerStarted","Data":"99cf82e9e14bd288c3c38e5e00a9eff553bbaccf9551c2fd9a3a2f4c67148958"}
Sep 15 13:21:55.008535 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:55.008511    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck"
Sep 15 13:21:55.026235 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:55.026180    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb" podStartSLOduration=1.026164757 podStartE2EDuration="1.026164757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:21:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:21:55.023335959 +0000 UTC m=+2218.744651489" watchObservedRunningTime="2026-09-15 13:21:55.026164757 +0000 UTC m=+2218.747480287"
Sep 15 13:21:55.041031 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:21:55.040919    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck" podStartSLOduration=1.040903028 podStartE2EDuration="1.040903028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 13:21:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:21:55.040026987 +0000 UTC m=+2218.761342519" watchObservedRunningTime="2026-09-15 13:21:55.040903028 +0000 UTC m=+2218.762218562"
Sep 15 13:22:06.017438 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:06.017403    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck"
Sep 15 13:22:06.017907 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:06.017841    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb"
Sep 15 13:22:52.406572 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:52.406474    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck"]
Sep 15 13:22:52.409118 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:52.406742    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck" podUID="d2ba133e-6814-4f46-8cca-3dc713b4fdfb" containerName="payload-processing" containerID="cri-o://d326c301602dd23ea7f89d16a9a9b166c97baf10c29825360d560191836c2653" gracePeriod=30
Sep 15 13:22:52.412558 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:52.412429    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb"]
Sep 15 13:22:52.412749 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:52.412674    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb" podUID="21148530-38e9-40a7-9468-ea21cf492e29" containerName="payload-pre-processing" containerID="cri-o://a69e6f9aaafd7023811a03888424eee054ec9da7f02d8ef1192f4c7eaafc2787" gracePeriod=30
Sep 15 13:22:52.705922 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:52.705896    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck"
Sep 15 13:22:52.710117 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:52.710089    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb"
Sep 15 13:22:52.817500 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:52.817460    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwcvs\" (UniqueName: \"kubernetes.io/projected/21148530-38e9-40a7-9468-ea21cf492e29-kube-api-access-fwcvs\") pod \"21148530-38e9-40a7-9468-ea21cf492e29\" (UID: \"21148530-38e9-40a7-9468-ea21cf492e29\") "
Sep 15 13:22:52.817691 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:52.817519    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2ba133e-6814-4f46-8cca-3dc713b4fdfb-plugins-config-volume\") pod \"d2ba133e-6814-4f46-8cca-3dc713b4fdfb\" (UID: \"d2ba133e-6814-4f46-8cca-3dc713b4fdfb\") "
Sep 15 13:22:52.817691 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:52.817562    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxjcx\" (UniqueName: \"kubernetes.io/projected/d2ba133e-6814-4f46-8cca-3dc713b4fdfb-kube-api-access-bxjcx\") pod \"d2ba133e-6814-4f46-8cca-3dc713b4fdfb\" (UID: \"d2ba133e-6814-4f46-8cca-3dc713b4fdfb\") "
Sep 15 13:22:52.817691 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:52.817630    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21148530-38e9-40a7-9468-ea21cf492e29-plugins-config-volume\") pod \"21148530-38e9-40a7-9468-ea21cf492e29\" (UID: \"21148530-38e9-40a7-9468-ea21cf492e29\") "
Sep 15 13:22:52.818328 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:52.817954    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2ba133e-6814-4f46-8cca-3dc713b4fdfb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d2ba133e-6814-4f46-8cca-3dc713b4fdfb" (UID: "d2ba133e-6814-4f46-8cca-3dc713b4fdfb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:22:52.818328 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:52.818084    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21148530-38e9-40a7-9468-ea21cf492e29-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "21148530-38e9-40a7-9468-ea21cf492e29" (UID: "21148530-38e9-40a7-9468-ea21cf492e29"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:22:52.818611 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:52.818481    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21148530-38e9-40a7-9468-ea21cf492e29-plugins-config-volume\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:22:52.818611 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:52.818509    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2ba133e-6814-4f46-8cca-3dc713b4fdfb-plugins-config-volume\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:22:52.819832 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:52.819798    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21148530-38e9-40a7-9468-ea21cf492e29-kube-api-access-fwcvs" (OuterVolumeSpecName: "kube-api-access-fwcvs") pod "21148530-38e9-40a7-9468-ea21cf492e29" (UID: "21148530-38e9-40a7-9468-ea21cf492e29"). InnerVolumeSpecName "kube-api-access-fwcvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:22:52.819926 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:52.819859    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2ba133e-6814-4f46-8cca-3dc713b4fdfb-kube-api-access-bxjcx" (OuterVolumeSpecName: "kube-api-access-bxjcx") pod "d2ba133e-6814-4f46-8cca-3dc713b4fdfb" (UID: "d2ba133e-6814-4f46-8cca-3dc713b4fdfb"). InnerVolumeSpecName "kube-api-access-bxjcx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:22:52.919848 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:52.919804    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxjcx\" (UniqueName: \"kubernetes.io/projected/d2ba133e-6814-4f46-8cca-3dc713b4fdfb-kube-api-access-bxjcx\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:22:52.919848 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:52.919844    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwcvs\" (UniqueName: \"kubernetes.io/projected/21148530-38e9-40a7-9468-ea21cf492e29-kube-api-access-fwcvs\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:22:53.309280 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:53.309242    2567 generic.go:356] "Generic (PLEG): container finished" podID="d2ba133e-6814-4f46-8cca-3dc713b4fdfb" containerID="d326c301602dd23ea7f89d16a9a9b166c97baf10c29825360d560191836c2653" exitCode=0
Sep 15 13:22:53.309504 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:53.309293    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck"
Sep 15 13:22:53.309504 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:53.309337    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck" event={"ID":"d2ba133e-6814-4f46-8cca-3dc713b4fdfb","Type":"ContainerDied","Data":"d326c301602dd23ea7f89d16a9a9b166c97baf10c29825360d560191836c2653"}
Sep 15 13:22:53.309504 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:53.309394    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck" event={"ID":"d2ba133e-6814-4f46-8cca-3dc713b4fdfb","Type":"ContainerDied","Data":"99cf82e9e14bd288c3c38e5e00a9eff553bbaccf9551c2fd9a3a2f4c67148958"}
Sep 15 13:22:53.309504 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:53.309425    2567 scope.go:117] "RemoveContainer" containerID="d326c301602dd23ea7f89d16a9a9b166c97baf10c29825360d560191836c2653"
Sep 15 13:22:53.310671 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:53.310650    2567 generic.go:356] "Generic (PLEG): container finished" podID="21148530-38e9-40a7-9468-ea21cf492e29" containerID="a69e6f9aaafd7023811a03888424eee054ec9da7f02d8ef1192f4c7eaafc2787" exitCode=0
Sep 15 13:22:53.310744 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:53.310684    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb"
Sep 15 13:22:53.310744 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:53.310729    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb" event={"ID":"21148530-38e9-40a7-9468-ea21cf492e29","Type":"ContainerDied","Data":"a69e6f9aaafd7023811a03888424eee054ec9da7f02d8ef1192f4c7eaafc2787"}
Sep 15 13:22:53.310863 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:53.310772    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb" event={"ID":"21148530-38e9-40a7-9468-ea21cf492e29","Type":"ContainerDied","Data":"bbf5ce7b460d0657f3e7e4ee4d9ca4fdb5091f298ebadea8525aac638a0d058c"}
Sep 15 13:22:53.321730 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:53.321604    2567 scope.go:117] "RemoveContainer" containerID="d326c301602dd23ea7f89d16a9a9b166c97baf10c29825360d560191836c2653"
Sep 15 13:22:53.321960 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:22:53.321931    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d326c301602dd23ea7f89d16a9a9b166c97baf10c29825360d560191836c2653\": container with ID starting with d326c301602dd23ea7f89d16a9a9b166c97baf10c29825360d560191836c2653 not found: ID does not exist" containerID="d326c301602dd23ea7f89d16a9a9b166c97baf10c29825360d560191836c2653"
Sep 15 13:22:53.322059 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:53.321998    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d326c301602dd23ea7f89d16a9a9b166c97baf10c29825360d560191836c2653"} err="failed to get container status \"d326c301602dd23ea7f89d16a9a9b166c97baf10c29825360d560191836c2653\": rpc error: code = NotFound desc = could not find container \"d326c301602dd23ea7f89d16a9a9b166c97baf10c29825360d560191836c2653\": container with ID starting with d326c301602dd23ea7f89d16a9a9b166c97baf10c29825360d560191836c2653 not found: ID does not exist"
Sep 15 13:22:53.322059 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:53.322024    2567 scope.go:117] "RemoveContainer" containerID="a69e6f9aaafd7023811a03888424eee054ec9da7f02d8ef1192f4c7eaafc2787"
Sep 15 13:22:53.330270 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:53.330252    2567 scope.go:117] "RemoveContainer" containerID="a69e6f9aaafd7023811a03888424eee054ec9da7f02d8ef1192f4c7eaafc2787"
Sep 15 13:22:53.330580 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:22:53.330558    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a69e6f9aaafd7023811a03888424eee054ec9da7f02d8ef1192f4c7eaafc2787\": container with ID starting with a69e6f9aaafd7023811a03888424eee054ec9da7f02d8ef1192f4c7eaafc2787 not found: ID does not exist" containerID="a69e6f9aaafd7023811a03888424eee054ec9da7f02d8ef1192f4c7eaafc2787"
Sep 15 13:22:53.330623 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:53.330589    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a69e6f9aaafd7023811a03888424eee054ec9da7f02d8ef1192f4c7eaafc2787"} err="failed to get container status \"a69e6f9aaafd7023811a03888424eee054ec9da7f02d8ef1192f4c7eaafc2787\": rpc error: code = NotFound desc = could not find container \"a69e6f9aaafd7023811a03888424eee054ec9da7f02d8ef1192f4c7eaafc2787\": container with ID starting with a69e6f9aaafd7023811a03888424eee054ec9da7f02d8ef1192f4c7eaafc2787 not found: ID does not exist"
Sep 15 13:22:53.335931 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:53.335909    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb"]
Sep 15 13:22:53.340755 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:53.340731    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-650c57-c4fb747db-glqtb"]
Sep 15 13:22:53.351614 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:53.351587    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck"]
Sep 15 13:22:53.357599 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:53.357572    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-650c57-d9b47f547-nb4ck"]
Sep 15 13:22:54.719428 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:54.719393    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21148530-38e9-40a7-9468-ea21cf492e29" path="/var/lib/kubelet/pods/21148530-38e9-40a7-9468-ea21cf492e29/volumes"
Sep 15 13:22:54.719808 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:22:54.719755    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2ba133e-6814-4f46-8cca-3dc713b4fdfb" path="/var/lib/kubelet/pods/d2ba133e-6814-4f46-8cca-3dc713b4fdfb/volumes"
Sep 15 13:23:33.903073 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:33.903031    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"]
Sep 15 13:23:33.903734 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:33.903312    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8" podUID="44024e3a-0553-4a26-b3d0-e498370c9c3e" containerName="maas-api" containerID="cri-o://9fcf732fd0f1b3c19e63de7fa4d0fbf69503cf7595ad6a061bd080776d360514" gracePeriod=30
Sep 15 13:23:33.972813 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:33.972780    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp"]
Sep 15 13:23:33.973099 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:33.973066    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp" podUID="f6ba9607-ec07-443a-9653-dfb5991fb7cd" containerName="payload-pre-processing" containerID="cri-o://86d1ab9738c131fee182c5a2a664a14e5d06148720a162e5a9c1ede918cd3109" gracePeriod=30
Sep 15 13:23:34.222199 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.222160    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"
Sep 15 13:23:34.267189 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.267162    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp"
Sep 15 13:23:34.316503 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.316471    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44024e3a-0553-4a26-b3d0-e498370c9c3e-openshift-service-ca\") pod \"44024e3a-0553-4a26-b3d0-e498370c9c3e\" (UID: \"44024e3a-0553-4a26-b3d0-e498370c9c3e\") "
Sep 15 13:23:34.316684 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.316509    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44024e3a-0553-4a26-b3d0-e498370c9c3e-maas-api-tls\") pod \"44024e3a-0553-4a26-b3d0-e498370c9c3e\" (UID: \"44024e3a-0553-4a26-b3d0-e498370c9c3e\") "
Sep 15 13:23:34.316684 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.316555    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmtm9\" (UniqueName: \"kubernetes.io/projected/44024e3a-0553-4a26-b3d0-e498370c9c3e-kube-api-access-bmtm9\") pod \"44024e3a-0553-4a26-b3d0-e498370c9c3e\" (UID: \"44024e3a-0553-4a26-b3d0-e498370c9c3e\") "
Sep 15 13:23:34.316684 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.316621    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44024e3a-0553-4a26-b3d0-e498370c9c3e-metrics-certs\") pod \"44024e3a-0553-4a26-b3d0-e498370c9c3e\" (UID: \"44024e3a-0553-4a26-b3d0-e498370c9c3e\") "
Sep 15 13:23:34.316895 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.316868    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44024e3a-0553-4a26-b3d0-e498370c9c3e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "44024e3a-0553-4a26-b3d0-e498370c9c3e" (UID: "44024e3a-0553-4a26-b3d0-e498370c9c3e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:23:34.317028 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.317012    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44024e3a-0553-4a26-b3d0-e498370c9c3e-openshift-service-ca\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:23:34.318760 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.318726    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44024e3a-0553-4a26-b3d0-e498370c9c3e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "44024e3a-0553-4a26-b3d0-e498370c9c3e" (UID: "44024e3a-0553-4a26-b3d0-e498370c9c3e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:23:34.318850 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.318786    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44024e3a-0553-4a26-b3d0-e498370c9c3e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "44024e3a-0553-4a26-b3d0-e498370c9c3e" (UID: "44024e3a-0553-4a26-b3d0-e498370c9c3e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:23:34.318850 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.318806    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44024e3a-0553-4a26-b3d0-e498370c9c3e-kube-api-access-bmtm9" (OuterVolumeSpecName: "kube-api-access-bmtm9") pod "44024e3a-0553-4a26-b3d0-e498370c9c3e" (UID: "44024e3a-0553-4a26-b3d0-e498370c9c3e"). InnerVolumeSpecName "kube-api-access-bmtm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:23:34.418019 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.417968    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fz9fd\" (UniqueName: \"kubernetes.io/projected/f6ba9607-ec07-443a-9653-dfb5991fb7cd-kube-api-access-fz9fd\") pod \"f6ba9607-ec07-443a-9653-dfb5991fb7cd\" (UID: \"f6ba9607-ec07-443a-9653-dfb5991fb7cd\") "
Sep 15 13:23:34.418221 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.418095    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6ba9607-ec07-443a-9653-dfb5991fb7cd-plugins-config-volume\") pod \"f6ba9607-ec07-443a-9653-dfb5991fb7cd\" (UID: \"f6ba9607-ec07-443a-9653-dfb5991fb7cd\") "
Sep 15 13:23:34.418443 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.418423    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44024e3a-0553-4a26-b3d0-e498370c9c3e-maas-api-tls\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:23:34.418537 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.418448    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmtm9\" (UniqueName: \"kubernetes.io/projected/44024e3a-0553-4a26-b3d0-e498370c9c3e-kube-api-access-bmtm9\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:23:34.418537 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.418474    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44024e3a-0553-4a26-b3d0-e498370c9c3e-metrics-certs\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:23:34.418537 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.418497    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6ba9607-ec07-443a-9653-dfb5991fb7cd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f6ba9607-ec07-443a-9653-dfb5991fb7cd" (UID: "f6ba9607-ec07-443a-9653-dfb5991fb7cd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:23:34.420167 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.420133    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6ba9607-ec07-443a-9653-dfb5991fb7cd-kube-api-access-fz9fd" (OuterVolumeSpecName: "kube-api-access-fz9fd") pod "f6ba9607-ec07-443a-9653-dfb5991fb7cd" (UID: "f6ba9607-ec07-443a-9653-dfb5991fb7cd"). InnerVolumeSpecName "kube-api-access-fz9fd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:23:34.516816 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.516718    2567 generic.go:356] "Generic (PLEG): container finished" podID="44024e3a-0553-4a26-b3d0-e498370c9c3e" containerID="9fcf732fd0f1b3c19e63de7fa4d0fbf69503cf7595ad6a061bd080776d360514" exitCode=0
Sep 15 13:23:34.516816 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.516794    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"
Sep 15 13:23:34.517070 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.516809    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8" event={"ID":"44024e3a-0553-4a26-b3d0-e498370c9c3e","Type":"ContainerDied","Data":"9fcf732fd0f1b3c19e63de7fa4d0fbf69503cf7595ad6a061bd080776d360514"}
Sep 15 13:23:34.517070 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.516914    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8" event={"ID":"44024e3a-0553-4a26-b3d0-e498370c9c3e","Type":"ContainerDied","Data":"e9f0f5a2601d08e62ca07df71a02a7b2ac4f91af10164022710e7ac9c42b8011"}
Sep 15 13:23:34.517070 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.516949    2567 scope.go:117] "RemoveContainer" containerID="9fcf732fd0f1b3c19e63de7fa4d0fbf69503cf7595ad6a061bd080776d360514"
Sep 15 13:23:34.518712 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.518683    2567 generic.go:356] "Generic (PLEG): container finished" podID="f6ba9607-ec07-443a-9653-dfb5991fb7cd" containerID="86d1ab9738c131fee182c5a2a664a14e5d06148720a162e5a9c1ede918cd3109" exitCode=0
Sep 15 13:23:34.518824 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.518714    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp" event={"ID":"f6ba9607-ec07-443a-9653-dfb5991fb7cd","Type":"ContainerDied","Data":"86d1ab9738c131fee182c5a2a664a14e5d06148720a162e5a9c1ede918cd3109"}
Sep 15 13:23:34.518824 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.518731    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp"
Sep 15 13:23:34.518824 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.518759    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp" event={"ID":"f6ba9607-ec07-443a-9653-dfb5991fb7cd","Type":"ContainerDied","Data":"bc6b5548c46b59bd4347abd37a58da0e56d33969606d6d3a548641466131f91c"}
Sep 15 13:23:34.519238 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.519201    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6ba9607-ec07-443a-9653-dfb5991fb7cd-plugins-config-volume\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:23:34.519238 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.519239    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fz9fd\" (UniqueName: \"kubernetes.io/projected/f6ba9607-ec07-443a-9653-dfb5991fb7cd-kube-api-access-fz9fd\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:23:34.529113 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.529090    2567 scope.go:117] "RemoveContainer" containerID="9fcf732fd0f1b3c19e63de7fa4d0fbf69503cf7595ad6a061bd080776d360514"
Sep 15 13:23:34.529407 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:23:34.529378    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fcf732fd0f1b3c19e63de7fa4d0fbf69503cf7595ad6a061bd080776d360514\": container with ID starting with 9fcf732fd0f1b3c19e63de7fa4d0fbf69503cf7595ad6a061bd080776d360514 not found: ID does not exist" containerID="9fcf732fd0f1b3c19e63de7fa4d0fbf69503cf7595ad6a061bd080776d360514"
Sep 15 13:23:34.529485 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.529408    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fcf732fd0f1b3c19e63de7fa4d0fbf69503cf7595ad6a061bd080776d360514"} err="failed to get container status \"9fcf732fd0f1b3c19e63de7fa4d0fbf69503cf7595ad6a061bd080776d360514\": rpc error: code = NotFound desc = could not find container \"9fcf732fd0f1b3c19e63de7fa4d0fbf69503cf7595ad6a061bd080776d360514\": container with ID starting with 9fcf732fd0f1b3c19e63de7fa4d0fbf69503cf7595ad6a061bd080776d360514 not found: ID does not exist"
Sep 15 13:23:34.529485 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.529429    2567 scope.go:117] "RemoveContainer" containerID="86d1ab9738c131fee182c5a2a664a14e5d06148720a162e5a9c1ede918cd3109"
Sep 15 13:23:34.538008 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.537984    2567 scope.go:117] "RemoveContainer" containerID="86d1ab9738c131fee182c5a2a664a14e5d06148720a162e5a9c1ede918cd3109"
Sep 15 13:23:34.538303 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:23:34.538278    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86d1ab9738c131fee182c5a2a664a14e5d06148720a162e5a9c1ede918cd3109\": container with ID starting with 86d1ab9738c131fee182c5a2a664a14e5d06148720a162e5a9c1ede918cd3109 not found: ID does not exist" containerID="86d1ab9738c131fee182c5a2a664a14e5d06148720a162e5a9c1ede918cd3109"
Sep 15 13:23:34.538357 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.538323    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86d1ab9738c131fee182c5a2a664a14e5d06148720a162e5a9c1ede918cd3109"} err="failed to get container status \"86d1ab9738c131fee182c5a2a664a14e5d06148720a162e5a9c1ede918cd3109\": rpc error: code = NotFound desc = could not find container \"86d1ab9738c131fee182c5a2a664a14e5d06148720a162e5a9c1ede918cd3109\": container with ID starting with 86d1ab9738c131fee182c5a2a664a14e5d06148720a162e5a9c1ede918cd3109 not found: ID does not exist"
Sep 15 13:23:34.540810 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.540787    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"]
Sep 15 13:23:34.547179 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.547156    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6a966-6f6c5b769-p55x8"]
Sep 15 13:23:34.556464 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.556440    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp"]
Sep 15 13:23:34.561078 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.561056    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f6a966-cb8d7b74-rhsnp"]
Sep 15 13:23:34.715436 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.715401    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44024e3a-0553-4a26-b3d0-e498370c9c3e" path="/var/lib/kubelet/pods/44024e3a-0553-4a26-b3d0-e498370c9c3e/volumes"
Sep 15 13:23:34.715771 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:34.715759    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6ba9607-ec07-443a-9653-dfb5991fb7cd" path="/var/lib/kubelet/pods/f6ba9607-ec07-443a-9653-dfb5991fb7cd/volumes"
Sep 15 13:23:52.456045 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.455941    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"]
Sep 15 13:23:52.456494 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.456265    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n" podUID="f10f1187-1fca-45b6-be63-2ff25ddaea5e" containerName="maas-api" containerID="cri-o://cde530d92f17519b5580e7d86aa7c5730c419b85fa122cb3a1e6ed80e212037e" gracePeriod=30
Sep 15 13:23:52.533134 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.533102    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz"]
Sep 15 13:23:52.533325 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.533301    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz" podUID="18fb3772-b54e-4aef-9130-130b377cec29" containerName="payload-pre-processing" containerID="cri-o://6c7e3f6d3463787d8f0cd7f058b4997a7ed792e0894d1e1d0f2b83118522fb4c" gracePeriod=30
Sep 15 13:23:52.616441 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.616406    2567 generic.go:356] "Generic (PLEG): container finished" podID="f10f1187-1fca-45b6-be63-2ff25ddaea5e" containerID="cde530d92f17519b5580e7d86aa7c5730c419b85fa122cb3a1e6ed80e212037e" exitCode=0
Sep 15 13:23:52.616603 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.616478    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n" event={"ID":"f10f1187-1fca-45b6-be63-2ff25ddaea5e","Type":"ContainerDied","Data":"cde530d92f17519b5580e7d86aa7c5730c419b85fa122cb3a1e6ed80e212037e"}
Sep 15 13:23:52.782301 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.782272    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"
Sep 15 13:23:52.818880 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.818849    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz"
Sep 15 13:23:52.884857 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.884824    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18fb3772-b54e-4aef-9130-130b377cec29-plugins-config-volume\") pod \"18fb3772-b54e-4aef-9130-130b377cec29\" (UID: \"18fb3772-b54e-4aef-9130-130b377cec29\") "
Sep 15 13:23:52.885033 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.884886    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vr7c\" (UniqueName: \"kubernetes.io/projected/18fb3772-b54e-4aef-9130-130b377cec29-kube-api-access-9vr7c\") pod \"18fb3772-b54e-4aef-9130-130b377cec29\" (UID: \"18fb3772-b54e-4aef-9130-130b377cec29\") "
Sep 15 13:23:52.885033 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.884915    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f10f1187-1fca-45b6-be63-2ff25ddaea5e-maas-api-tls\") pod \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\" (UID: \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\") "
Sep 15 13:23:52.885033 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.884937    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8fg9\" (UniqueName: \"kubernetes.io/projected/f10f1187-1fca-45b6-be63-2ff25ddaea5e-kube-api-access-g8fg9\") pod \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\" (UID: \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\") "
Sep 15 13:23:52.885033 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.885004    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f10f1187-1fca-45b6-be63-2ff25ddaea5e-openshift-service-ca\") pod \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\" (UID: \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\") "
Sep 15 13:23:52.885245 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.885071    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f10f1187-1fca-45b6-be63-2ff25ddaea5e-metrics-certs\") pod \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\" (UID: \"f10f1187-1fca-45b6-be63-2ff25ddaea5e\") "
Sep 15 13:23:52.885245 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.885189    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18fb3772-b54e-4aef-9130-130b377cec29-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "18fb3772-b54e-4aef-9130-130b377cec29" (UID: "18fb3772-b54e-4aef-9130-130b377cec29"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:23:52.885480 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.885452    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/18fb3772-b54e-4aef-9130-130b377cec29-plugins-config-volume\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:23:52.885480 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.885457    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f10f1187-1fca-45b6-be63-2ff25ddaea5e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f10f1187-1fca-45b6-be63-2ff25ddaea5e" (UID: "f10f1187-1fca-45b6-be63-2ff25ddaea5e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:23:52.887171 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.887141    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f10f1187-1fca-45b6-be63-2ff25ddaea5e-kube-api-access-g8fg9" (OuterVolumeSpecName: "kube-api-access-g8fg9") pod "f10f1187-1fca-45b6-be63-2ff25ddaea5e" (UID: "f10f1187-1fca-45b6-be63-2ff25ddaea5e"). InnerVolumeSpecName "kube-api-access-g8fg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:23:52.887171 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.887141    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f10f1187-1fca-45b6-be63-2ff25ddaea5e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f10f1187-1fca-45b6-be63-2ff25ddaea5e" (UID: "f10f1187-1fca-45b6-be63-2ff25ddaea5e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:23:52.887513 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.887494    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f10f1187-1fca-45b6-be63-2ff25ddaea5e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f10f1187-1fca-45b6-be63-2ff25ddaea5e" (UID: "f10f1187-1fca-45b6-be63-2ff25ddaea5e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:23:52.887569 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.887509    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18fb3772-b54e-4aef-9130-130b377cec29-kube-api-access-9vr7c" (OuterVolumeSpecName: "kube-api-access-9vr7c") pod "18fb3772-b54e-4aef-9130-130b377cec29" (UID: "18fb3772-b54e-4aef-9130-130b377cec29"). InnerVolumeSpecName "kube-api-access-9vr7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:23:52.986683 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.986604    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f10f1187-1fca-45b6-be63-2ff25ddaea5e-metrics-certs\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:23:52.986683 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.986629    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vr7c\" (UniqueName: \"kubernetes.io/projected/18fb3772-b54e-4aef-9130-130b377cec29-kube-api-access-9vr7c\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:23:52.986683 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.986640    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f10f1187-1fca-45b6-be63-2ff25ddaea5e-maas-api-tls\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:23:52.986683 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.986650    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8fg9\" (UniqueName: \"kubernetes.io/projected/f10f1187-1fca-45b6-be63-2ff25ddaea5e-kube-api-access-g8fg9\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:23:52.986683 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:52.986658    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f10f1187-1fca-45b6-be63-2ff25ddaea5e-openshift-service-ca\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:23:53.622888 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:53.622851    2567 generic.go:356] "Generic (PLEG): container finished" podID="18fb3772-b54e-4aef-9130-130b377cec29" containerID="6c7e3f6d3463787d8f0cd7f058b4997a7ed792e0894d1e1d0f2b83118522fb4c" exitCode=0
Sep 15 13:23:53.623384 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:53.622896    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz"
Sep 15 13:23:53.623384 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:53.622939    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz" event={"ID":"18fb3772-b54e-4aef-9130-130b377cec29","Type":"ContainerDied","Data":"6c7e3f6d3463787d8f0cd7f058b4997a7ed792e0894d1e1d0f2b83118522fb4c"}
Sep 15 13:23:53.623384 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:53.623029    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz" event={"ID":"18fb3772-b54e-4aef-9130-130b377cec29","Type":"ContainerDied","Data":"636127588b6969a8e8822d2c3dba6b2591f97a7c1dd72d6daaf7d8251dd3cf9a"}
Sep 15 13:23:53.623384 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:53.623064    2567 scope.go:117] "RemoveContainer" containerID="6c7e3f6d3463787d8f0cd7f058b4997a7ed792e0894d1e1d0f2b83118522fb4c"
Sep 15 13:23:53.624572 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:53.624550    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n" event={"ID":"f10f1187-1fca-45b6-be63-2ff25ddaea5e","Type":"ContainerDied","Data":"9a8d32450c85ffda1b5d8bbcf97f1ab7b1ae11fc2721fe88c6b3f6a02c9ae0d9"}
Sep 15 13:23:53.624655 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:53.624553    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"
Sep 15 13:23:53.632340 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:53.632260    2567 scope.go:117] "RemoveContainer" containerID="6c7e3f6d3463787d8f0cd7f058b4997a7ed792e0894d1e1d0f2b83118522fb4c"
Sep 15 13:23:53.632603 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:23:53.632574    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c7e3f6d3463787d8f0cd7f058b4997a7ed792e0894d1e1d0f2b83118522fb4c\": container with ID starting with 6c7e3f6d3463787d8f0cd7f058b4997a7ed792e0894d1e1d0f2b83118522fb4c not found: ID does not exist" containerID="6c7e3f6d3463787d8f0cd7f058b4997a7ed792e0894d1e1d0f2b83118522fb4c"
Sep 15 13:23:53.632686 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:53.632612    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c7e3f6d3463787d8f0cd7f058b4997a7ed792e0894d1e1d0f2b83118522fb4c"} err="failed to get container status \"6c7e3f6d3463787d8f0cd7f058b4997a7ed792e0894d1e1d0f2b83118522fb4c\": rpc error: code = NotFound desc = could not find container \"6c7e3f6d3463787d8f0cd7f058b4997a7ed792e0894d1e1d0f2b83118522fb4c\": container with ID starting with 6c7e3f6d3463787d8f0cd7f058b4997a7ed792e0894d1e1d0f2b83118522fb4c not found: ID does not exist"
Sep 15 13:23:53.632686 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:53.632633    2567 scope.go:117] "RemoveContainer" containerID="cde530d92f17519b5580e7d86aa7c5730c419b85fa122cb3a1e6ed80e212037e"
Sep 15 13:23:53.646831 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:53.646807    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"]
Sep 15 13:23:53.654330 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:53.654309    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-ddd0eb-5f9667f5b5-x4l6n"]
Sep 15 13:23:53.666699 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:53.666677    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz"]
Sep 15 13:23:53.672144 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:53.672123    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-ddd0eb-86f88b8698-xfnjz"]
Sep 15 13:23:54.713537 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:54.713504    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18fb3772-b54e-4aef-9130-130b377cec29" path="/var/lib/kubelet/pods/18fb3772-b54e-4aef-9130-130b377cec29/volumes"
Sep 15 13:23:54.713940 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:23:54.713925    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f10f1187-1fca-45b6-be63-2ff25ddaea5e" path="/var/lib/kubelet/pods/f10f1187-1fca-45b6-be63-2ff25ddaea5e/volumes"
Sep 15 13:32:36.304845 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:36.304807    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"]
Sep 15 13:32:36.305329 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:36.305071    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r" podUID="f03c436d-11fe-4858-b6fb-bc98b0c970f8" containerName="maas-api" containerID="cri-o://e2d31215cd7caaa9f80a334923c90a12beb0d54ae601b9b8d14aa41d0e8010c9" gracePeriod=30
Sep 15 13:32:36.553218 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:36.553187    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:32:36.655885 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:36.655808    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03c436d-11fe-4858-b6fb-bc98b0c970f8-openshift-service-ca\") pod \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\" (UID: \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\") "
Sep 15 13:32:36.656042 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:36.655933    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f03c436d-11fe-4858-b6fb-bc98b0c970f8-maas-api-tls\") pod \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\" (UID: \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\") "
Sep 15 13:32:36.656042 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:36.656025    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkrnp\" (UniqueName: \"kubernetes.io/projected/f03c436d-11fe-4858-b6fb-bc98b0c970f8-kube-api-access-rkrnp\") pod \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\" (UID: \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\") "
Sep 15 13:32:36.656162 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:36.656137    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f03c436d-11fe-4858-b6fb-bc98b0c970f8-metrics-certs\") pod \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\" (UID: \"f03c436d-11fe-4858-b6fb-bc98b0c970f8\") "
Sep 15 13:32:36.656285 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:36.656261    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f03c436d-11fe-4858-b6fb-bc98b0c970f8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f03c436d-11fe-4858-b6fb-bc98b0c970f8" (UID: "f03c436d-11fe-4858-b6fb-bc98b0c970f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 13:32:36.656512 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:36.656491    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f03c436d-11fe-4858-b6fb-bc98b0c970f8-openshift-service-ca\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:32:36.658212 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:36.658180    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f03c436d-11fe-4858-b6fb-bc98b0c970f8-kube-api-access-rkrnp" (OuterVolumeSpecName: "kube-api-access-rkrnp") pod "f03c436d-11fe-4858-b6fb-bc98b0c970f8" (UID: "f03c436d-11fe-4858-b6fb-bc98b0c970f8"). InnerVolumeSpecName "kube-api-access-rkrnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:32:36.658316 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:36.658211    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f03c436d-11fe-4858-b6fb-bc98b0c970f8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f03c436d-11fe-4858-b6fb-bc98b0c970f8" (UID: "f03c436d-11fe-4858-b6fb-bc98b0c970f8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:32:36.658316 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:36.658190    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f03c436d-11fe-4858-b6fb-bc98b0c970f8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f03c436d-11fe-4858-b6fb-bc98b0c970f8" (UID: "f03c436d-11fe-4858-b6fb-bc98b0c970f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:32:36.757192 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:36.757155    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f03c436d-11fe-4858-b6fb-bc98b0c970f8-maas-api-tls\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:32:36.757192 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:36.757183    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkrnp\" (UniqueName: \"kubernetes.io/projected/f03c436d-11fe-4858-b6fb-bc98b0c970f8-kube-api-access-rkrnp\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:32:36.757192 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:36.757195    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f03c436d-11fe-4858-b6fb-bc98b0c970f8-metrics-certs\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:32:37.165663 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:37.165627    2567 generic.go:356] "Generic (PLEG): container finished" podID="f03c436d-11fe-4858-b6fb-bc98b0c970f8" containerID="e2d31215cd7caaa9f80a334923c90a12beb0d54ae601b9b8d14aa41d0e8010c9" exitCode=0
Sep 15 13:32:37.165832 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:37.165674    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"
Sep 15 13:32:37.165832 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:37.165697    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r" event={"ID":"f03c436d-11fe-4858-b6fb-bc98b0c970f8","Type":"ContainerDied","Data":"e2d31215cd7caaa9f80a334923c90a12beb0d54ae601b9b8d14aa41d0e8010c9"}
Sep 15 13:32:37.165832 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:37.165738    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r" event={"ID":"f03c436d-11fe-4858-b6fb-bc98b0c970f8","Type":"ContainerDied","Data":"e93eaec48c36e4be105cc3544adb73c16f3bccad0fdc97cd4424f9715a9b291b"}
Sep 15 13:32:37.165832 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:37.165759    2567 scope.go:117] "RemoveContainer" containerID="e2d31215cd7caaa9f80a334923c90a12beb0d54ae601b9b8d14aa41d0e8010c9"
Sep 15 13:32:37.174788 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:37.174767    2567 scope.go:117] "RemoveContainer" containerID="e2d31215cd7caaa9f80a334923c90a12beb0d54ae601b9b8d14aa41d0e8010c9"
Sep 15 13:32:37.175130 ip-10-0-129-48 kubenswrapper[2567]: E0915 13:32:37.175103    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2d31215cd7caaa9f80a334923c90a12beb0d54ae601b9b8d14aa41d0e8010c9\": container with ID starting with e2d31215cd7caaa9f80a334923c90a12beb0d54ae601b9b8d14aa41d0e8010c9 not found: ID does not exist" containerID="e2d31215cd7caaa9f80a334923c90a12beb0d54ae601b9b8d14aa41d0e8010c9"
Sep 15 13:32:37.175237 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:37.175134    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d31215cd7caaa9f80a334923c90a12beb0d54ae601b9b8d14aa41d0e8010c9"} err="failed to get container status \"e2d31215cd7caaa9f80a334923c90a12beb0d54ae601b9b8d14aa41d0e8010c9\": rpc error: code = NotFound desc = could not find container \"e2d31215cd7caaa9f80a334923c90a12beb0d54ae601b9b8d14aa41d0e8010c9\": container with ID starting with e2d31215cd7caaa9f80a334923c90a12beb0d54ae601b9b8d14aa41d0e8010c9 not found: ID does not exist"
Sep 15 13:32:37.188096 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:37.188063    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"]
Sep 15 13:32:37.206754 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:37.206726    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-38d90f-65c4bccb49-dkf9r"]
Sep 15 13:32:38.713900 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:32:38.713868    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f03c436d-11fe-4858-b6fb-bc98b0c970f8" path="/var/lib/kubelet/pods/f03c436d-11fe-4858-b6fb-bc98b0c970f8/volumes"
Sep 15 13:34:20.443775 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:20.443695    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f4dcdf76b-qvlrj"]
Sep 15 13:34:20.444326 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:20.443895    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj" podUID="23ff1b7e-5a87-439b-8416-e57d057bc08f" containerName="manager" containerID="cri-o://9167ab902528e5cd1688b803faff265e921bafbfd6cd0add1a35279ac7c6c2d8" gracePeriod=30
Sep 15 13:34:20.652958 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:20.652923    2567 generic.go:356] "Generic (PLEG): container finished" podID="23ff1b7e-5a87-439b-8416-e57d057bc08f" containerID="9167ab902528e5cd1688b803faff265e921bafbfd6cd0add1a35279ac7c6c2d8" exitCode=0
Sep 15 13:34:20.653132 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:20.653000    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj" event={"ID":"23ff1b7e-5a87-439b-8416-e57d057bc08f","Type":"ContainerDied","Data":"9167ab902528e5cd1688b803faff265e921bafbfd6cd0add1a35279ac7c6c2d8"}
Sep 15 13:34:20.691563 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:20.691535    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj"
Sep 15 13:34:20.791770 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:20.791678    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23ff1b7e-5a87-439b-8416-e57d057bc08f-webhook-cert\") pod \"23ff1b7e-5a87-439b-8416-e57d057bc08f\" (UID: \"23ff1b7e-5a87-439b-8416-e57d057bc08f\") "
Sep 15 13:34:20.791770 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:20.791734    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfjtg\" (UniqueName: \"kubernetes.io/projected/23ff1b7e-5a87-439b-8416-e57d057bc08f-kube-api-access-xfjtg\") pod \"23ff1b7e-5a87-439b-8416-e57d057bc08f\" (UID: \"23ff1b7e-5a87-439b-8416-e57d057bc08f\") "
Sep 15 13:34:20.791951 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:20.791776    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23ff1b7e-5a87-439b-8416-e57d057bc08f-metrics-certs\") pod \"23ff1b7e-5a87-439b-8416-e57d057bc08f\" (UID: \"23ff1b7e-5a87-439b-8416-e57d057bc08f\") "
Sep 15 13:34:20.793762 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:20.793727    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23ff1b7e-5a87-439b-8416-e57d057bc08f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "23ff1b7e-5a87-439b-8416-e57d057bc08f" (UID: "23ff1b7e-5a87-439b-8416-e57d057bc08f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:34:20.793944 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:20.793922    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23ff1b7e-5a87-439b-8416-e57d057bc08f-kube-api-access-xfjtg" (OuterVolumeSpecName: "kube-api-access-xfjtg") pod "23ff1b7e-5a87-439b-8416-e57d057bc08f" (UID: "23ff1b7e-5a87-439b-8416-e57d057bc08f"). InnerVolumeSpecName "kube-api-access-xfjtg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 13:34:20.794004 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:20.793943    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23ff1b7e-5a87-439b-8416-e57d057bc08f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "23ff1b7e-5a87-439b-8416-e57d057bc08f" (UID: "23ff1b7e-5a87-439b-8416-e57d057bc08f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 13:34:20.893020 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:20.892958    2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/23ff1b7e-5a87-439b-8416-e57d057bc08f-webhook-cert\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:34:20.893020 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:20.893015    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfjtg\" (UniqueName: \"kubernetes.io/projected/23ff1b7e-5a87-439b-8416-e57d057bc08f-kube-api-access-xfjtg\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:34:20.893020 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:20.893026    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23ff1b7e-5a87-439b-8416-e57d057bc08f-metrics-certs\") on node \"ip-10-0-129-48.ec2.internal\" DevicePath \"\""
Sep 15 13:34:21.659325 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:21.659289    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj" event={"ID":"23ff1b7e-5a87-439b-8416-e57d057bc08f","Type":"ContainerDied","Data":"3abc5ea1d1985669408f002d94e50b7abb03d90e3572f255fc67638c24173053"}
Sep 15 13:34:21.659325 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:21.659305    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f4dcdf76b-qvlrj"
Sep 15 13:34:21.659814 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:21.659349    2567 scope.go:117] "RemoveContainer" containerID="9167ab902528e5cd1688b803faff265e921bafbfd6cd0add1a35279ac7c6c2d8"
Sep 15 13:34:21.681616 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:21.681582    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f4dcdf76b-qvlrj"]
Sep 15 13:34:21.684966 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:21.684941    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f4dcdf76b-qvlrj"]
Sep 15 13:34:22.712739 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:34:22.712707    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23ff1b7e-5a87-439b-8416-e57d057bc08f" path="/var/lib/kubelet/pods/23ff1b7e-5a87-439b-8416-e57d057bc08f/volumes"
Sep 15 13:39:31.626960 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:31.626930    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79946fddd6-psd6d_a86abf55-31d6-40cc-a26e-c194e363788a/copy-manifests/0.log"
Sep 15 13:39:31.633554 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:31.633519    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79946fddd6-psd6d_a86abf55-31d6-40cc-a26e-c194e363788a/manager/0.log"
Sep 15 13:39:32.114554 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:32.114528    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-786fdf86ff-mmkr7_88803825-7ae4-4766-b505-366de9b09870/maas-api/0.log"
Sep 15 13:39:32.230598 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:32.230553    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-a-528f6b-7b44c985db-gtjlm_a9320923-d5fa-4442-bd26-855a306c2baa/maas-api/0.log"
Sep 15 13:39:32.342395 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:32.342365    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-b-1c35dd-55bbccd5bd-fb44s_a2ac296c-7702-4bf6-be76-502c62309551/maas-api/0.log"
Sep 15 13:39:32.454750 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:32.454722    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-worker-w0-6c9f0b-77d5fbb548-snh66_c51aca84-b2fa-4d8b-9f36-e668a5182363/maas-api/0.log"
Sep 15 13:39:32.571898 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:32.571871    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-worker-w4-2af9a3-56d57c65f4-d7mt9_bb665f5e-aa83-4aa7-b855-2df48f524c64/maas-api/0.log"
Sep 15 13:39:34.327639 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:34.327604    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-xb47s_dd186e9c-fce3-4bd4-a3c9-2fff14942f9b/postgres/0.log"
Sep 15 13:39:35.218789 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:35.218755    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-rhzkt_212ad554-4504-4582-ac83-d5d1f7ef605e/manager/0.log"
Sep 15 13:39:35.442190 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:35.442164    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-896q5_7e730322-0d4f-4941-bc9b-c036787c235e/kuadrant-console-plugin/0.log"
Sep 15 13:39:35.782746 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:35.782718    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-rkhwg_b0079bb3-5eed-447b-99a3-97965833a504/manager/0.log"
Sep 15 13:39:36.251007 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:36.249490    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-62ldp_a4b35ed2-1140-4126-9a04-d0a6e4dcdd56/discovery/0.log"
Sep 15 13:39:36.354311 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:36.354278    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cfb95df68-n7v4d_9682dc5b-5b44-4e08-9eb1-4cc4cf00f396/kube-auth-proxy/0.log"
Sep 15 13:39:36.915382 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:36.915351    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr_eb865e51-fc60-4fde-9f62-b071ff69fc0e/payload-pre-processing/0.log"
Sep 15 13:39:37.026743 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:37.026713    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr_8639557c-c952-443b-a6d8-412e2a219dd9/payload-pre-processing/0.log"
Sep 15 13:39:37.254158 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:37.254075    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-45tlr_c13fe9f2-5622-4ad6-9c64-bf4a7e20f440/payload-processing/0.log"
Sep 15 13:39:38.153096 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:38.153071    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-lfpqb_53e88ec6-c2b4-49b9-8c45-071d3d7ed2c2/main/0.log"
Sep 15 13:39:38.373772 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:38.373740    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-n5z48_0455b622-172b-43b8-a98a-cd757c2a84a2/main/0.log"
Sep 15 13:39:38.702566 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:38.702538    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-4rj7j_7e4a6863-e587-4646-9670-6965d78cbb7c/main/0.log"
Sep 15 13:39:47.085484 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:47.085458    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4gb4s_048c8d38-9a54-4ece-9887-db9382ceee1f/global-pull-secret-syncer/0.log"
Sep 15 13:39:47.264435 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:47.264394    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-d2bpj_826d3dbd-d234-48bd-b6fe-d426ab919b84/konnectivity-agent/0.log"
Sep 15 13:39:47.327312 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:47.327285    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-48.ec2.internal_19e9bd3d9e4c4d8228116fb4b9295f1a/haproxy/0.log"
Sep 15 13:39:52.123886 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:52.123845    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-rhzkt_212ad554-4504-4582-ac83-d5d1f7ef605e/manager/0.log"
Sep 15 13:39:52.177412 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:52.177383    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-896q5_7e730322-0d4f-4941-bc9b-c036787c235e/kuadrant-console-plugin/0.log"
Sep 15 13:39:52.339580 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:52.339554    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-rkhwg_b0079bb3-5eed-447b-99a3-97965833a504/manager/0.log"
Sep 15 13:39:53.797311 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:53.797274    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8155cb57-9298-4bf5-99b4-a3ddbca3ae5a/alertmanager/0.log"
Sep 15 13:39:53.817410 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:53.817354    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8155cb57-9298-4bf5-99b4-a3ddbca3ae5a/config-reloader/0.log"
Sep 15 13:39:53.834836 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:53.834819    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8155cb57-9298-4bf5-99b4-a3ddbca3ae5a/kube-rbac-proxy-web/0.log"
Sep 15 13:39:53.854184 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:53.854167    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8155cb57-9298-4bf5-99b4-a3ddbca3ae5a/kube-rbac-proxy/0.log"
Sep 15 13:39:53.875813 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:53.875795    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8155cb57-9298-4bf5-99b4-a3ddbca3ae5a/kube-rbac-proxy-metric/0.log"
Sep 15 13:39:53.895750 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:53.895731    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8155cb57-9298-4bf5-99b4-a3ddbca3ae5a/prom-label-proxy/0.log"
Sep 15 13:39:53.922218 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:53.922199    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8155cb57-9298-4bf5-99b4-a3ddbca3ae5a/init-config-reloader/0.log"
Sep 15 13:39:54.210070 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:54.210041    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dpdqv_6f70622b-5f37-4f27-af7e-1a1c091c31db/node-exporter/0.log"
Sep 15 13:39:54.231350 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:54.231327    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dpdqv_6f70622b-5f37-4f27-af7e-1a1c091c31db/kube-rbac-proxy/0.log"
Sep 15 13:39:54.260134 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:54.260115    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dpdqv_6f70622b-5f37-4f27-af7e-1a1c091c31db/init-textfile/0.log"
Sep 15 13:39:54.800492 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:54.800458    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b87466bdc-2gbq5_545ed919-0186-4899-af48-82621ab11143/telemeter-client/0.log"
Sep 15 13:39:54.851080 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:54.851013    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b87466bdc-2gbq5_545ed919-0186-4899-af48-82621ab11143/reload/0.log"
Sep 15 13:39:54.884845 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:54.884818    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-b87466bdc-2gbq5_545ed919-0186-4899-af48-82621ab11143/kube-rbac-proxy/0.log"
Sep 15 13:39:57.134916 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.134879    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"]
Sep 15 13:39:57.135301 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135273    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f10f1187-1fca-45b6-be63-2ff25ddaea5e" containerName="maas-api"
Sep 15 13:39:57.135301 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135285    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f10f1187-1fca-45b6-be63-2ff25ddaea5e" containerName="maas-api"
Sep 15 13:39:57.135301 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135293    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f03c436d-11fe-4858-b6fb-bc98b0c970f8" containerName="maas-api"
Sep 15 13:39:57.135301 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135300    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f03c436d-11fe-4858-b6fb-bc98b0c970f8" containerName="maas-api"
Sep 15 13:39:57.135433 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135308    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21148530-38e9-40a7-9468-ea21cf492e29" containerName="payload-pre-processing"
Sep 15 13:39:57.135433 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135314    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="21148530-38e9-40a7-9468-ea21cf492e29" containerName="payload-pre-processing"
Sep 15 13:39:57.135433 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135330    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2ba133e-6814-4f46-8cca-3dc713b4fdfb" containerName="payload-processing"
Sep 15 13:39:57.135433 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135335    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2ba133e-6814-4f46-8cca-3dc713b4fdfb" containerName="payload-processing"
Sep 15 13:39:57.135433 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135341    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23ff1b7e-5a87-439b-8416-e57d057bc08f" containerName="manager"
Sep 15 13:39:57.135433 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135346    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ff1b7e-5a87-439b-8416-e57d057bc08f" containerName="manager"
Sep 15 13:39:57.135433 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135353    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18fb3772-b54e-4aef-9130-130b377cec29" containerName="payload-pre-processing"
Sep 15 13:39:57.135433 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135358    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="18fb3772-b54e-4aef-9130-130b377cec29" containerName="payload-pre-processing"
Sep 15 13:39:57.135433 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135374    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6ba9607-ec07-443a-9653-dfb5991fb7cd" containerName="payload-pre-processing"
Sep 15 13:39:57.135433 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135379    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6ba9607-ec07-443a-9653-dfb5991fb7cd" containerName="payload-pre-processing"
Sep 15 13:39:57.135433 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135385    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44024e3a-0553-4a26-b3d0-e498370c9c3e" containerName="maas-api"
Sep 15 13:39:57.135433 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135390    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="44024e3a-0553-4a26-b3d0-e498370c9c3e" containerName="maas-api"
Sep 15 13:39:57.135784 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135440    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="21148530-38e9-40a7-9468-ea21cf492e29" containerName="payload-pre-processing"
Sep 15 13:39:57.135784 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135448    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f10f1187-1fca-45b6-be63-2ff25ddaea5e" containerName="maas-api"
Sep 15 13:39:57.135784 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135456    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f03c436d-11fe-4858-b6fb-bc98b0c970f8" containerName="maas-api"
Sep 15 13:39:57.135784 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135462    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6ba9607-ec07-443a-9653-dfb5991fb7cd" containerName="payload-pre-processing"
Sep 15 13:39:57.135784 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135468    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="18fb3772-b54e-4aef-9130-130b377cec29" containerName="payload-pre-processing"
Sep 15 13:39:57.135784 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135473    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="23ff1b7e-5a87-439b-8416-e57d057bc08f" containerName="manager"
Sep 15 13:39:57.135784 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135477    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="44024e3a-0553-4a26-b3d0-e498370c9c3e" containerName="maas-api"
Sep 15 13:39:57.135784 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.135482    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2ba133e-6814-4f46-8cca-3dc713b4fdfb" containerName="payload-processing"
Sep 15 13:39:57.138663 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.138644    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"
Sep 15 13:39:57.140462 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.140444    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xpvzq\"/\"kube-root-ca.crt\""
Sep 15 13:39:57.140855 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.140841    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xpvzq\"/\"openshift-service-ca.crt\""
Sep 15 13:39:57.140924 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.140870    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xpvzq\"/\"default-dockercfg-4dw7n\""
Sep 15 13:39:57.147396 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.147373    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"]
Sep 15 13:39:57.239579 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.239548    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/35dab9bd-a750-4c23-8246-f960539e29cb-podres\") pod \"perf-node-gather-daemonset-l7r2q\" (UID: \"35dab9bd-a750-4c23-8246-f960539e29cb\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"
Sep 15 13:39:57.239754 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.239593    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt78x\" (UniqueName: \"kubernetes.io/projected/35dab9bd-a750-4c23-8246-f960539e29cb-kube-api-access-qt78x\") pod \"perf-node-gather-daemonset-l7r2q\" (UID: \"35dab9bd-a750-4c23-8246-f960539e29cb\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"
Sep 15 13:39:57.239754 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.239665    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/35dab9bd-a750-4c23-8246-f960539e29cb-proc\") pod \"perf-node-gather-daemonset-l7r2q\" (UID: \"35dab9bd-a750-4c23-8246-f960539e29cb\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"
Sep 15 13:39:57.239754 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.239700    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35dab9bd-a750-4c23-8246-f960539e29cb-sys\") pod \"perf-node-gather-daemonset-l7r2q\" (UID: \"35dab9bd-a750-4c23-8246-f960539e29cb\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"
Sep 15 13:39:57.239754 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.239717    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35dab9bd-a750-4c23-8246-f960539e29cb-lib-modules\") pod \"perf-node-gather-daemonset-l7r2q\" (UID: \"35dab9bd-a750-4c23-8246-f960539e29cb\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"
Sep 15 13:39:57.340942 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.340906    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35dab9bd-a750-4c23-8246-f960539e29cb-sys\") pod \"perf-node-gather-daemonset-l7r2q\" (UID: \"35dab9bd-a750-4c23-8246-f960539e29cb\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"
Sep 15 13:39:57.341144 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.340946    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35dab9bd-a750-4c23-8246-f960539e29cb-lib-modules\") pod \"perf-node-gather-daemonset-l7r2q\" (UID: \"35dab9bd-a750-4c23-8246-f960539e29cb\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"
Sep 15 13:39:57.341144 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.341003    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/35dab9bd-a750-4c23-8246-f960539e29cb-podres\") pod \"perf-node-gather-daemonset-l7r2q\" (UID: \"35dab9bd-a750-4c23-8246-f960539e29cb\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"
Sep 15 13:39:57.341144 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.341039    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/35dab9bd-a750-4c23-8246-f960539e29cb-sys\") pod \"perf-node-gather-daemonset-l7r2q\" (UID: \"35dab9bd-a750-4c23-8246-f960539e29cb\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"
Sep 15 13:39:57.341144 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.341058    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt78x\" (UniqueName: \"kubernetes.io/projected/35dab9bd-a750-4c23-8246-f960539e29cb-kube-api-access-qt78x\") pod \"perf-node-gather-daemonset-l7r2q\" (UID: \"35dab9bd-a750-4c23-8246-f960539e29cb\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"
Sep 15 13:39:57.341144 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.341136    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/35dab9bd-a750-4c23-8246-f960539e29cb-proc\") pod \"perf-node-gather-daemonset-l7r2q\" (UID: \"35dab9bd-a750-4c23-8246-f960539e29cb\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"
Sep 15 13:39:57.341372 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.341153    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/35dab9bd-a750-4c23-8246-f960539e29cb-podres\") pod \"perf-node-gather-daemonset-l7r2q\" (UID: \"35dab9bd-a750-4c23-8246-f960539e29cb\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"
Sep 15 13:39:57.341372 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.341154    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/35dab9bd-a750-4c23-8246-f960539e29cb-lib-modules\") pod \"perf-node-gather-daemonset-l7r2q\" (UID: \"35dab9bd-a750-4c23-8246-f960539e29cb\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"
Sep 15 13:39:57.341372 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.341217    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/35dab9bd-a750-4c23-8246-f960539e29cb-proc\") pod \"perf-node-gather-daemonset-l7r2q\" (UID: \"35dab9bd-a750-4c23-8246-f960539e29cb\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"
Sep 15 13:39:57.349140 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.349121    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt78x\" (UniqueName: \"kubernetes.io/projected/35dab9bd-a750-4c23-8246-f960539e29cb-kube-api-access-qt78x\") pod \"perf-node-gather-daemonset-l7r2q\" (UID: \"35dab9bd-a750-4c23-8246-f960539e29cb\") " pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"
Sep 15 13:39:57.449317 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.449277    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"
Sep 15 13:39:57.718192 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:57.718162    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"]
Sep 15 13:39:57.720383 ip-10-0-129-48 kubenswrapper[2567]: W0915 13:39:57.720355    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod35dab9bd_a750_4c23_8246_f960539e29cb.slice/crio-cbeddaa7b8e0d6a6ac6f469784c3b45d5f9661bc94c4aa26cf1986172cc2aa90 WatchSource:0}: Error finding container cbeddaa7b8e0d6a6ac6f469784c3b45d5f9661bc94c4aa26cf1986172cc2aa90: Status 404 returned error can't find the container with id cbeddaa7b8e0d6a6ac6f469784c3b45d5f9661bc94c4aa26cf1986172cc2aa90
Sep 15 13:39:58.216060 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:58.216016    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q" event={"ID":"35dab9bd-a750-4c23-8246-f960539e29cb","Type":"ContainerStarted","Data":"c2350d5b9d29b49bf6db4582676267fc3483c4ec3c826626e23d3b7f048a7d38"}
Sep 15 13:39:58.216507 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:58.216080    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q" event={"ID":"35dab9bd-a750-4c23-8246-f960539e29cb","Type":"ContainerStarted","Data":"cbeddaa7b8e0d6a6ac6f469784c3b45d5f9661bc94c4aa26cf1986172cc2aa90"}
Sep 15 13:39:58.216507 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:58.216199    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"
Sep 15 13:39:58.234151 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:58.234107    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q" podStartSLOduration=1.234089967 podStartE2EDuration="1.234089967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 13:39:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 13:39:58.23250694 +0000 UTC m=+3301.953822472" watchObservedRunningTime="2026-09-15 13:39:58.234089967 +0000 UTC m=+3301.955405499"
Sep 15 13:39:59.349914 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:59.349885    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dzc42_d18d2255-6fc6-4ba8-a48d-723b6a0e13f5/dns/0.log"
Sep 15 13:39:59.371785 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:59.371765    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dzc42_d18d2255-6fc6-4ba8-a48d-723b6a0e13f5/kube-rbac-proxy/0.log"
Sep 15 13:39:59.481064 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:39:59.481042    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f2f6j_5486db58-30f3-45ce-8ecb-de7cf67208ed/dns-node-resolver/0.log"
Sep 15 13:40:00.086730 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:00.086703    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mqrsx_b21d4a34-9489-4099-8eef-89a54d5e9fc1/node-ca/0.log"
Sep 15 13:40:01.335072 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:01.335033    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-62ldp_a4b35ed2-1140-4126-9a04-d0a6e4dcdd56/discovery/0.log"
Sep 15 13:40:01.353030 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:01.352996    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cfb95df68-n7v4d_9682dc5b-5b44-4e08-9eb1-4cc4cf00f396/kube-auth-proxy/0.log"
Sep 15 13:40:01.473312 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:01.473276    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr_eb865e51-fc60-4fde-9f62-b071ff69fc0e/payload-pre-processing/0.log"
Sep 15 13:40:01.499743 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:01.499721    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr_8639557c-c952-443b-a6d8-412e2a219dd9/payload-pre-processing/0.log"
Sep 15 13:40:01.550638 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:01.550611    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-45tlr_c13fe9f2-5622-4ad6-9c64-bf4a7e20f440/payload-processing/0.log"
Sep 15 13:40:02.602296 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:02.602266    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j77qb_9879519f-861e-41e1-9faf-ea6502c5e01d/serve-healthcheck-canary/0.log"
Sep 15 13:40:03.139821 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:03.139793    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2w46l_64793d1d-8223-42f3-9e9a-61f328d34f29/kube-rbac-proxy/0.log"
Sep 15 13:40:03.160330 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:03.160305    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2w46l_64793d1d-8223-42f3-9e9a-61f328d34f29/exporter/0.log"
Sep 15 13:40:03.179491 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:03.179463    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2w46l_64793d1d-8223-42f3-9e9a-61f328d34f29/extractor/0.log"
Sep 15 13:40:04.231428 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:04.231402    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xpvzq/perf-node-gather-daemonset-l7r2q"
Sep 15 13:40:05.967088 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:05.967008    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79946fddd6-psd6d_a86abf55-31d6-40cc-a26e-c194e363788a/manager/0.log"
Sep 15 13:40:05.987060 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:05.987030    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79946fddd6-psd6d_a86abf55-31d6-40cc-a26e-c194e363788a/copy-manifests/0.log"
Sep 15 13:40:07.951656 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:07.951627    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-62ldp_a4b35ed2-1140-4126-9a04-d0a6e4dcdd56/discovery/0.log"
Sep 15 13:40:07.960821 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:07.960799    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cfb95df68-n7v4d_9682dc5b-5b44-4e08-9eb1-4cc4cf00f396/kube-auth-proxy/0.log"
Sep 15 13:40:08.038257 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:08.038230    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr_eb865e51-fc60-4fde-9f62-b071ff69fc0e/payload-pre-processing/0.log"
Sep 15 13:40:08.053240 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:08.053213    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr_8639557c-c952-443b-a6d8-412e2a219dd9/payload-pre-processing/0.log"
Sep 15 13:40:08.085715 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:08.085687    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-45tlr_c13fe9f2-5622-4ad6-9c64-bf4a7e20f440/payload-processing/0.log"
Sep 15 13:40:10.047274 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:10.047238    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-62ldp_a4b35ed2-1140-4126-9a04-d0a6e4dcdd56/discovery/0.log"
Sep 15 13:40:10.074573 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:10.074542    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cfb95df68-n7v4d_9682dc5b-5b44-4e08-9eb1-4cc4cf00f396/kube-auth-proxy/0.log"
Sep 15 13:40:10.178380 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:10.178349    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-inf-b-1c35dd-755f88d5d6-w4fxr_eb865e51-fc60-4fde-9f62-b071ff69fc0e/payload-pre-processing/0.log"
Sep 15 13:40:10.197040 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:10.197011    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-e2e-worker-w0-6c9f0b-584f46d8f8-28llr_8639557c-c952-443b-a6d8-412e2a219dd9/payload-pre-processing/0.log"
Sep 15 13:40:10.232479 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:10.232453    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-45tlr_c13fe9f2-5622-4ad6-9c64-bf4a7e20f440/payload-processing/0.log"
Sep 15 13:40:14.555071 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:14.555042    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rmdnt_ba39148c-16e4-4d97-bc00-ad3586383bdc/kube-multus-additional-cni-plugins/0.log"
Sep 15 13:40:14.573706 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:14.573679    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rmdnt_ba39148c-16e4-4d97-bc00-ad3586383bdc/egress-router-binary-copy/0.log"
Sep 15 13:40:14.592282 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:14.592253    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rmdnt_ba39148c-16e4-4d97-bc00-ad3586383bdc/cni-plugins/0.log"
Sep 15 13:40:14.610614 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:14.610578    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rmdnt_ba39148c-16e4-4d97-bc00-ad3586383bdc/bond-cni-plugin/0.log"
Sep 15 13:40:14.629380 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:14.629354    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rmdnt_ba39148c-16e4-4d97-bc00-ad3586383bdc/routeoverride-cni/0.log"
Sep 15 13:40:14.650938 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:14.650910    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rmdnt_ba39148c-16e4-4d97-bc00-ad3586383bdc/whereabouts-cni-bincopy/0.log"
Sep 15 13:40:14.669347 ip-10-0-129-48 kubenswrapper[2567]: I0915 13:40:14.669317    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rmdnt_ba39148c-16e4-4d97-bc00-ad3586383bdc/whereabouts-cni/0.log"